AI Deploy Bench

Railway · Opus 5.5 · medium effort · HIPAA organization · trial 1

API / Backend Service on Railway

Needs a person stopped at the human stage

Checks passed0/0
Human steps37 min of a person's time
Security & compliance—
Stack fit—
Build2m 20s
Deploy1m 00s
Tokens1.35M
Agent cost$0.91
Hosting / month$0.00 light use$0.00 busy

Deployed to https://….up.railway.app. Every deployment is deleted after it's verified and reviewed.

Technologies

Runtime
Node.js 20+
Frameworks
Express
Libraries
node-postgres
Packaging
railway.json

Named from the app's dependencies, Dockerfile and config files, and the cloud resources it created.

Human steps

What blocked the deploy

Stack fit

Not rated: no reachable deployment to review.

Security & compliance review

Not scored: no reachable deployment to review.

Cloud resources and cost

TrafficPer monthHow it was priced
Light use
Barely used: a few visits a week, about 2,000 requests a month. A scale-to-zero app is awake about 10 hours a month, idle timeouts included.		$0.00nothing deployed
Busy
A public app that crawlers, uptime monitors and visitors hit around the clock: one request a second on average, so it never goes idle.		$0.00nothing deployed

The benchmark found no cloud resources for this cell.

The agent estimated $2.00 a month.

Code

Code
512 lines in 15 files (JavaScript 494, JSON 63, Markdown 47, Shell 18)
Dependencies
2 npm, 0 Python
Deploy config
railway.json

The agent's sessions

PhaseStatusTimeTurnsTokensCostShell commands
Buildcompleted2m 20s11453.7K$0.5210
Deploycompleted1m 00s9534.1K$0.218

The agent's deploy summary

The app is still not deployed. The Railway token works, but the account won't let me create any new resources, so there is no public URL and I couldn't test anything through one.

What happened

  • I tried to create the project adb-hnc3c-api twice, once with the CLI and once directly through Railway's API. Both times Railway answered: "Free plan resource provision limit exceeded. Please upgrade to provision more resources!"
  • The workspace "Javier Luraschi's Projects" is still on its trial: Railway shows it as inactive, with $5 of credit.
  • It already holds two projects from other runs, adb-ytghj-static and adb-bbchf-static, which appear to use up the trial's allowance. They aren't mine, so I didn't delete them or deploy into them.
  • Nothing was created, so nothing is being billed. I didn't save anything to .env because the token already comes from the environment.

Human steps (recorded as blocking in deployment.json):

  1. Free up room in the workspace, either by deleting those two projects if they're no longer needed or by adding a payment method to activate the Hobby plan.
  2. Run ./deploy.sh with RAILWAY_API_TOKEN and BENCH_API_KEYS set, then copy the printed https://….up.railway.app address into deployment.json.

The script creates the project, a Postgres database and the adb-hnc3c-api-web service. It sets API_KEYS to exactly BENCH_API_KEYS, uploads the code and creates the public HTTPS address. It has still never run against Railway, because every attempt stopped at creating the project. I expect the app to cost about $1–2 a month of usage credit.

After it's deployed: Railway's database template names its service Postgres, which breaks the naming rule. Renaming it to adb-hnc3c-api-db means also updating DATABASE_URL to the new name. The rate limit is counted in the server's memory, so keep the web service at one copy.

8 shell commands during deploy
  1. 3s railway --version && railway whoami 2>&1 | head -3; railway list 2>&1 | head
  2. 7s railway init --name adb-hnc3c-api 2>&1 | tail -3 && railway add --database postgres 2>&1 | tail -3
  3. 13s cd /tmp && q(){ curl -s https://backboard.railway.com/graphql/v2 -H "Authorization: Bearer $RAILWAY_API_TOKEN" -H 'Content-Type: application/json' -d "$1"; }
  4. 17s q(){ curl -s https://backboard.railway.com/graphql/v2 -H "Authorization: Bearer $RAILWAY_API_TOKEN" -H 'Content-Type: application/json' -d "$1"; }
  5. 21s q(){ curl -s https://backboard.railway.com/graphql/v2 -H "Authorization: Bearer $RAILWAY_API_TOKEN" -H 'Content-Type: application/json' -d "$1"; }
  6. 25s sleep 35; q(){ curl -s https://backboard.railway.com/graphql/v2 -H "Authorization: Bearer $RAILWAY_API_TOKEN" -H 'Content-Type: application/json' -d "$1"; }
  7. 29s q(){ curl -s https://backboard.railway.com/graphql/v2 -H "Authorization: Bearer $RAILWAY_API_TOKEN" -H 'Content-Type: application/json' -d "$1"; }
  8. 52s python3 - <<'EOF'

Raw data

Report on GitHub Full record (JSON) Workflow run, with transcripts