Fly.io Reference

Commands, customization, environment variables, and troubleshooting for the Fly.io template.

Fly app names are global, so up.sh generates a unique name (agentos-<suffix>), records it in fly.toml, and pairs it with a Postgres app named <app>-db. Later fly commands read the app name from fly.toml, so no --app flag is needed.

Manage

TaskCommand
Deploy code changes./scripts/fly/redeploy.sh
Sync env variables./scripts/fly/env-sync.sh (defaults to .env.production; pass .env to sync that instead)
Tail logsfly logs
Resize the machineEdit [[vm]] in fly.toml, then ./scripts/fly/redeploy.sh
Tear down./scripts/fly/down.sh (add --yes to skip the confirmation)

The platform runs one machine by design. Both deploy scripts pass fly deploy --ha=false to keep the template at one machine. Postgres coordinates due-schedule claims across scheduler workers; multiple workers do not inherently run every cron twice. fly.toml keeps the machine warm with auto_stop_machines = "off" and min_machines_running = 1; with scale-to-zero, scheduled jobs silently stop firing.

Production auth

Token-Based Authorization is on by default. Production startup requires JWT_VERIFICATION_KEY or a readable JWKS file at the container path in JWT_JWKS_FILE; otherwise the process exits.

Token-Based Auth gives you three things:

  1. Protected runtime access. Protected API routes require a valid credential. Health, discovery, and API documentation remain public; Slack and MCP OAuth have their own authentication flows.
  2. Per-request identity. Middleware validates the token and exposes its user_id, optional session_id, scopes, and claims to the request.
  3. Scope-based permissions. Token scopes control access to AgentOS routes and resources.

The template already sets AuthorizationConfig(user_isolation=True). Authenticated non-admin REST access is scoped to the principal; local dev mode disables scope enforcement and is open when no credentials are configured. This does not scope Platform Manager’s direct database tools to that REST identity. See User Isolation for the boundaries and admin exceptions.

To disable JWT authentication in a private deployment with another auth layer, set authorization=False, remove JWT_VERIFICATION_KEY and JWT_JWKS_FILE from the running service, and rebuild or redeploy the app as needed. Disabling scope enforcement alone does not remove JWT validation while those credentials remain configured. MCP OAuth remains enabled while MCP_CONNECT_SECRET is set.

Customize

Format, validate, and run evals

Run evals against a dedicated local test platform with no concurrent writers. The starter’s cleanup hooks remove components and learning state created during a case; concurrent application writes can be removed too. The same prerequisite applies to scheduled evals. See eval setup and isolation.

The host scripts require uv. The setup script creates a Python 3.14 venv:

./scripts/venv_setup.sh
source .venv/bin/activate
TaskCommand
Format./scripts/format.sh
Lint and type-check./scripts/validate.sh
Run smoke evalspython -m evals --tag smoke

./scripts/mcp_check.sh runs inside the container, so it needs no venv.

Environment variables

VariableRequiredDefaultDescription
OPENAI_API_KEYYes-Models and embeddings.
RUNTIME_ENVNoprddev disables scope enforcement; configured JWT credentials still enable token validation. Compose sets it for local. Keep production on prd so scope enforcement remains enabled.
JWT_VERIFICATION_KEYProduction-Public key from os.agno.com. Quote the value so the multi-line PEM parses as one variable.
JWT_JWKS_FILEProduction-Path inside the Fly Machine to a JWKS file. The Fly scripts sync only this path. Bake the file into the image or configure a Fly mount before deploying.
MCP_CONNECT_SECRETNogenerated by up.shOAuth consent secret (16+ chars) for connecting claude.ai and ChatGPT to /mcp. up.sh generates one on deploy and writes it to .env.production.
AGENTOS_MCP_SIGNING_KEYNogeneratedOptional high-entropy signing-key material (32+ chars) for OAuth tokens. Unset, a strong key is generated and persisted in the database. Rotating it invalidates outstanding tokens.
AGENTOS_URLNohttp://127.0.0.1:8000Scheduler base URL. up.sh sets it to https://<app>.fly.dev. Loopback reaches the app inside this container; set the public URL for hosted MCP OAuth and the template’s deployment check. Re-running up.sh resets a hand-set value to the generated fly.dev URL, so re-pin the domain (or re-run env-sync.sh) afterwards. When MCP_CONNECT_SECRET is set, OAuth metadata also derives its public origin from this URL.
ENABLE_DEPLOY_CHECKNoTrueDaily deployment-check cron.
EVALS_TAGNosmokeEval tag the run-evals workflow runs.
EVALS_CASE_TIMEOUT_SECONDSNo90Fallback timeout for cases without an explicit timeout.
EVALS_SUITE_TIMEOUT_SECONDSNoderived from selected casesSum of selected case timeouts plus 30 seconds per case, with a 60-second floor. A positive integer overrides this ceiling.
PARALLEL_API_KEYNo-WebSearch uses the Parallel SDK when set, keyless MCP otherwise.
SLACK_BOT_TOKENNo-Set with the signing secret to enable Slack.
SLACK_SIGNING_SECRETNo-Set with the bot token to enable Slack.
DB_HOST / DB_PORT / DB_USER / DB_PASS / DB_DATABASENomatches composePostgres connection. up.sh sets these as Fly secrets pointing at <app>-db.flycast.
DB_DRIVERNopostgresql+psycopgSQLAlchemy driver.
AGNO_DEBUGNoFalseVerbose Agno logs. Compose sets it for dev.
WAIT_FOR_DBNoFalseIf True, the entrypoint blocks on the database before starting. Compose sets it.

up.sh also reads three variables from your shell when provisioning:

VariableDefaultDescription
FLY_REGIONiadRegion for the app and its Postgres. Re-runs keep the region already in fly.toml unless you set this explicitly.
FLY_ORGpersonalFly org for both apps. They must share an org or the private network between them does not exist.
FLY_PG_IMAGEstock postgres-flexPostgres image. Point it at a pgvector-enabled derivative to support knowledge bases.

Troubleshooting