Production Readiness
Operational runbook
Operator runbook for incidents, manual review, and support workflows.
Operational runbook
Use this runbook for day-2 operations after launch.
Watch items
- operator API auth failures
- wallet adapter timeouts
- balance operations in
unknownormanual_review - Polyflight purchases in wallet lifecycle
unknown,manual_review, orcompensation_pending - Polyflight payments in
owedormanual_review - unresolved native liabilities or blocked statement finalization
- webhook deliveries in
failedordead_letter - unexpected Opinion market or Polyflight entry complaints
First-response flow
- identify affected user or event
- capture UTC time window
- locate
idempotency_key,event_id, Opinionorder_id/redemption ID, or Polyflight purchase/ticket/flight/obligation ID - determine if money movement, public result, or statement liability may be affected
- stop retries or replays until state is understood
Wallet incidents
If balance operation is unknown:
- inspect the operator wallet ledger using the same
idempotency_key - confirm whether the original mutation landed
- do not replay a primary debit or credit automatically
- only then decide whether compensation or manual resolution is needed
If balance operation is manual_review:
- gather operator-side wallet logs
- gather related trade or redemption record
- escalate with exact IDs
For Polyflight, reconcile wallet evidence separately from the public outcome. A won/cancelled ticket remains won/cancelled while payout/refund is owed. Operators provide evidence; only an authorized Polynion administrator can record manual resolution. Then confirm the related event, liability, statement, and export changed once.
Webhook incidents
If delivery is failed:
- inspect last status code and response body sample
- fix receiver issue
- wait for retry or replay manually if needed
If delivery is dead_letter:
- confirm receiver fix deployed
- replay from dashboard or operator API
- confirm latest attempt becomes
sent
Key rotation runbook
- create replacement key
- deploy secret
- smoke one endpoint
- revoke old key
- monitor for
INVALID_API_KEYspikes
