Skip to content

Configuration Reference

CLI Options

fallbackrabbit serve

Flag Default Description
--host 127.0.0.1 Bind address
--port 8000 Port number
--storage memory:// Storage URL (memory:// or sqlite:///path.db)
--reload false Enable auto-reload for development
--api-keys API keys (comma-separated or label:key pairs)
--rate-limit 60 Per-IP rate limit per minute
--rate-limit-global 600 Global rate limit per minute
--rate-limit-burst 10 Burst allowance

fallbackrabbit test

Flag Default Description
--prompts 5 Number of test prompts
--outages Outage scenario file
--verbose false Detailed per-prompt results
--real false Make real provider calls

fallbackrabbit export

Flag Default Description
--format litellm Export format
--output stdout Output file path
--template Jinja2 template file
--extra-vars Template variables (key=value, repeatable)

Environment Variables

Variable Description
OPENAI_API_KEY OpenAI API key
ANTHROPIC_API_KEY Anthropic API key
AZURE_OPENAI_API_KEY Azure OpenAI API key
AZURE_OPENAI_ENDPOINT Azure OpenAI endpoint URL
OLLAMA_BASE_URL Ollama base URL (default: http://localhost:11434)
FALLBACKRABBIT_API_KEYS API keys for authentication
FALLBACKRABBIT_STORAGE_URL Default storage URL

Export Formats

Format Description
litellm LiteLLM model config
openrouter OpenRouter routing config
langchain LangChain router config
haystack Haystack pipeline config
custom Raw JSON dump
template Jinja2 template-based

Error Types

Type HTTP Codes Default Action
rate_limit 429 Retry
timeout 408, 504 Failover
server_error 500, 502, 503 Failover
auth_error 401, 403 Fail
connection_error Failover
validation_error 400 Fail

Fallback Actions

Action Behavior
retry Retry same provider (up to max_retries)
failover Try next provider
wait Wait wait_ms then retry same provider
fail Stop immediately