Circuit Breaker × Token Bucket
Interactive demo for LLM Router Architecture — each browser tab has its own isolated state
Circuit Breaker
CLOSED
→
HALF-OPEN
→
OPEN
Circuit is healthy. Requests flow through normally.
Token Bucket
100 / 100refill rate: 2 tokens/s · capacity: 100
Scenarios
Step 1 is a good starting point — it shows the normal happy-path flow.
Demo values — not production defaults: cooldown 10 s · probe lock 5 s · capacity 100 tokens · failure threshold 3