feat: Capture Anthropic rate limit headers for heartbeat throttling #5

2026-02-14T22:52:40+01:00

wylab commented

2026-02-14 22:52:40 +01:00

Summary

Implements Task 1 of the rate limit monitoring plan: captures Anthropic's weekly usage headers on every API call and writes them to /root/.nanobot/workspace/memory/rate_limits.json.

Changes

Modified AnthropicOAuthProvider._make_request() to parse 7 rate limit headers from API responses
Headers captured: weekly all-models utilization, Sonnet utilization, 5h session utilization, reset times, binding limit, fallback status
State file updated atomically on every API call (wrapped in try/except to never break requests)

Verification

Tested in-place: rate_limits.json correctly populated after API call with:

{
  "weekly_all_models": 0.84,
  "session_5h": 0.23,
  "binding_limit": "seven_day",
  ...
}

Next Steps

Task 2: Update HEARTBEAT.md to read this file and gate heartbeat frequency based on weekly_all_models threshold

## Summary Implements Task 1 of the rate limit monitoring plan: captures Anthropic's weekly usage headers on every API call and writes them to `/root/.nanobot/workspace/memory/rate_limits.json`. ## Changes - Modified `AnthropicOAuthProvider._make_request()` to parse 7 rate limit headers from API responses - Headers captured: weekly all-models utilization, Sonnet utilization, 5h session utilization, reset times, binding limit, fallback status - State file updated atomically on every API call (wrapped in try/except to never break requests) ## Verification Tested in-place: `rate_limits.json` correctly populated after API call with: ```json { "weekly_all_models": 0.84, "session_5h": 0.23, "binding_limit": "seven_day", ... } ``` ## Next Steps - [ ] Task 2: Update `HEARTBEAT.md` to read this file and gate heartbeat frequency based on `weekly_all_models` threshold ## Related Part of `/root/.nanobot/workspace/docs/plans/2026-02-14-rate-limit-monitoring.md`

wylab added 1 commit 2026-02-14 22:52:41 +01:00

feat: capture Anthropic rate limit headers for heartbeat throttling

Build Nanobot OAuth / cleanup (pull_request) Has been skipped

Details

Build Nanobot OAuth / build (pull_request) Successful in 5m40s

Details

1d940cb4f2

Adds rate limit state capture to _make_request():
- Parses 7 Anthropic rate limit headers from every API response
- Writes to memory/rate_limits.json with utilization, reset times, binding limit
- Enables HEARTBEAT.md to throttle based on weekly_all_models budget

Part of rate limit monitoring implementation plan.

wylab referenced this issue from a commit

2026-02-14 23:51:28 +01:00

feat: dynamic Opus/Sonnet model switching based on rolling quota

wylab referenced this pull request

2026-02-14 23:51:45 +01:00

feat: dynamic Opus/Sonnet model switching based on rolling quota #6

wylab commented

2026-02-14 23:51:59 +01:00

Closing this PR in favor of #6.

Why: This PR implemented the wrong approach - it throttles heartbeat frequency, but heartbeats already use Sonnet (separate budget pool). The real problem is Opus overuse in main conversation turns.

Solution: PR #6 implements dynamic model switching for the main agent based on rolling weekly quota. When burn rate exceeds target, main agent switches to Sonnet. When under quota, switches back to Opus.

The rate limit header capture from this PR is still valuable and will be used by #6.

Closing this PR in favor of #6. **Why:** This PR implemented the wrong approach - it throttles heartbeat frequency, but heartbeats already use Sonnet (separate budget pool). The real problem is Opus overuse in main conversation turns. **Solution:** PR #6 implements dynamic model switching for the main agent based on rolling weekly quota. When burn rate exceeds target, main agent switches to Sonnet. When under quota, switches back to Opus. The rate limit header capture from this PR is still valuable and will be used by #6.

wylab closed this pull request

2026-02-14 23:52:00 +01:00

wylab referenced this issue from a commit

2026-02-15 00:37:23 +01:00

feat: dynamic Opus/Sonnet model switching based on rolling quota

wylab referenced this issue from a commit

2026-02-15 11:58:36 +01:00

Merge feat/quota-model-switching into feat/rate-limit-tracking

wylab referenced this pull request

2026-02-15 14:05:50 +01:00

Quota-based model switching + thinking mode fixes #9

code-server referenced this issue from a commit