feat(llm-gateway): complete Cloudflare Worker implementation (Phases 1–7)#752

Open

iscekic wants to merge 82 commits intomainfrom

feat/llm-gateway

Commits on Mar 2, 2026

feat(llm-gateway): phase 1 scaffolding
iscekic
committed
chore(llm-gateway): strip wrangler.jsonc to bare minimum
iscekic
committed
chore(llm-gateway): tidy wrangler.jsonc bindings
iscekic
committed
feat(llm-gateway): phase 2 — request parsing, auth, anonymous gate
iscekic
committed
feat(llm-gateway): Phase 3 — rate limiting + provider resolution
iscekic
committed
Phase 4: balance/org checks, request validation, request transform
iscekic
committed
feat(llm-gateway): Phase 5 — upstream proxy + response handling
iscekic
committed
feat(llm-gateway): Phase 6 — background tasks (usage accounting, api metrics, request logging, abuse cost)
iscekic
committed
feat(llm-gateway): Phase 7 — testing + parity verification (168 tests passing)
iscekic
committed
refactor(llm-gateway): replace setTimeout with scheduler.wait
iscekic
committed
refactor(llm-gateway): use O11Y service binding RPC instead of HTTP fetch
iscekic
committed

Commits on Mar 3, 2026