fix(cache): clean up lib

[MasterPtato]

Description

Please include a summary of the changes and the related issue. Please also include relevant motivation and context.

Type of change

• Bug fix (non-breaking change which fixes an issue)
• New feature (non-breaking change which adds functionality)
• Breaking change (fix or feature that would cause existing functionality to not work as expected)
• This change requires a documentation update

How Has This Been Tested?

Please describe the tests that you ran to verify your changes.

Checklist:

• My code follows the style guidelines of this project
• I have performed a self-review of my code
• I have commented my code, particularly in hard-to-understand areas
• I have made corresponding changes to the documentation
• My changes generate no new warnings
• I have added tests that prove my fix is effective or that my feature works
• New and existing unit tests pass locally with my changes

[railway-app]

🚅 Deployed to the rivet-pr-4457 environment in rivet-frontend

Service	Status	Web	Updated (UTC)
frontend-cloud	😴 Sleeping (View Logs)	Web	Mar 26, 2026 at 12:37 am
frontend-inspector	😴 Sleeping (View Logs)	Web	Mar 22, 2026 at 10:18 am
website	❌ Build Failed (View Logs)	Web	Mar 19, 2026 at 2:08 am
mcp-hub	✅ Success (View Logs)	Web	Mar 19, 2026 at 2:07 am
ladle	❌ Build Failed (View Logs)	Web	Mar 19, 2026 at 2:06 am

[MasterPtato]

Warning

This pull request is not mergeable via GitHub because a downstack PR is open. Once all requirements are satisfied, merge this PR as a stack on Graphite.
Learn more

• chore: envoy client #4521
• feat(pb): actors v3 #4463
• feat(ups): implement queue subs #4486
• feat(cache): add in flight deduping #4459
• fix(cache): clean up lib #4457 👈 (View in Graphite)
• fix(config): allow configuring topo dcs via map, fix pg ssl mode config #4456
• fix(api): dont 500 on cross dc response #4449
• chore: update byte units on frontend #4444
• fix: runner alloc idx logic, api auth for actor get #4443
• main

This stack of pull requests is managed by Graphite. Learn more about stacking.

[pkg-pr-new]

More templates

• actor-actions
• actor-actions-vercel
• ai-agent
• ai-agent-vercel
• example-ai-and-user-generated-actors-freestyle
• chat-room
• chat-room-vercel
• example-cloudflare-workers
• example-cloudflare-workers-hono
• collaborative-document
• collaborative-document-vercel
• cross-actor-actions
• cross-actor-actions-vercel
• example-cursors
• example-cursors-raw-websocket
• example-cursors-raw-websocket-vercel
• example-cursors-vercel
• custom-serverless
• example-elysia
• example-experimental-durable-streams-ai-agent
• example-experimental-durable-streams-ai-agent-vercel
• geo-distributed-database
• geo-distributed-database-vercel
• hello-world
• hello-world-vercel
• example-hono
• hono-react
• hono-react-vercel
• example-kitchen-sink
• example-kitchen-sink-vercel
• multi-region-vercel
• multiplayer-game
• example-multiplayer-game-patterns
• example-multiplayer-game-patterns-vercel
• multiplayer-game-vercel
• native-websockets
• native-websockets-vercel
• next-js
• per-tenant-database
• per-tenant-database-vercel
• example-raw-fetch-handler
• example-raw-fetch-handler-vercel
• example-raw-websocket-handler
• example-raw-websocket-handler-proxy
• example-raw-websocket-handler-proxy-vercel
• example-raw-websocket-handler-vercel
• example-react
• example-react-vercel
• sandbox
• sandbox-coding-agent
• sandbox-coding-agent-vercel
• sandbox-vercel
• scheduling
• scheduling-vercel
• example-sqlite-drizzle
• example-sqlite-raw
• state
• state-vercel
• example-stream
• example-stream-vercel
• example-trpc

@rivetkit/virtual-websocket

pnpm add https://pkg.pr.new/rivet-dev/rivet/@rivetkit/virtual-websocket@4457

@rivetkit/cloudflare-workers

pnpm add https://pkg.pr.new/rivet-dev/rivet/@rivetkit/cloudflare-workers@4457

@rivetkit/framework-base

pnpm add https://pkg.pr.new/rivet-dev/rivet/@rivetkit/framework-base@4457

@rivetkit/next-js

pnpm add https://pkg.pr.new/rivet-dev/rivet/@rivetkit/next-js@4457

@rivetkit/react

pnpm add https://pkg.pr.new/rivet-dev/rivet/@rivetkit/react@4457

rivetkit

pnpm add https://pkg.pr.new/rivet-dev/rivet/rivetkit@4457

@rivetkit/sql-loader

pnpm add https://pkg.pr.new/rivet-dev/rivet/@rivetkit/sql-loader@4457

@rivetkit/sqlite-vfs

pnpm add https://pkg.pr.new/rivet-dev/rivet/@rivetkit/sqlite-vfs@4457

@rivetkit/traces

pnpm add https://pkg.pr.new/rivet-dev/rivet/@rivetkit/traces@4457

@rivetkit/workflow-engine

pnpm add https://pkg.pr.new/rivet-dev/rivet/@rivetkit/workflow-engine@4457

@rivetkit/engine-runner

pnpm add https://pkg.pr.new/rivet-dev/rivet/@rivetkit/engine-runner@4457

@rivetkit/engine-runner-protocol

pnpm add https://pkg.pr.new/rivet-dev/rivet/@rivetkit/engine-runner-protocol@4457

commit: e65f84d

[claude]

Cache Library Cleanup Review

Good cleanup overall — removes dead code (Redis was a todo!() stub), eliminates double-serialization overhead, and better organizes metrics. A few issues to address before merging.

Compilation Failures in Integration Tests

The integration tests were not updated and will fail to compile:

engine/packages/cache/tests/integration.rs:10 — new_in_memory signature changed but tests still pass the old 3-argument signature. The service_name: String argument was removed, so CacheInner::new_in_memory("cache-test".to_owned(), 1000, None) must become CacheInner::new_in_memory(1000, None).

Tests still call removed public API — fetch_all (lines 17, 66, 316, 364), fetch_one (lines 103, 114, 147, 173, 184, 214, 225, 255, 287, 301, 350), and rate_limit (lines 422, 436, 467, 481, 498, 512, 528) are all removed by this PR but still used in the integration test file. These need to be migrated to fetch_one_json/fetch_all_json equivalents or deleted if the functionality is intentionally dropped.

Rate Limiting Removal

The rate_limit module is deleted entirely. If this is intentional dead-code removal, it would help to confirm in the PR description that no callers remain in production paths. The guard-core package has its own rate limiting (RateLimitConfig, RateLimiter) which is unrelated and fine.

Minor: Deref target should be str, not String

In engine/packages/cache/src/key.rs, the Deref impl targets String rather than str. Deref-ing to str is the idiomatic target for String newtypes — it matches what String itself derefs to and gives &str in one step rather than two. Minor and does not affect correctness here since &String coerces to &str via Borrow.

Positives

• Removing the double-serialization layer (encoder/decoder now work on Vec<u8>/&[u8] directly instead of an intermediate serde type) is a nice simplification.
• Moving purge metrics from driver.delete to purge_local in req_config.rs is the right location since it has base_key context naturally.
• Removing Clone from Driver/InMemoryDriver and cloning Arc<CacheInner> instead is correct.
• Cache capacity bump from 1000 to 10000 is reasonable.
• Removing the Redis todo!() variant eliminates a latent panic.