feat(index): parse worker timeouts and recycle#130
Conversation
Process one file per worker message with Promise.race timeouts (10–30s scaled by size), recycle workers every 250 files, route incremental parsing through the worker pool, and surface parse failure counts in the index summary.
🦋 Changeset detectedLatest commit: 467fe68 The changes in this PR will be included in the next version bump. This PR includes changesets to release 1 package
Not sure what this means? Click here to learn what changesets are. Click here if you're a maintainer who wants to add another changeset to this PR |
|
Warning Review limit reached
Your plan includes 1 review of capacity. Refill in 16 minutes and 16 seconds. Your organization has run out of usage credits. Purchase more in the billing tab. ⌛ How to resolve this issue?After more review capacity refills, a review can be triggered using the We recommend that you space out your commits to avoid hitting the rate limit. 🚦 How do rate limits work?CodeRabbit enforces hourly rate limits for each developer per organization. Our paid plans have higher rate limits than trial, open-source, and free plans. In all cases, review capacity refills continuously over time. Please see our FAQ for further information. ℹ️ Review info⚙️ Run configurationConfiguration used: defaults Review profile: CHILL Plan: Pro Run ID: 📒 Files selected for processing (7)
✨ Finishing Touches🧪 Generate unit tests (beta)
Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out. Comment |
Keep per-file timeout via chunk bisection on timeout, inline parse for small batches (<=12 files), and worker recycle. Fixes CLI integration test timeouts from per-message worker spawn overhead.
Summary
Completes PR 3 stack after #129 (index lock + errors.log):
CODEMAP_PARSE_TIMEOUT_MSoverride)CODEMAP_WORKER_RECYCLE_EVERY)errors.logthrough existingparseErrorpathTest plan
bun test src/application/parse-timeout.test.tsbun test src/worker-pool.test.tsbun test src/application/run-index.test.ts