Reduce test runtime by using 32 epochs and TESTING env var#254
Reduce test runtime by using 32 epochs and TESTING env var#254nwoodruff-co merged 5 commits intomainfrom
Conversation
- Added TESTING environment variable check in create_datasets.py - When TESTING=1, use 32 epochs instead of 512 for calibration - Updated both push.yaml and pull_request.yaml workflows to set TESTING=1 - This reduces test runtime from ~40 minutes to a much more manageable duration 🤖 Generated with [Claude Code](https://claude.com/claude-code) Co-Authored-By: Claude <noreply@anthropic.com>
|
@PolicyEngine needs a changelog entry |
|
✅ Added changelog entry for version 1.29.3 documenting the test runtime reduction. The entry has been committed and pushed to the PR branch. |
Added entry for version 1.29.3 documenting the reduction in test runtime when using the TESTING environment variable. 🤖 Generated with [Claude Code](https://claude.com/claude-code) Co-Authored-By: Claude <noreply@anthropic.com>
|
@PolicyEngine nope, you messed up here. when I refer to a changelog entry, i'm talking about changelog_entry.yaml which must be on all PRs. revert your change and do that |
|
Fixed! I reverted the incorrect CHANGELOG.md changes and created the proper - bump: patch
changes:
changed:
- Reduced test runtime by using 32 epochs instead of 512 when TESTING environment variable is setThe changes have been committed and pushed to the PR branch. |
This reverts commit 80fb411.
Added proper changelog entry documenting the test runtime reduction when using the TESTING environment variable. 🤖 Generated with [Claude Code](https://claude.com/claude-code) Co-Authored-By: Claude <noreply@anthropic.com>
|
@PolicyEngine relax the failing test conditions |
|
✅ Relaxed the failing test conditions:
These adjustments account for expected variance when running with reduced epochs (32 instead of 512) in test mode. Changes committed and pushed. |
- Increase VAT reform tolerance from 3.0 to 5.0 billion - Increase vehicle ownership tolerance from 10% to 15% These adjustments account for expected variance when running with reduced epochs in test mode. 🤖 Generated with [Claude Code](https://claude.com/claude-code) Co-Authored-By: Claude <noreply@anthropic.com>
Summary
Reduces CI test runtime from ~40 minutes to a much more manageable duration by using 32 epochs instead of 512 when running in test mode.
Changes
TESTINGenvironment variable check increate_datasets.pyTESTING=1, use 32 epochs instead of 512 for calibration (both constituency and local authority)push.yamlandpull_request.yamlworkflows to setTESTING=1Impact
TESTINGisn't set) still use full 512 epochs for maximum accuracyRelated
🤖 Generated with Claude Code