Skip to content

Exectuion and optimization tracing harness for testing#7814

Draft
AdamGS wants to merge 3 commits intodevelopfrom
adamg/execution-tests
Draft

Exectuion and optimization tracing harness for testing#7814
AdamGS wants to merge 3 commits intodevelopfrom
adamg/execution-tests

Conversation

@AdamGS
Copy link
Copy Markdown
Contributor

@AdamGS AdamGS commented May 6, 2026

Summary

Closes: #000

Testing

@AdamGS AdamGS added the changelog/feature A new feature label May 6, 2026
Signed-off-by: Adam Gutglick <adam@spiraldb.com>
@AdamGS AdamGS force-pushed the adamg/execution-tests branch from 1520af8 to 51759b3 Compare May 6, 2026 14:41
@codspeed-hq
Copy link
Copy Markdown

codspeed-hq Bot commented May 6, 2026

Merging this PR will degrade performance by 11.49%

⚠️ Unknown Walltime execution environment detected

Using the Walltime instrument on standard Hosted Runners will lead to inconsistent data.

For the most accurate results, we recommend using CodSpeed Macro Runners: bare-metal machines fine-tuned for performance measurement consistency.

⚠️ Different runtime environments detected

Some benchmarks with significant performance changes were compared across different runtime environments,
which may affect the accuracy of the results.

Open the report in CodSpeed to investigate

⚡ 1 improved benchmark
❌ 5 regressed benchmarks
✅ 1200 untouched benchmarks

⚠️ Please fix the performance issues or acknowledge them on CodSpeed.

Performance Changes

Mode Benchmark BASE HEAD Efficiency
Simulation search_index_above_max 268.9 µs 303.3 µs -11.34%
Simulation search_index_below_min 265 µs 299.4 µs -11.49%
Simulation search_index_full_range_random 266.9 µs 301.3 µs -11.42%
Simulation search_index_in_range 267.3 µs 301.7 µs -11.41%
Simulation search_index_mixed_out_of_range 267.1 µs 301.4 µs -11.39%
Simulation new_bp_prim_test_between[i64, 32768] 236.6 µs 177.9 µs +32.98%

Comparing adamg/execution-tests (6e2d090) with develop (115b3ba)

Open in CodSpeed

AdamGS added 2 commits May 6, 2026 21:43
Signed-off-by: Adam Gutglick <adam@spiraldb.com>
Signed-off-by: Adam Gutglick <adam@spiraldb.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

changelog/feature A new feature

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant