Skip to content

Slots are a Box<[...]> instead of Vec<...>#7822

Closed
robert3005 wants to merge 2 commits intodevelopfrom
rk/smallvec
Closed

Slots are a Box<[...]> instead of Vec<...>#7822
robert3005 wants to merge 2 commits intodevelopfrom
rk/smallvec

Conversation

@robert3005
Copy link
Copy Markdown
Contributor

Trying to see if the one pointer less is beneficial

Signed-off-by: Robert Kruszewski github@robertk.io

Signed-off-by: Robert Kruszewski <github@robertk.io>
@robert3005 robert3005 added action/benchmark Trigger full benchmarks to run on this PR changelog/chore A trivial change labels May 6, 2026
@github-actions github-actions Bot removed the action/benchmark Trigger full benchmarks to run on this PR label May 6, 2026
@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 6, 2026

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done a1d2e1e 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 6, 2026

Benchmarks: PolarSignals Profiling

Vortex (geomean): 1.010x ➖


datafusion / vortex-file-compressed (1.010x ➖, 0↑ 0↓)
name PR a1d2e1e (ns) base eda8c2c (ns) ratio (PR/base)
polarsignals_q00/datafusion:vortex-file-compressed 124678647 123402731 1.01
polarsignals_q01/datafusion:vortex-file-compressed 258742051 283046410 0.91
polarsignals_q02/datafusion:vortex-file-compressed 23287873 23993648 0.97
polarsignals_q03/datafusion:vortex-file-compressed 282350216 278565420 1.01
polarsignals_q04/datafusion:vortex-file-compressed 12651479 11641773 1.09
polarsignals_q05/datafusion:vortex-file-compressed 15978491 15208556 1.05
polarsignals_q06/datafusion:vortex-file-compressed 19281138 18512506 1.04
polarsignals_q07/datafusion:vortex-file-compressed 14239042 13742818 1.04
polarsignals_q08/datafusion:vortex-file-compressed 414580936 405949392 1.02
polarsignals_q09/datafusion:vortex-file-compressed 11357868 11756145 0.97

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 6, 2026

File Sizes: PolarSignals Profiling

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 6, 2026

Benchmarks: FineWeb NVMe

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.0%
Vortex (geomean): 0.994x ➖
Parquet (geomean): 0.994x ➖
Shifts: Parquet (control) -0.6% · Median polish -0.8%


datafusion / vortex-file-compressed (1.008x ➖, 0↑ 1↓)
name PR a1d2e1e (ns) base eda8c2c (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 5087688 5240437 0.97
fineweb_q01/datafusion:vortex-file-compressed 🚨 20512244 18153299 1.13
fineweb_q02/datafusion:vortex-file-compressed 22282673 22276798 1.00
fineweb_q03/datafusion:vortex-file-compressed 76507081 71841428 1.06
fineweb_q04/datafusion:vortex-file-compressed 230574904 230610117 1.00
fineweb_q05/datafusion:vortex-file-compressed 215795531 217474354 0.99
fineweb_q06/datafusion:vortex-file-compressed 51449010 52447646 0.98
fineweb_q07/datafusion:vortex-file-compressed 55128602 57760278 0.95
fineweb_q08/datafusion:vortex-file-compressed 22705736 23037662 0.99
datafusion / vortex-compact (0.991x ➖, 0↑ 0↓)
name PR a1d2e1e (ns) base eda8c2c (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 5390573 5822199 0.93
fineweb_q01/datafusion:vortex-compact 123728784 125015824 0.99
fineweb_q02/datafusion:vortex-compact 128733237 127370506 1.01
fineweb_q03/datafusion:vortex-compact 1024777651 1034611154 0.99
fineweb_q04/datafusion:vortex-compact 1114978004 1106650099 1.01
fineweb_q05/datafusion:vortex-compact 947058870 945434365 1.00
fineweb_q06/datafusion:vortex-compact 521091085 531718283 0.98
fineweb_q07/datafusion:vortex-compact 532209939 538985213 0.99
fineweb_q08/datafusion:vortex-compact 17964466 17522147 1.03
datafusion / parquet (0.993x ➖, 0↑ 0↓)
name PR a1d2e1e (ns) base eda8c2c (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 6333697 6090788 1.04
fineweb_q01/datafusion:parquet 279407297 293771590 0.95
fineweb_q02/datafusion:parquet 283871378 288715952 0.98
fineweb_q03/datafusion:parquet 293159054 281631940 1.04
fineweb_q04/datafusion:parquet 295830981 300096112 0.99
fineweb_q05/datafusion:parquet 291811931 296467213 0.98
fineweb_q06/datafusion:parquet 284096643 296636369 0.96
fineweb_q07/datafusion:parquet 285369900 282343279 1.01
fineweb_q08/datafusion:parquet 274476405 277655583 0.99
duckdb / vortex-file-compressed (1.002x ➖, 0↑ 0↓)
name PR a1d2e1e (ns) base eda8c2c (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 3171261 3105144 1.02
fineweb_q01/duckdb:vortex-file-compressed 22518531 22069466 1.02
fineweb_q02/duckdb:vortex-file-compressed 22752967 24101855 0.94
fineweb_q03/duckdb:vortex-file-compressed 121172266 115070826 1.05
fineweb_q04/duckdb:vortex-file-compressed 222846190 218806463 1.02
fineweb_q05/duckdb:vortex-file-compressed 211261203 212871474 0.99
fineweb_q06/duckdb:vortex-file-compressed 51034845 51946802 0.98
fineweb_q07/duckdb:vortex-file-compressed 54799562 55328220 0.99
fineweb_q08/duckdb:vortex-file-compressed 22114510 22093382 1.00
duckdb / vortex-compact (0.975x ➖, 0↑ 0↓)
name PR a1d2e1e (ns) base eda8c2c (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 3769309 4098618 0.92
fineweb_q01/duckdb:vortex-compact 102116480 110192498 0.93
fineweb_q02/duckdb:vortex-compact 107442902 107362806 1.00
fineweb_q03/duckdb:vortex-compact 853778953 858268788 0.99
fineweb_q04/duckdb:vortex-compact 902002422 901297491 1.00
fineweb_q05/duckdb:vortex-compact 805041973 818236412 0.98
fineweb_q06/duckdb:vortex-compact 451106374 461451428 0.98
fineweb_q07/duckdb:vortex-compact 476296222 479660440 0.99
fineweb_q08/duckdb:vortex-compact 20447530 20918249 0.98
duckdb / parquet (0.994x ➖, 0↑ 0↓)
name PR a1d2e1e (ns) base eda8c2c (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 31061803 31509844 0.99
fineweb_q01/duckdb:parquet 81858172 82191426 1.00
fineweb_q02/duckdb:parquet 82983197 83049048 1.00
fineweb_q03/duckdb:parquet 307669004 310001613 0.99
fineweb_q04/duckdb:parquet 436878171 438683126 1.00
fineweb_q05/duckdb:parquet 408984013 411075453 0.99
fineweb_q06/duckdb:parquet 196203916 196711053 1.00
fineweb_q07/duckdb:parquet 207453190 207643158 1.00
fineweb_q08/duckdb:parquet 28486652 28910941 0.99
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-compact -7.4% +1.2% -8.6% +51.5% ➖ noise
0 datafusion:vortex-file-compressed -2.9% +1.2% -4.1% +54.1% ➖ noise
0 duckdb:vortex-compact -8.0% +1.2% -9.2% +96.6% ➖ noise
0 duckdb:vortex-file-compressed +2.1% +1.2% +0.9% +91.7% ➖ noise
1 datafusion:vortex-compact -1.0% -2.7% +1.7% +11.4% ➖ noise
1 datafusion:vortex-file-compressed +13.0% -2.7% +16.1% +26.4% ➖ noise
1 duckdb:vortex-compact -7.3% -2.7% -4.8% +21.4% ➖ noise
1 duckdb:vortex-file-compressed +2.0% -2.7% +4.8% +56.5% ➖ noise
2 datafusion:vortex-compact +1.1% -0.9% +2.0% +10.4% ➖ noise
2 datafusion:vortex-file-compressed +0.0% -0.9% +0.9% +17.9% ➖ noise
2 duckdb:vortex-compact +0.1% -0.9% +1.0% +10.0% ➖ noise
2 duckdb:vortex-file-compressed -5.6% -0.9% -4.8% +23.0% ➖ noise
3 datafusion:vortex-compact -1.0% +1.6% -2.5% +10.0% ➖ noise
3 datafusion:vortex-file-compressed +6.5% +1.6% +4.8% +40.6% ➖ noise
3 duckdb:vortex-compact -0.5% +1.6% -2.1% +10.0% ➖ noise
3 duckdb:vortex-file-compressed +5.3% +1.6% +3.6% +34.8% ➖ noise
4 datafusion:vortex-compact +0.8% -0.9% +1.7% +10.0% ➖ noise
4 datafusion:vortex-file-compressed -0.0% -0.9% +0.9% +10.0% ➖ noise
4 duckdb:vortex-compact +0.1% -0.9% +1.0% +10.0% ➖ noise
4 duckdb:vortex-file-compressed +1.8% -0.9% +2.8% +10.0% ➖ noise
5 datafusion:vortex-compact +0.2% -1.0% +1.2% +10.0% ➖ noise
5 datafusion:vortex-file-compressed -0.8% -1.0% +0.3% +10.0% ➖ noise
5 duckdb:vortex-compact -1.6% -1.0% -0.6% +10.0% ➖ noise
5 duckdb:vortex-file-compressed -0.8% -1.0% +0.3% +10.0% ➖ noise
6 datafusion:vortex-compact -2.0% -2.3% +0.3% +10.0% ➖ noise
6 datafusion:vortex-file-compressed -1.9% -2.3% +0.4% +14.2% ➖ noise
6 duckdb:vortex-compact -2.2% -2.3% +0.0% +10.0% ➖ noise
6 duckdb:vortex-file-compressed -1.8% -2.3% +0.5% +10.0% ➖ noise
7 datafusion:vortex-compact -1.3% +0.5% -1.7% +10.0% ➖ noise
7 datafusion:vortex-file-compressed -4.6% +0.5% -5.0% +20.5% ➖ noise
7 duckdb:vortex-compact -0.7% +0.5% -1.2% +10.0% ➖ noise
7 duckdb:vortex-file-compressed -1.0% +0.5% -1.4% +20.5% ➖ noise
8 datafusion:vortex-compact +2.5% -1.3% +3.9% +11.6% ➖ noise
8 datafusion:vortex-file-compressed -1.4% -1.3% -0.1% +20.4% ➖ noise
8 duckdb:vortex-compact -2.3% -1.3% -1.0% +36.5% ➖ noise
8 duckdb:vortex-file-compressed +0.1% -1.3% +1.4% +11.3% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 6, 2026

File Sizes: FineWeb NVMe

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 6, 2026

Benchmarks: TPC-H SF=1 on NVME

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +2.6%
Vortex (geomean): 0.933x ➖
Parquet (geomean): 0.912x ➖
Shifts: Parquet (control) -8.8% · Median polish -6.4%


datafusion / vortex-file-compressed (0.906x ➖, 7↑ 0↓)
name PR a1d2e1e (ns) base eda8c2c (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 52916187 55420292 0.95
tpch_q02/datafusion:vortex-file-compressed 22986231 24613980 0.93
tpch_q03/datafusion:vortex-file-compressed 29283804 32466751 0.90
tpch_q04/datafusion:vortex-file-compressed 21590221 23388320 0.92
tpch_q05/datafusion:vortex-file-compressed 🚀 51374870 58272735 0.88
tpch_q06/datafusion:vortex-file-compressed 13119436 14191106 0.92
tpch_q07/datafusion:vortex-file-compressed 🚀 57457035 66237477 0.87
tpch_q08/datafusion:vortex-file-compressed 🚀 41320743 46290556 0.89
tpch_q09/datafusion:vortex-file-compressed 55150258 59480088 0.93
tpch_q10/datafusion:vortex-file-compressed 42254702 46613632 0.91
tpch_q11/datafusion:vortex-file-compressed 16885003 18657371 0.91
tpch_q12/datafusion:vortex-file-compressed 26433609 28842239 0.92
tpch_q13/datafusion:vortex-file-compressed 🚀 25366680 28990339 0.88
tpch_q14/datafusion:vortex-file-compressed 🚀 16914913 20471306 0.83
tpch_q15/datafusion:vortex-file-compressed 27390421 29842948 0.92
tpch_q16/datafusion:vortex-file-compressed 20617326 22229467 0.93
tpch_q17/datafusion:vortex-file-compressed 🚀 70979200 79998302 0.89
tpch_q18/datafusion:vortex-file-compressed 84034873 93173766 0.90
tpch_q19/datafusion:vortex-file-compressed 23530782 25649224 0.92
tpch_q20/datafusion:vortex-file-compressed 31344819 34069126 0.92
tpch_q21/datafusion:vortex-file-compressed 🚀 74227805 82634492 0.90
tpch_q22/datafusion:vortex-file-compressed 12918507 13731544 0.94
datafusion / vortex-compact (0.937x ➖, 1↑ 0↓)
name PR a1d2e1e (ns) base eda8c2c (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 57990030 62764996 0.92
tpch_q02/datafusion:vortex-compact 25308305 27462127 0.92
tpch_q03/datafusion:vortex-compact 31656320 33304161 0.95
tpch_q04/datafusion:vortex-compact 25168439 26227697 0.96
tpch_q05/datafusion:vortex-compact 53900566 58976681 0.91
tpch_q06/datafusion:vortex-compact 14975691 15851445 0.94
tpch_q07/datafusion:vortex-compact 62004036 67592871 0.92
tpch_q08/datafusion:vortex-compact 47711123 49413589 0.97
tpch_q09/datafusion:vortex-compact 58772726 63290793 0.93
tpch_q10/datafusion:vortex-compact 48951061 52871613 0.93
tpch_q11/datafusion:vortex-compact 17378323 18929647 0.92
tpch_q12/datafusion:vortex-compact 33706205 36344195 0.93
tpch_q13/datafusion:vortex-compact 32588565 34790025 0.94
tpch_q14/datafusion:vortex-compact 21690242 22169380 0.98
tpch_q15/datafusion:vortex-compact 33675808 35853327 0.94
tpch_q16/datafusion:vortex-compact 25286678 26024243 0.97
tpch_q17/datafusion:vortex-compact 73034205 76400835 0.96
tpch_q18/datafusion:vortex-compact 90814290 93957982 0.97
tpch_q19/datafusion:vortex-compact 31787450 32785688 0.97
tpch_q20/datafusion:vortex-compact 36144535 39780385 0.91
tpch_q21/datafusion:vortex-compact 🚀 81855111 91177918 0.90
tpch_q22/datafusion:vortex-compact 13475258 14847846 0.91
datafusion / parquet (0.895x ✅, 6↑ 0↓)
name PR a1d2e1e (ns) base eda8c2c (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 🚀 96427612 140905780 0.68
tpch_q02/datafusion:parquet 63414466 69313314 0.91
tpch_q03/datafusion:parquet 73721808 79638122 0.93
tpch_q04/datafusion:parquet 44262974 47458651 0.93
tpch_q05/datafusion:parquet 95520655 103652591 0.92
tpch_q06/datafusion:parquet 🚀 37385038 44747529 0.84
tpch_q07/datafusion:parquet 108940686 119441030 0.91
tpch_q08/datafusion:parquet 91792829 100361025 0.91
tpch_q09/datafusion:parquet 131099944 145278383 0.90
tpch_q10/datafusion:parquet 113815457 122051372 0.93
tpch_q11/datafusion:parquet 🚀 41419575 46344706 0.89
tpch_q12/datafusion:parquet 81468364 90121375 0.90
tpch_q13/datafusion:parquet 201392715 218646983 0.92
tpch_q14/datafusion:parquet 🚀 45642040 51985148 0.88
tpch_q15/datafusion:parquet 60171910 66482930 0.91
tpch_q16/datafusion:parquet 🚀 42521744 49352812 0.86
tpch_q17/datafusion:parquet 🚀 136211796 177079279 0.77
tpch_q18/datafusion:parquet 174735003 183226016 0.95
tpch_q19/datafusion:parquet 78602404 80520776 0.98
tpch_q20/datafusion:parquet 70712467 75253898 0.94
tpch_q21/datafusion:parquet 137093805 145636541 0.94
tpch_q22/datafusion:parquet 31333694 33914136 0.92
datafusion / arrow (0.937x ➖, 8↑ 0↓)
name PR a1d2e1e (ns) base eda8c2c (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 57711597 57892702 1.00
tpch_q02/datafusion:arrow 19950533 19695731 1.01
tpch_q03/datafusion:arrow 33970720 34615692 0.98
tpch_q04/datafusion:arrow 29256208 30005693 0.98
tpch_q05/datafusion:arrow 87190580 81881218 1.06
tpch_q06/datafusion:arrow 23881935 22667580 1.05
tpch_q07/datafusion:arrow 109285970 113138284 0.97
tpch_q08/datafusion:arrow 🚀 47096367 53141857 0.89
tpch_q09/datafusion:arrow 🚀 72987138 82819873 0.88
tpch_q10/datafusion:arrow 49864259 54827213 0.91
tpch_q11/datafusion:arrow 9640578 9831642 0.98
tpch_q12/datafusion:arrow 🚀 53433712 60275068 0.89
tpch_q13/datafusion:arrow 47416534 49415343 0.96
tpch_q14/datafusion:arrow 🚀 22835364 25507617 0.90
tpch_q15/datafusion:arrow 🚀 44934529 51925226 0.87
tpch_q16/datafusion:arrow 19725139 20978975 0.94
tpch_q17/datafusion:arrow 🚀 72854514 84816613 0.86
tpch_q18/datafusion:arrow 144155879 156494204 0.92
tpch_q19/datafusion:arrow 🚀 38217122 45448944 0.84
tpch_q20/datafusion:arrow 🚀 37046071 41402776 0.89
tpch_q21/datafusion:arrow 159872350 174695313 0.92
tpch_q22/datafusion:arrow 18317557 18981293 0.97
duckdb / vortex-file-compressed (0.930x ➖, 4↑ 0↓)
name PR a1d2e1e (ns) base eda8c2c (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 32150291 34170214 0.94
tpch_q02/duckdb:vortex-file-compressed 26019944 28319493 0.92
tpch_q03/duckdb:vortex-file-compressed 🚀 30663979 34358590 0.89
tpch_q04/duckdb:vortex-file-compressed 31752680 33937877 0.94
tpch_q05/duckdb:vortex-file-compressed 35393093 37244595 0.95
tpch_q06/duckdb:vortex-file-compressed 🚀 10449627 11699187 0.89
tpch_q07/duckdb:vortex-file-compressed 38069619 42028063 0.91
tpch_q08/duckdb:vortex-file-compressed 39727357 43654533 0.91
tpch_q09/duckdb:vortex-file-compressed 🚀 78952587 87789055 0.90
tpch_q10/duckdb:vortex-file-compressed 38983611 38506886 1.01
tpch_q11/duckdb:vortex-file-compressed 15732818 16883016 0.93
tpch_q12/duckdb:vortex-file-compressed 22676711 24556100 0.92
tpch_q13/duckdb:vortex-file-compressed 38473351 41026051 0.94
tpch_q14/duckdb:vortex-file-compressed 23032169 25423047 0.91
tpch_q15/duckdb:vortex-file-compressed 18352622 19793085 0.93
tpch_q16/duckdb:vortex-file-compressed 30423282 33301671 0.91
tpch_q17/duckdb:vortex-file-compressed 27065962 29187934 0.93
tpch_q18/duckdb:vortex-file-compressed 54966000 55681579 0.99
tpch_q19/duckdb:vortex-file-compressed 34527439 36507867 0.95
tpch_q20/duckdb:vortex-file-compressed 38838104 40100471 0.97
tpch_q21/duckdb:vortex-file-compressed 125138238 131732766 0.95
tpch_q22/duckdb:vortex-file-compressed 🚀 18657309 21096378 0.88
duckdb / vortex-compact (0.961x ➖, 0↑ 0↓)
name PR a1d2e1e (ns) base eda8c2c (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 39821730 41185497 0.97
tpch_q02/duckdb:vortex-compact 38123154 42073672 0.91
tpch_q03/duckdb:vortex-compact 35078954 36898596 0.95
tpch_q04/duckdb:vortex-compact 37446083 38716894 0.97
tpch_q05/duckdb:vortex-compact 40957638 41375381 0.99
tpch_q06/duckdb:vortex-compact 15540316 16136343 0.96
tpch_q07/duckdb:vortex-compact 46590471 47050018 0.99
tpch_q08/duckdb:vortex-compact 47199934 48956810 0.96
tpch_q09/duckdb:vortex-compact 94892774 99833988 0.95
tpch_q10/duckdb:vortex-compact 42215280 45008660 0.94
tpch_q11/duckdb:vortex-compact 21094378 21144710 1.00
tpch_q12/duckdb:vortex-compact 36891058 38474609 0.96
tpch_q13/duckdb:vortex-compact 47131191 50999161 0.92
tpch_q14/duckdb:vortex-compact 31449481 31994217 0.98
tpch_q15/duckdb:vortex-compact 20696698 21534063 0.96
tpch_q16/duckdb:vortex-compact 37628226 37829575 0.99
tpch_q17/duckdb:vortex-compact 33397326 33782330 0.99
tpch_q18/duckdb:vortex-compact 54293030 55530134 0.98
tpch_q19/duckdb:vortex-compact 39020403 40335568 0.97
tpch_q20/duckdb:vortex-compact 45377371 46867007 0.97
tpch_q21/duckdb:vortex-compact 122631851 134332815 0.91
tpch_q22/duckdb:vortex-compact 21256077 23134237 0.92
duckdb / parquet (0.930x ➖, 6↑ 0↓)
name PR a1d2e1e (ns) base eda8c2c (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 🚀 77355470 90438159 0.86
tpch_q02/duckdb:parquet 41077508 41890263 0.98
tpch_q03/duckdb:parquet 69813059 74165270 0.94
tpch_q04/duckdb:parquet 49020474 51453552 0.95
tpch_q05/duckdb:parquet 65740822 70706687 0.93
tpch_q06/duckdb:parquet 20238175 21996005 0.92
tpch_q07/duckdb:parquet 🚀 67546247 82490139 0.82
tpch_q08/duckdb:parquet 🚀 81700180 100907209 0.81
tpch_q09/duckdb:parquet 🚀 138052774 160365813 0.86
tpch_q10/duckdb:parquet 127621513 133526680 0.96
tpch_q11/duckdb:parquet 21928966 23617910 0.93
tpch_q12/duckdb:parquet 46213125 47811718 0.97
tpch_q13/duckdb:parquet 🚀 264461420 294877694 0.90
tpch_q14/duckdb:parquet 48906272 52911751 0.92
tpch_q15/duckdb:parquet 24338402 25829388 0.94
tpch_q16/duckdb:parquet 59402201 61680015 0.96
tpch_q17/duckdb:parquet 54234928 53374086 1.02
tpch_q18/duckdb:parquet 116480636 118690334 0.98
tpch_q19/duckdb:parquet 74803554 76439365 0.98
tpch_q20/duckdb:parquet 67828391 65987987 1.03
tpch_q21/duckdb:parquet 🚀 180040945 200522257 0.90
tpch_q22/duckdb:parquet 53154888 55836761 0.95
duckdb / duckdb (0.947x ➖, 0↑ 0↓)
name PR a1d2e1e (ns) base eda8c2c (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 16511676 17562255 0.94
tpch_q02/duckdb:duckdb 14272726 14738189 0.97
tpch_q03/duckdb:duckdb 20600941 22076571 0.93
tpch_q04/duckdb:duckdb 21011565 20730285 1.01
tpch_q05/duckdb:duckdb 20540683 22315476 0.92
tpch_q06/duckdb:duckdb 5788657 5744100 1.01
tpch_q07/duckdb:duckdb 24618432 26424499 0.93
tpch_q08/duckdb:duckdb 22713409 23209296 0.98
tpch_q09/duckdb:duckdb 63539263 67206828 0.95
tpch_q10/duckdb:duckdb 45981821 48724874 0.94
tpch_q11/duckdb:duckdb 6574369 7114298 0.92
tpch_q12/duckdb:duckdb 14846740 16462642 0.90
tpch_q13/duckdb:duckdb 40301935 42703852 0.94
tpch_q14/duckdb:duckdb 18539409 19264182 0.96
tpch_q15/duckdb:duckdb 12408703 12749155 0.97
tpch_q16/duckdb:duckdb 25061487 26914600 0.93
tpch_q17/duckdb:duckdb 14595030 15959552 0.91
tpch_q18/duckdb:duckdb 40171594 41757473 0.96
tpch_q19/duckdb:duckdb 30021993 31498641 0.95
tpch_q20/duckdb:duckdb 23899345 25424894 0.94
tpch_q21/duckdb:duckdb 61663160 67904002 0.91
tpch_q22/duckdb:duckdb 25658360 27109775 0.95
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:arrow -0.3% -23.5% +30.3% +19.1% 🚨 regression
1 datafusion:vortex-compact -7.6% -23.5% +20.8% +18.1% 🚨 regression
1 datafusion:vortex-file-compressed -4.5% -23.5% +24.8% +19.3% 🚨 regression
1 duckdb:duckdb -6.0% -23.5% +22.9% +18.1% 🚨 regression
1 duckdb:vortex-compact -3.3% -23.5% +26.4% +17.8% 🚨 regression
1 duckdb:vortex-file-compressed -5.9% -23.5% +23.0% +21.4% 🚨 regression
2 datafusion:arrow +1.3% -5.3% +6.9% +14.9% ➖ noise
2 datafusion:vortex-compact -7.8% -5.3% -2.7% +14.9% ➖ noise
2 datafusion:vortex-file-compressed -6.6% -5.3% -1.4% +14.9% ➖ noise
2 duckdb:duckdb -3.2% -5.3% +2.2% +14.9% ➖ noise
2 duckdb:vortex-compact -9.4% -5.3% -4.3% +14.9% ➖ noise
2 duckdb:vortex-file-compressed -8.1% -5.3% -3.0% +14.9% ➖ noise
3 datafusion:arrow -1.9% -6.7% +5.1% +14.9% ➖ noise
3 datafusion:vortex-compact -4.9% -6.7% +1.8% +14.9% ➖ noise
3 datafusion:vortex-file-compressed -9.8% -6.7% -3.4% +14.9% ➖ noise
3 duckdb:duckdb -6.7% -6.7% -0.0% +14.9% ➖ noise
3 duckdb:vortex-compact -4.9% -6.7% +1.8% +14.9% ➖ noise
3 duckdb:vortex-file-compressed -10.8% -6.7% -4.4% +14.9% ➖ noise
4 datafusion:arrow -2.5% -5.7% +3.4% +14.9% ➖ noise
4 datafusion:vortex-compact -4.0% -5.7% +1.8% +14.9% ➖ noise
4 datafusion:vortex-file-compressed -7.7% -5.7% -2.1% +14.9% ➖ noise
4 duckdb:duckdb +1.4% -5.7% +7.5% +14.9% ➖ noise
4 duckdb:vortex-compact -3.3% -5.7% +2.6% +14.9% ➖ noise
4 duckdb:vortex-file-compressed -6.4% -5.7% -0.7% +14.9% ➖ noise
5 datafusion:arrow +6.5% -7.4% +15.0% +14.9% 🚨 regression
5 datafusion:vortex-compact -8.6% -7.4% -1.3% +14.9% ➖ noise
5 datafusion:vortex-file-compressed -11.8% -7.4% -4.8% +14.9% ➖ noise
5 duckdb:duckdb -8.0% -7.4% -0.6% +14.9% ➖ noise
5 duckdb:vortex-compact -1.0% -7.4% +6.9% +14.9% ➖ noise
5 duckdb:vortex-file-compressed -5.0% -7.4% +2.7% +14.9% ➖ noise
6 datafusion:arrow +5.4% -12.3% +20.2% +15.4% 🚨 regression
6 datafusion:vortex-compact -5.5% -12.3% +7.8% +16.2% ➖ noise
6 datafusion:vortex-file-compressed -7.6% -12.3% +5.4% +15.5% ➖ noise
6 duckdb:duckdb +0.8% -12.3% +14.9% +17.6% ➖ noise
6 duckdb:vortex-compact -3.7% -12.3% +9.8% +15.5% ➖ noise
6 duckdb:vortex-file-compressed -10.7% -12.3% +1.9% +15.4% ➖ noise
7 datafusion:arrow -3.4% -13.6% +11.8% +14.9% ➖ noise
7 datafusion:vortex-compact -8.3% -13.6% +6.1% +14.9% ➖ noise
7 datafusion:vortex-file-compressed -13.3% -13.6% +0.4% +14.9% ➖ noise
7 duckdb:duckdb -6.8% -13.6% +7.8% +14.9% ➖ noise
7 duckdb:vortex-compact -1.0% -13.6% +14.6% +14.9% ➖ noise
7 duckdb:vortex-file-compressed -9.4% -13.6% +4.8% +14.9% ➖ noise
8 datafusion:arrow -11.4% -13.9% +3.0% +14.9% ➖ noise
8 datafusion:vortex-compact -3.4% -13.9% +12.2% +14.9% ➖ noise
8 datafusion:vortex-file-compressed -10.7% -13.9% +3.7% +14.9% ➖ noise
8 duckdb:duckdb -2.1% -13.9% +13.7% +14.9% ➖ noise
8 duckdb:vortex-compact -3.6% -13.9% +12.0% +14.9% ➖ noise
8 duckdb:vortex-file-compressed -9.0% -13.9% +5.8% +14.9% ➖ noise
9 datafusion:arrow -11.9% -11.9% -0.0% +14.9% ➖ noise
9 datafusion:vortex-compact -7.1% -11.9% +5.4% +14.9% ➖ noise
9 datafusion:vortex-file-compressed -7.3% -11.9% +5.2% +14.9% ➖ noise
9 duckdb:duckdb -5.5% -11.9% +7.3% +14.9% ➖ noise
9 duckdb:vortex-compact -4.9% -11.9% +7.8% +14.9% ➖ noise
9 duckdb:vortex-file-compressed -10.1% -11.9% +2.0% +14.9% ➖ noise
10 datafusion:arrow -9.1% -5.6% -3.7% +14.9% ➖ noise
10 datafusion:vortex-compact -7.4% -5.6% -1.9% +14.9% ➖ noise
10 datafusion:vortex-file-compressed -9.4% -5.6% -4.0% +14.9% ➖ noise
10 duckdb:duckdb -5.6% -5.6% -0.0% +14.9% ➖ noise
10 duckdb:vortex-compact -6.2% -5.6% -0.7% +14.9% ➖ noise
10 duckdb:vortex-file-compressed +1.2% -5.6% +7.2% +14.9% ➖ noise
11 datafusion:arrow -1.9% -8.9% +7.6% +14.9% ➖ noise
11 datafusion:vortex-compact -8.2% -8.9% +0.8% +14.9% ➖ noise
11 datafusion:vortex-file-compressed -9.5% -8.9% -0.7% +14.9% ➖ noise
11 duckdb:duckdb -7.6% -8.9% +1.4% +14.9% ➖ noise
11 duckdb:vortex-compact -0.2% -8.9% +9.5% +14.9% ➖ noise
11 duckdb:vortex-file-compressed -6.8% -8.9% +2.3% +14.9% ➖ noise
12 datafusion:arrow -11.4% -6.5% -5.2% +19.2% ➖ noise
12 datafusion:vortex-compact -7.3% -6.5% -0.8% +14.9% ➖ noise
12 datafusion:vortex-file-compressed -8.4% -6.5% -2.0% +14.9% ➖ noise
12 duckdb:duckdb -9.8% -6.5% -3.5% +14.9% ➖ noise
12 duckdb:vortex-compact -4.1% -6.5% +2.6% +14.9% ➖ noise
12 duckdb:vortex-file-compressed -7.7% -6.5% -1.2% +14.9% ➖ noise
13 datafusion:arrow -4.0% -9.1% +5.6% +14.9% ➖ noise
13 datafusion:vortex-compact -6.3% -9.1% +3.1% +14.9% ➖ noise
13 datafusion:vortex-file-compressed -12.5% -9.1% -3.7% +14.9% ➖ noise
13 duckdb:duckdb -5.6% -9.1% +3.8% +14.9% ➖ noise
13 duckdb:vortex-compact -7.6% -9.1% +1.7% +14.9% ➖ noise
13 duckdb:vortex-file-compressed -6.2% -9.1% +3.2% +14.9% ➖ noise
14 datafusion:arrow -10.5% -9.9% -0.6% +14.9% ➖ noise
14 datafusion:vortex-compact -2.2% -9.9% +8.6% +14.9% ➖ noise
14 datafusion:vortex-file-compressed -17.4% -9.9% -8.3% +14.9% ➖ noise
14 duckdb:duckdb -3.8% -9.9% +6.8% +14.9% ➖ noise
14 duckdb:vortex-compact -1.7% -9.9% +9.1% +14.9% ➖ noise
14 duckdb:vortex-file-compressed -9.4% -9.9% +0.6% +14.9% ➖ noise
15 datafusion:arrow -13.5% -7.7% -6.3% +14.9% ➖ noise
15 datafusion:vortex-compact -6.1% -7.7% +1.7% +14.9% ➖ noise
15 datafusion:vortex-file-compressed -8.2% -7.7% -0.6% +14.9% ➖ noise
15 duckdb:duckdb -2.7% -7.7% +5.4% +14.9% ➖ noise
15 duckdb:vortex-compact -3.9% -7.7% +4.1% +15.0% ➖ noise
15 duckdb:vortex-file-compressed -7.3% -7.7% +0.4% +14.9% ➖ noise
16 datafusion:arrow -6.0% -8.9% +3.2% +14.9% ➖ noise
16 datafusion:vortex-compact -2.8% -8.9% +6.7% +14.9% ➖ noise
16 datafusion:vortex-file-compressed -7.3% -8.9% +1.8% +14.9% ➖ noise
16 duckdb:duckdb -6.9% -8.9% +2.2% +14.9% ➖ noise
16 duckdb:vortex-compact -0.5% -8.9% +9.2% +14.9% ➖ noise
16 duckdb:vortex-file-compressed -8.6% -8.9% +0.3% +14.9% ➖ noise
17 datafusion:arrow -14.1% -11.6% -2.8% +14.9% ➖ noise
17 datafusion:vortex-compact -4.4% -11.6% +8.1% +14.9% ➖ noise
17 datafusion:vortex-file-compressed -11.3% -11.6% +0.4% +14.9% ➖ noise
17 duckdb:duckdb -8.5% -11.6% +3.4% +14.9% ➖ noise
17 duckdb:vortex-compact -1.1% -11.6% +11.8% +14.9% ➖ noise
17 duckdb:vortex-file-compressed -7.3% -11.6% +4.9% +14.9% ➖ noise
18 datafusion:arrow -7.9% -3.3% -4.8% +14.9% ➖ noise
18 datafusion:vortex-compact -3.3% -3.3% -0.1% +14.9% ➖ noise
18 datafusion:vortex-file-compressed -9.8% -3.3% -6.8% +14.9% ➖ noise
18 duckdb:duckdb -3.8% -3.3% -0.6% +14.9% ➖ noise
18 duckdb:vortex-compact -2.2% -3.3% +1.1% +14.9% ➖ noise
18 duckdb:vortex-file-compressed -1.3% -3.3% +2.0% +14.9% ➖ noise
19 datafusion:arrow -15.9% -2.3% -14.0% +15.7% ✅ faster
19 datafusion:vortex-compact -3.0% -2.3% -0.8% +14.9% ➖ noise
19 datafusion:vortex-file-compressed -8.3% -2.3% -6.1% +14.9% ➖ noise
19 duckdb:duckdb -4.7% -2.3% -2.5% +14.9% ➖ noise
19 duckdb:vortex-compact -3.3% -2.3% -1.0% +14.9% ➖ noise
19 duckdb:vortex-file-compressed -5.4% -2.3% -3.2% +14.9% ➖ noise
20 datafusion:arrow -10.5% -1.7% -9.0% +14.9% ➖ noise
20 datafusion:vortex-compact -9.1% -1.7% -7.5% +14.9% ➖ noise
20 datafusion:vortex-file-compressed -8.0% -1.7% -6.4% +14.9% ➖ noise
20 duckdb:duckdb -6.0% -1.7% -4.4% +14.9% ➖ noise
20 duckdb:vortex-compact -3.2% -1.7% -1.5% +14.9% ➖ noise
20 duckdb:vortex-file-compressed -3.1% -1.7% -1.5% +14.9% ➖ noise
21 datafusion:arrow -8.5% -8.1% -0.5% +14.9% ➖ noise
21 datafusion:vortex-compact -10.2% -8.1% -2.3% +14.9% ➖ noise
21 datafusion:vortex-file-compressed -10.2% -8.1% -2.3% +14.9% ➖ noise
21 duckdb:duckdb -9.2% -8.1% -1.2% +14.9% ➖ noise
21 duckdb:vortex-compact -8.7% -8.1% -0.7% +14.9% ➖ noise
21 duckdb:vortex-file-compressed -5.0% -8.1% +3.3% +14.9% ➖ noise
22 datafusion:arrow -3.5% -6.2% +2.9% +14.9% ➖ noise
22 datafusion:vortex-compact -9.2% -6.2% -3.2% +14.9% ➖ noise
22 datafusion:vortex-file-compressed -5.9% -6.2% +0.3% +14.9% ➖ noise
22 duckdb:duckdb -5.4% -6.2% +0.9% +14.9% ➖ noise
22 duckdb:vortex-compact -8.1% -6.2% -2.0% +14.9% ➖ noise
22 duckdb:vortex-file-compressed -11.6% -6.2% -5.7% +14.9% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 6, 2026

File Sizes: TPC-H SF=1 on NVME

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 6, 2026

Benchmarks: TPC-DS SF=1 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.7%
Vortex (geomean): 1.008x ➖
Parquet (geomean): 1.011x ➖
Shifts: Parquet (control) +1.1% · Median polish +0.6%


datafusion / vortex-file-compressed (0.997x ➖, 1↑ 1↓)
name PR a1d2e1e (ns) base eda8c2c (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-file-compressed 26487936 26184859 1.01
tpcds_q02/datafusion:vortex-file-compressed 46976337 47363066 0.99
tpcds_q03/datafusion:vortex-file-compressed 15501296 15380570 1.01
tpcds_q04/datafusion:vortex-file-compressed 264462107 252270791 1.05
tpcds_q05/datafusion:vortex-file-compressed 44367702 44567191 1.00
tpcds_q06/datafusion:vortex-file-compressed 59403642 61314628 0.97
tpcds_q07/datafusion:vortex-file-compressed 42255207 43484392 0.97
tpcds_q08/datafusion:vortex-file-compressed 29462691 29570475 1.00
tpcds_q09/datafusion:vortex-file-compressed 44523528 44255662 1.01
tpcds_q10/datafusion:vortex-file-compressed 39153079 39800500 0.98
tpcds_q11/datafusion:vortex-file-compressed 128380918 134352333 0.96
tpcds_q12/datafusion:vortex-file-compressed 20895728 21068444 0.99
tpcds_q13/datafusion:vortex-file-compressed 45266724 44642682 1.01
tpcds_q14/datafusion:vortex-file-compressed 171609872 170819696 1.00
tpcds_q15/datafusion:vortex-file-compressed 28269483 28563731 0.99
tpcds_q16/datafusion:vortex-file-compressed 28954917 29155338 0.99
tpcds_q17/datafusion:vortex-file-compressed 63645567 62511079 1.02
tpcds_q18/datafusion:vortex-file-compressed 70897125 71416772 0.99
tpcds_q19/datafusion:vortex-file-compressed 23124290 22355633 1.03
tpcds_q20/datafusion:vortex-file-compressed 22430829 21430841 1.05
tpcds_q21/datafusion:vortex-file-compressed 34988236 36041133 0.97
tpcds_q22/datafusion:vortex-file-compressed 115669678 121324985 0.95
tpcds_q23/datafusion:vortex-file-compressed 157581953 155080676 1.02
tpcds_q24/datafusion:vortex-file-compressed 87477217 85186085 1.03
tpcds_q25/datafusion:vortex-file-compressed 67864415 67090293 1.01
tpcds_q26/datafusion:vortex-file-compressed 34446113 34845137 0.99
tpcds_q27/datafusion:vortex-file-compressed 103835847 105264525 0.99
tpcds_q28/datafusion:vortex-file-compressed 40881959 41473317 0.99
tpcds_q29/datafusion:vortex-file-compressed 63717346 63571071 1.00
tpcds_q30/datafusion:vortex-file-compressed 25247500 23709233 1.06
tpcds_q31/datafusion:vortex-file-compressed 75239911 72998811 1.03
tpcds_q32/datafusion:vortex-file-compressed 20936439 20404640 1.03
tpcds_q33/datafusion:vortex-file-compressed 30064998 30459910 0.99
tpcds_q34/datafusion:vortex-file-compressed 25302286 24861511 1.02
tpcds_q35/datafusion:vortex-file-compressed 47798603 46343417 1.03
tpcds_q36/datafusion:vortex-file-compressed 58335663 59046052 0.99
tpcds_q37/datafusion:vortex-file-compressed 26818644 26394049 1.02
tpcds_q38/datafusion:vortex-file-compressed 44536051 43951455 1.01
tpcds_q39/datafusion:vortex-file-compressed 108655867 106337686 1.02
tpcds_q40/datafusion:vortex-file-compressed 32853040 33302288 0.99
tpcds_q41/datafusion:vortex-file-compressed 15906850 16021316 0.99
tpcds_q42/datafusion:vortex-file-compressed 14108350 14375778 0.98
tpcds_q43/datafusion:vortex-file-compressed 19549544 18952588 1.03
tpcds_q44/datafusion:vortex-file-compressed 32620136 31739030 1.03
tpcds_q45/datafusion:vortex-file-compressed 27935456 27730970 1.01
tpcds_q46/datafusion:vortex-file-compressed 35181849 34434837 1.02
tpcds_q47/datafusion:vortex-file-compressed 132254631 134377916 0.98
tpcds_q48/datafusion:vortex-file-compressed 39459266 39587364 1.00
tpcds_q49/datafusion:vortex-file-compressed 59140142 59481757 0.99
tpcds_q50/datafusion:vortex-file-compressed 40015404 39863455 1.00
tpcds_q51/datafusion:vortex-file-compressed 89959801 90441489 0.99
tpcds_q52/datafusion:vortex-file-compressed 14469347 14778182 0.98
tpcds_q53/datafusion:vortex-file-compressed 21113686 21225039 0.99
tpcds_q54/datafusion:vortex-file-compressed 35618843 35017087 1.02
tpcds_q55/datafusion:vortex-file-compressed 13954124 14087895 0.99
tpcds_q56/datafusion:vortex-file-compressed 30079855 30635804 0.98
tpcds_q57/datafusion:vortex-file-compressed 108839714 106006920 1.03
tpcds_q58/datafusion:vortex-file-compressed 55080463 54111782 1.02
tpcds_q59/datafusion:vortex-file-compressed 57441641 57328255 1.00
tpcds_q60/datafusion:vortex-file-compressed 30551546 30011972 1.02
tpcds_q61/datafusion:vortex-file-compressed 40835325 41405247 0.99
tpcds_q62/datafusion:vortex-file-compressed 🚨 24779152 22355613 1.11
tpcds_q63/datafusion:vortex-file-compressed 21469716 20904697 1.03
tpcds_q64/datafusion:vortex-file-compressed 418847387 419425398 1.00
tpcds_q65/datafusion:vortex-file-compressed 40151600 40543854 0.99
tpcds_q66/datafusion:vortex-file-compressed 74125261 73598310 1.01
tpcds_q67/datafusion:vortex-file-compressed 144124230 158788710 0.91
tpcds_q68/datafusion:vortex-file-compressed 33026409 35461742 0.93
tpcds_q69/datafusion:vortex-file-compressed 38616882 39412513 0.98
tpcds_q70/datafusion:vortex-file-compressed 86901190 91507754 0.95
tpcds_q71/datafusion:vortex-file-compressed 23406149 24187779 0.97
tpcds_q72/datafusion:vortex-file-compressed 🚀 2177439334 2545126305 0.86
tpcds_q73/datafusion:vortex-file-compressed 23088466 22612948 1.02
tpcds_q74/datafusion:vortex-file-compressed 80095491 85794339 0.93
tpcds_q75/datafusion:vortex-file-compressed 108908926 108266446 1.01
tpcds_q76/datafusion:vortex-file-compressed 24682516 24560544 1.00
tpcds_q77/datafusion:vortex-file-compressed 40746550 41221893 0.99
tpcds_q78/datafusion:vortex-file-compressed 124834955 127581766 0.98
tpcds_q79/datafusion:vortex-file-compressed 28283957 29113901 0.97
tpcds_q80/datafusion:vortex-file-compressed 94212781 99543403 0.95
tpcds_q81/datafusion:vortex-file-compressed 24121346 24455903 0.99
tpcds_q82/datafusion:vortex-file-compressed 26169689 26176525 1.00
tpcds_q83/datafusion:vortex-file-compressed 34229063 34698976 0.99
tpcds_q84/datafusion:vortex-file-compressed 12992716 12792457 1.02
tpcds_q85/datafusion:vortex-file-compressed 98059393 99960242 0.98
tpcds_q86/datafusion:vortex-file-compressed 18474936 18323783 1.01
tpcds_q87/datafusion:vortex-file-compressed 44490054 44171781 1.01
tpcds_q88/datafusion:vortex-file-compressed 57038295 59123600 0.96
tpcds_q89/datafusion:vortex-file-compressed 25193146 25220820 1.00
tpcds_q90/datafusion:vortex-file-compressed 15282379 15251941 1.00
tpcds_q91/datafusion:vortex-file-compressed 18925475 18698970 1.01
tpcds_q92/datafusion:vortex-file-compressed 19429653 18409434 1.06
tpcds_q93/datafusion:vortex-file-compressed 34493364 34433668 1.00
tpcds_q94/datafusion:vortex-file-compressed 24864698 23415869 1.06
tpcds_q95/datafusion:vortex-file-compressed 63066584 64503761 0.98
tpcds_q96/datafusion:vortex-file-compressed 13787884 14714025 0.94
tpcds_q97/datafusion:vortex-file-compressed 32522753 33924112 0.96
tpcds_q98/datafusion:vortex-file-compressed 25092104 25006660 1.00
tpcds_q99/datafusion:vortex-file-compressed 32849126 33117146 0.99
datafusion / vortex-compact (1.003x ➖, 0↑ 3↓)
name PR a1d2e1e (ns) base eda8c2c (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-compact 25882991 25220702 1.03
tpcds_q02/datafusion:vortex-compact 54084643 54673276 0.99
tpcds_q03/datafusion:vortex-compact 20212081 19881843 1.02
tpcds_q04/datafusion:vortex-compact 310675120 305801533 1.02
tpcds_q05/datafusion:vortex-compact 49485021 48572009 1.02
tpcds_q06/datafusion:vortex-compact 61892147 61501804 1.01
tpcds_q07/datafusion:vortex-compact 52332390 54018031 0.97
tpcds_q08/datafusion:vortex-compact 36063466 35900555 1.00
tpcds_q09/datafusion:vortex-compact 62316357 61783137 1.01
tpcds_q10/datafusion:vortex-compact 50834206 52158238 0.97
tpcds_q11/datafusion:vortex-compact 154985651 163969434 0.95
tpcds_q12/datafusion:vortex-compact 🚨 25935831 23463387 1.11
tpcds_q13/datafusion:vortex-compact 92840981 92549131 1.00
tpcds_q14/datafusion:vortex-compact 200806840 201767035 1.00
tpcds_q15/datafusion:vortex-compact 31033865 32319108 0.96
tpcds_q16/datafusion:vortex-compact 33839921 32442640 1.04
tpcds_q17/datafusion:vortex-compact 74267415 74646093 0.99
tpcds_q18/datafusion:vortex-compact 81315876 81751880 0.99
tpcds_q19/datafusion:vortex-compact 29956773 30436233 0.98
tpcds_q20/datafusion:vortex-compact 26370898 26746089 0.99
tpcds_q21/datafusion:vortex-compact 40534155 40466129 1.00
tpcds_q22/datafusion:vortex-compact 122344145 130263663 0.94
tpcds_q23/datafusion:vortex-compact 162711752 165637180 0.98
tpcds_q24/datafusion:vortex-compact 98213816 98045755 1.00
tpcds_q25/datafusion:vortex-compact 82018695 80887249 1.01
tpcds_q26/datafusion:vortex-compact 46908524 45570426 1.03
tpcds_q27/datafusion:vortex-compact 123500325 122796197 1.01
tpcds_q28/datafusion:vortex-compact 77455517 82021552 0.94
tpcds_q29/datafusion:vortex-compact 73061196 74839993 0.98
tpcds_q30/datafusion:vortex-compact 27450796 28237857 0.97
tpcds_q31/datafusion:vortex-compact 101081130 98180214 1.03
tpcds_q32/datafusion:vortex-compact 26781733 25963432 1.03
tpcds_q33/datafusion:vortex-compact 36521981 36456237 1.00
tpcds_q34/datafusion:vortex-compact 32080502 32190574 1.00
tpcds_q35/datafusion:vortex-compact 51920276 54614818 0.95
tpcds_q36/datafusion:vortex-compact 78283356 75196086 1.04
tpcds_q37/datafusion:vortex-compact 41555293 40521057 1.03
tpcds_q38/datafusion:vortex-compact 54318691 54413316 1.00
tpcds_q39/datafusion:vortex-compact 116850299 113755459 1.03
tpcds_q40/datafusion:vortex-compact 36725898 36835760 1.00
tpcds_q41/datafusion:vortex-compact 17581905 18783107 0.94
tpcds_q42/datafusion:vortex-compact 18297315 18800960 0.97
tpcds_q43/datafusion:vortex-compact 25000720 25286542 0.99
tpcds_q44/datafusion:vortex-compact 48668051 48298657 1.01
tpcds_q45/datafusion:vortex-compact 32501690 31530397 1.03
tpcds_q46/datafusion:vortex-compact 44567028 44161398 1.01
tpcds_q47/datafusion:vortex-compact 151641441 155761733 0.97
tpcds_q48/datafusion:vortex-compact 71309585 74027759 0.96
tpcds_q49/datafusion:vortex-compact 73114140 71751189 1.02
tpcds_q50/datafusion:vortex-compact 48979386 47507815 1.03
tpcds_q51/datafusion:vortex-compact 97368354 98452211 0.99
tpcds_q52/datafusion:vortex-compact 18888607 19585159 0.96
tpcds_q53/datafusion:vortex-compact 28038594 28690931 0.98
tpcds_q54/datafusion:vortex-compact 42872945 42509352 1.01
tpcds_q55/datafusion:vortex-compact 18647897 18184822 1.03
tpcds_q56/datafusion:vortex-compact 36846223 35738276 1.03
tpcds_q57/datafusion:vortex-compact 115386531 124189437 0.93
tpcds_q58/datafusion:vortex-compact 61955290 65008094 0.95
tpcds_q59/datafusion:vortex-compact 70405921 71474587 0.99
tpcds_q60/datafusion:vortex-compact 35958187 36207898 0.99
tpcds_q61/datafusion:vortex-compact 55106412 54810018 1.01
tpcds_q62/datafusion:vortex-compact 🚨 31704147 28189297 1.12
tpcds_q63/datafusion:vortex-compact 27686232 27656011 1.00
tpcds_q64/datafusion:vortex-compact 464706412 460363327 1.01
tpcds_q65/datafusion:vortex-compact 55219312 54218202 1.02
tpcds_q66/datafusion:vortex-compact 77920864 78156845 1.00
tpcds_q67/datafusion:vortex-compact 153043031 156828385 0.98
tpcds_q68/datafusion:vortex-compact 46508260 45594591 1.02
tpcds_q69/datafusion:vortex-compact 48215248 47998663 1.00
tpcds_q70/datafusion:vortex-compact 102582610 102064980 1.01
tpcds_q71/datafusion:vortex-compact 29511828 29601451 1.00
tpcds_q72/datafusion:vortex-compact 2183401782 2187087602 1.00
tpcds_q73/datafusion:vortex-compact 30519439 30595923 1.00
tpcds_q74/datafusion:vortex-compact 95199256 97283424 0.98
tpcds_q75/datafusion:vortex-compact 127892789 128516935 1.00
tpcds_q76/datafusion:vortex-compact 33547976 32218388 1.04
tpcds_q77/datafusion:vortex-compact 50281054 50789360 0.99
tpcds_q78/datafusion:vortex-compact 139374908 142172406 0.98
tpcds_q79/datafusion:vortex-compact 38529072 37418384 1.03
tpcds_q80/datafusion:vortex-compact 105029883 103079221 1.02
tpcds_q81/datafusion:vortex-compact 29370117 28785019 1.02
tpcds_q82/datafusion:vortex-compact 41799157 41873102 1.00
tpcds_q83/datafusion:vortex-compact 34253179 33279801 1.03
tpcds_q84/datafusion:vortex-compact 15085757 14693237 1.03
tpcds_q85/datafusion:vortex-compact 133434256 133196840 1.00
tpcds_q86/datafusion:vortex-compact 🚨 21786375 18465182 1.18
tpcds_q87/datafusion:vortex-compact 52971996 52474149 1.01
tpcds_q88/datafusion:vortex-compact 77325422 76668605 1.01
tpcds_q89/datafusion:vortex-compact 32247625 33214712 0.97
tpcds_q90/datafusion:vortex-compact 15266674 15084695 1.01
tpcds_q91/datafusion:vortex-compact 33119984 32521029 1.02
tpcds_q92/datafusion:vortex-compact 26404225 24570045 1.07
tpcds_q93/datafusion:vortex-compact 39083222 38491776 1.02
tpcds_q94/datafusion:vortex-compact 25749104 26602722 0.97
tpcds_q95/datafusion:vortex-compact 70443152 70368773 1.00
tpcds_q96/datafusion:vortex-compact 17407451 17204457 1.01
tpcds_q97/datafusion:vortex-compact 37329033 37656074 0.99
tpcds_q98/datafusion:vortex-compact 30727154 31485226 0.98
tpcds_q99/datafusion:vortex-compact 37397210 35691777 1.05
datafusion / parquet (1.012x ➖, 0↑ 1↓)
name PR a1d2e1e (ns) base eda8c2c (ns) ratio (PR/base)
tpcds_q01/datafusion:parquet 31796331 29102026 1.09
tpcds_q02/datafusion:parquet 42398759 41472011 1.02
tpcds_q03/datafusion:parquet 13396330 12917463 1.04
tpcds_q04/datafusion:parquet 265810872 267750019 0.99
tpcds_q05/datafusion:parquet 40760662 42392892 0.96
tpcds_q06/datafusion:parquet 59086965 58853463 1.00
tpcds_q07/datafusion:parquet 76883084 75226675 1.02
tpcds_q08/datafusion:parquet 27268198 26433246 1.03
tpcds_q09/datafusion:parquet 🚨 52769655 43396224 1.22
tpcds_q10/datafusion:parquet 74258476 72844662 1.02
tpcds_q11/datafusion:parquet 146096398 146257056 1.00
tpcds_q12/datafusion:parquet 17873555 18051889 0.99
tpcds_q13/datafusion:parquet 77951772 74484767 1.05
tpcds_q14/datafusion:parquet 166340829 161020757 1.03
tpcds_q15/datafusion:parquet 20784837 21774420 0.95
tpcds_q16/datafusion:parquet 23941901 23453190 1.02
tpcds_q17/datafusion:parquet 62014097 66116247 0.94
tpcds_q18/datafusion:parquet 117654924 116945719 1.01
tpcds_q19/datafusion:parquet 23101990 22469075 1.03
tpcds_q20/datafusion:parquet 16576720 16189241 1.02
tpcds_q21/datafusion:parquet 19074731 18311040 1.04
tpcds_q22/datafusion:parquet 158338453 150260212 1.05
tpcds_q23/datafusion:parquet 147244739 140791637 1.05
tpcds_q24/datafusion:parquet 90736950 89786137 1.01
tpcds_q25/datafusion:parquet 64332924 63424893 1.01
tpcds_q26/datafusion:parquet 66017292 64215500 1.03
tpcds_q27/datafusion:parquet 151150585 146597012 1.03
tpcds_q28/datafusion:parquet 45487198 44181859 1.03
tpcds_q29/datafusion:parquet 64679611 63406842 1.02
tpcds_q30/datafusion:parquet 35216573 33729755 1.04
tpcds_q31/datafusion:parquet 67219787 67901912 0.99
tpcds_q32/datafusion:parquet 18209038 17981919 1.01
tpcds_q33/datafusion:parquet 26298729 25405465 1.04
tpcds_q34/datafusion:parquet 22193197 21689952 1.02
tpcds_q35/datafusion:parquet 68443462 67120139 1.02
tpcds_q36/datafusion:parquet 57282200 56618659 1.01
tpcds_q37/datafusion:parquet 18882898 19281131 0.98
tpcds_q38/datafusion:parquet 41051270 41702472 0.98
tpcds_q39/datafusion:parquet 74387550 74125429 1.00
tpcds_q40/datafusion:parquet 24997882 25012091 1.00
tpcds_q41/datafusion:parquet 14138927 13382493 1.06
tpcds_q42/datafusion:parquet 11701241 11870782 0.99
tpcds_q43/datafusion:parquet 17191435 17982610 0.96
tpcds_q44/datafusion:parquet 33067049 33225179 1.00
tpcds_q45/datafusion:parquet 28648932 27461806 1.04
tpcds_q46/datafusion:parquet 31986095 32426967 0.99
tpcds_q47/datafusion:parquet 125602741 124457171 1.01
tpcds_q48/datafusion:parquet 68726855 68135873 1.01
tpcds_q49/datafusion:parquet 54606985 54537749 1.00
tpcds_q50/datafusion:parquet 44044702 43586383 1.01
tpcds_q51/datafusion:parquet 83839389 85143459 0.98
tpcds_q52/datafusion:parquet 12120076 11634359 1.04
tpcds_q53/datafusion:parquet 18160705 17324961 1.05
tpcds_q54/datafusion:parquet 35757038 33873463 1.06
tpcds_q55/datafusion:parquet 11477455 11454558 1.00
tpcds_q56/datafusion:parquet 26785562 27309406 0.98
tpcds_q57/datafusion:parquet 94822764 92473629 1.03
tpcds_q58/datafusion:parquet 49194349 48459265 1.02
tpcds_q59/datafusion:parquet 58266856 57490537 1.01
tpcds_q60/datafusion:parquet 27324045 26382804 1.04
tpcds_q61/datafusion:parquet 41690720 41683120 1.00
tpcds_q62/datafusion:parquet 20569507 22062873 0.93
tpcds_q63/datafusion:parquet 18107404 17482768 1.04
tpcds_q64/datafusion:parquet 521579503 522680850 1.00
tpcds_q65/datafusion:parquet 37549185 37215587 1.01
tpcds_q66/datafusion:parquet 66051303 66402968 0.99
tpcds_q67/datafusion:parquet 143232961 147618772 0.97
tpcds_q68/datafusion:parquet 31975009 31664690 1.01
tpcds_q69/datafusion:parquet 66784036 65521920 1.02
tpcds_q70/datafusion:parquet 86479823 87312711 0.99
tpcds_q71/datafusion:parquet 21754620 21918768 0.99
tpcds_q72/datafusion:parquet 602870561 612368749 0.98
tpcds_q73/datafusion:parquet 21236757 21176949 1.00
tpcds_q74/datafusion:parquet 85850185 83416349 1.03
tpcds_q75/datafusion:parquet 99411581 99977986 0.99
tpcds_q76/datafusion:parquet 30087487 31312535 0.96
tpcds_q77/datafusion:parquet 37734366 37974038 0.99
tpcds_q78/datafusion:parquet 112097190 112277427 1.00
tpcds_q79/datafusion:parquet 26904634 26227902 1.03
tpcds_q80/datafusion:parquet 78259277 79322851 0.99
tpcds_q81/datafusion:parquet 31617500 31230245 1.01
tpcds_q82/datafusion:parquet 19162755 19629755 0.98
tpcds_q83/datafusion:parquet 37365211 36433036 1.03
tpcds_q84/datafusion:parquet 39697653 39107973 1.02
tpcds_q85/datafusion:parquet 150780088 147377588 1.02
tpcds_q86/datafusion:parquet 16942682 15857817 1.07
tpcds_q87/datafusion:parquet 42836336 41277091 1.04
tpcds_q88/datafusion:parquet 59887119 59494580 1.01
tpcds_q89/datafusion:parquet 20714284 21253092 0.97
tpcds_q90/datafusion:parquet 14270503 15219419 0.94
tpcds_q91/datafusion:parquet 58585727 58167836 1.01
tpcds_q92/datafusion:parquet 18886046 18503965 1.02
tpcds_q93/datafusion:parquet 33174035 31927419 1.04
tpcds_q94/datafusion:parquet 21979762 20492078 1.07
tpcds_q95/datafusion:parquet 61865429 60792788 1.02
tpcds_q96/datafusion:parquet 12713299 12082869 1.05
tpcds_q97/datafusion:parquet 31734138 29937733 1.06
tpcds_q98/datafusion:parquet 21442335 21869730 0.98
tpcds_q99/datafusion:parquet 25650276 26653805 0.96
duckdb / vortex-file-compressed (1.022x ➖, 3↑ 3↓)
name PR a1d2e1e (ns) base eda8c2c (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-file-compressed 21025289 20845146 1.01
tpcds_q02/duckdb:vortex-file-compressed 35938196 34815397 1.03
tpcds_q03/duckdb:vortex-file-compressed 32532797 31888918 1.02
tpcds_q04/duckdb:vortex-file-compressed 101119644 108058616 0.94
tpcds_q05/duckdb:vortex-file-compressed 38137858 35833766 1.06
tpcds_q06/duckdb:vortex-file-compressed 33284494 31784682 1.05
tpcds_q07/duckdb:vortex-file-compressed 19431408 19404502 1.00
tpcds_q08/duckdb:vortex-file-compressed 28288011 27155907 1.04
tpcds_q09/duckdb:vortex-file-compressed 36822689 36740007 1.00
tpcds_q10/duckdb:vortex-file-compressed 41812817 40939172 1.02
tpcds_q11/duckdb:vortex-file-compressed 62393241 60529775 1.03
tpcds_q12/duckdb:vortex-file-compressed 14485862 13694891 1.06
tpcds_q13/duckdb:vortex-file-compressed 33226595 32469219 1.02
tpcds_q14/duckdb:vortex-file-compressed 105124909 102231277 1.03
tpcds_q15/duckdb:vortex-file-compressed 27952843 26214342 1.07
tpcds_q16/duckdb:vortex-file-compressed 27426738 26872111 1.02
tpcds_q17/duckdb:vortex-file-compressed 44945505 41866170 1.07
tpcds_q18/duckdb:vortex-file-compressed 46514224 46137175 1.01
tpcds_q19/duckdb:vortex-file-compressed 33183980 32314360 1.03
tpcds_q20/duckdb:vortex-file-compressed 15697924 15498051 1.01
tpcds_q21/duckdb:vortex-file-compressed 17535104 17105603 1.03
tpcds_q22/duckdb:vortex-file-compressed 71622040 76238254 0.94
tpcds_q23/duckdb:vortex-file-compressed 108197623 110015337 0.98
tpcds_q24/duckdb:vortex-file-compressed 50035366 48661777 1.03
tpcds_q25/duckdb:vortex-file-compressed 49525504 48318771 1.02
tpcds_q26/duckdb:vortex-file-compressed 40640212 38919765 1.04
tpcds_q27/duckdb:vortex-file-compressed 49729557 48189459 1.03
tpcds_q28/duckdb:vortex-file-compressed 34176068 34805916 0.98
tpcds_q29/duckdb:vortex-file-compressed 42127599 40501018 1.04
tpcds_q30/duckdb:vortex-file-compressed 25029616 23687442 1.06
tpcds_q31/duckdb:vortex-file-compressed 37012923 35040944 1.06
tpcds_q32/duckdb:vortex-file-compressed 14349871 13830038 1.04
tpcds_q33/duckdb:vortex-file-compressed 23960580 23182593 1.03
tpcds_q34/duckdb:vortex-file-compressed 23043273 23351945 0.99
tpcds_q35/duckdb:vortex-file-compressed 68021402 64628409 1.05
tpcds_q36/duckdb:vortex-file-compressed 25340127 23856915 1.06
tpcds_q37/duckdb:vortex-file-compressed 15898235 14730183 1.08
tpcds_q38/duckdb:vortex-file-compressed 37845161 38405194 0.99
tpcds_q39/duckdb:vortex-file-compressed 37230526 34186287 1.09
tpcds_q40/duckdb:vortex-file-compressed 19944089 19073796 1.05
tpcds_q41/duckdb:vortex-file-compressed 13818800 13266106 1.04
tpcds_q42/duckdb:vortex-file-compressed 13043701 12951506 1.01
tpcds_q43/duckdb:vortex-file-compressed 22677377 25010545 0.91
tpcds_q44/duckdb:vortex-file-compressed 21565730 20555229 1.05
tpcds_q45/duckdb:vortex-file-compressed 31481832 30297441 1.04
tpcds_q46/duckdb:vortex-file-compressed 50967737 51522109 0.99
tpcds_q47/duckdb:vortex-file-compressed 47177130 47395381 1.00
tpcds_q48/duckdb:vortex-file-compressed 32132184 29595418 1.09
tpcds_q49/duckdb:vortex-file-compressed 34539159 32882726 1.05
tpcds_q50/duckdb:vortex-file-compressed 34564503 33917667 1.02
tpcds_q51/duckdb:vortex-file-compressed 99158194 98072878 1.01
tpcds_q52/duckdb:vortex-file-compressed 13511459 13484662 1.00
tpcds_q53/duckdb:vortex-file-compressed 23758969 22236906 1.07
tpcds_q54/duckdb:vortex-file-compressed 28262019 27502028 1.03
tpcds_q55/duckdb:vortex-file-compressed 14342680 13204220 1.09
tpcds_q56/duckdb:vortex-file-compressed 24691653 24524168 1.01
tpcds_q57/duckdb:vortex-file-compressed 39658910 40227913 0.99
tpcds_q58/duckdb:vortex-file-compressed 30861532 30885791 1.00
tpcds_q59/duckdb:vortex-file-compressed 67440338 68640769 0.98
tpcds_q60/duckdb:vortex-file-compressed 25626843 26323926 0.97
tpcds_q61/duckdb:vortex-file-compressed 31335091 30425169 1.03
tpcds_q62/duckdb:vortex-file-compressed 🚨 19573382 16964440 1.15
tpcds_q63/duckdb:vortex-file-compressed 22261059 20780141 1.07
tpcds_q64/duckdb:vortex-file-compressed 86654291 85426383 1.01
tpcds_q65/duckdb:vortex-file-compressed 22035657 21728677 1.01
tpcds_q66/duckdb:vortex-file-compressed 31236898 29632284 1.05
tpcds_q67/duckdb:vortex-file-compressed 140319510 136511190 1.03
tpcds_q68/duckdb:vortex-file-compressed 41936508 41731127 1.00
tpcds_q69/duckdb:vortex-file-compressed 42913088 41248891 1.04
tpcds_q70/duckdb:vortex-file-compressed 26881815 25590079 1.05
tpcds_q71/duckdb:vortex-file-compressed 22899147 21026463 1.09
tpcds_q72/duckdb:vortex-file-compressed 175766772 172621230 1.02
tpcds_q73/duckdb:vortex-file-compressed 24334209 23789802 1.02
tpcds_q74/duckdb:vortex-file-compressed 🚀 72061861 96012399 0.75
tpcds_q75/duckdb:vortex-file-compressed 60082996 56100527 1.07
tpcds_q76/duckdb:vortex-file-compressed 18330021 18285039 1.00
tpcds_q77/duckdb:vortex-file-compressed 24969578 24048200 1.04
tpcds_q78/duckdb:vortex-file-compressed 73142148 72172277 1.01
tpcds_q79/duckdb:vortex-file-compressed 32700336 33195913 0.99
tpcds_q80/duckdb:vortex-file-compressed 🚀 46772204 51980409 0.90
tpcds_q81/duckdb:vortex-file-compressed 29593709 28132214 1.05
tpcds_q82/duckdb:vortex-file-compressed 17139790 17287262 0.99
tpcds_q83/duckdb:vortex-file-compressed 25970450 23953389 1.08
tpcds_q84/duckdb:vortex-file-compressed 19345651 19487121 0.99
tpcds_q85/duckdb:vortex-file-compressed 45326291 45578391 0.99
tpcds_q86/duckdb:vortex-file-compressed 🚨 18467014 16180048 1.14
tpcds_q87/duckdb:vortex-file-compressed 40227152 39693888 1.01
tpcds_q88/duckdb:vortex-file-compressed 33838035 33330774 1.02
tpcds_q89/duckdb:vortex-file-compressed 23224761 21681990 1.07
tpcds_q90/duckdb:vortex-file-compressed 13402381 13082891 1.02
tpcds_q91/duckdb:vortex-file-compressed 32947436 30451129 1.08
tpcds_q92/duckdb:vortex-file-compressed 🚀 22133243 25023181 0.88
tpcds_q93/duckdb:vortex-file-compressed 27398746 28511972 0.96
tpcds_q94/duckdb:vortex-file-compressed 23390023 23332548 1.00
tpcds_q95/duckdb:vortex-file-compressed 134494915 140763777 0.96
tpcds_q96/duckdb:vortex-file-compressed 13337808 13160108 1.01
tpcds_q97/duckdb:vortex-file-compressed 40061110 38870003 1.03
tpcds_q98/duckdb:vortex-file-compressed 18001904 17951528 1.00
tpcds_q99/duckdb:vortex-file-compressed 🚨 34794547 27594311 1.26
duckdb / vortex-compact (1.010x ➖, 1↑ 1↓)
name PR a1d2e1e (ns) base eda8c2c (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-compact 24585882 23030231 1.07
tpcds_q02/duckdb:vortex-compact 42825454 40125708 1.07
tpcds_q03/duckdb:vortex-compact 57968651 56522491 1.03
tpcds_q04/duckdb:vortex-compact 121952180 126940297 0.96
tpcds_q05/duckdb:vortex-compact 51670283 51741765 1.00
tpcds_q06/duckdb:vortex-compact 41035569 40064288 1.02
tpcds_q07/duckdb:vortex-compact 35659063 33854235 1.05
tpcds_q08/duckdb:vortex-compact 46621827 46052121 1.01
tpcds_q09/duckdb:vortex-compact 57705350 57228779 1.01
tpcds_q10/duckdb:vortex-compact 62823010 59790864 1.05
tpcds_q11/duckdb:vortex-compact 71869974 69121457 1.04
tpcds_q12/duckdb:vortex-compact 24050303 23676506 1.02
tpcds_q13/duckdb:vortex-compact 59254297 59775585 0.99
tpcds_q14/duckdb:vortex-compact 134743665 129674249 1.04
tpcds_q15/duckdb:vortex-compact 31657859 30891992 1.02
tpcds_q16/duckdb:vortex-compact 32782914 31881288 1.03
tpcds_q17/duckdb:vortex-compact 55828697 56403746 0.99
tpcds_q18/duckdb:vortex-compact 60213419 58138027 1.04
tpcds_q19/duckdb:vortex-compact 50548738 51702798 0.98
tpcds_q20/duckdb:vortex-compact 20974577 20227065 1.04
tpcds_q21/duckdb:vortex-compact 21219722 19586122 1.08
tpcds_q22/duckdb:vortex-compact 82544682 76756124 1.08
tpcds_q23/duckdb:vortex-compact 122950799 117431748 1.05
tpcds_q24/duckdb:vortex-compact 63181524 64944915 0.97
tpcds_q25/duckdb:vortex-compact 84293963 81971068 1.03
tpcds_q26/duckdb:vortex-compact 54412218 52393771 1.04
tpcds_q27/duckdb:vortex-compact 72086072 70769902 1.02
tpcds_q28/duckdb:vortex-compact 84308348 85929762 0.98
tpcds_q29/duckdb:vortex-compact 54573956 54594054 1.00
tpcds_q30/duckdb:vortex-compact 29857308 30222716 0.99
tpcds_q31/duckdb:vortex-compact 46313650 45547541 1.02
tpcds_q32/duckdb:vortex-compact 23863990 23503834 1.02
tpcds_q33/duckdb:vortex-compact 37367724 35808415 1.04
tpcds_q34/duckdb:vortex-compact 38283508 38653408 0.99
tpcds_q35/duckdb:vortex-compact 84163877 80865780 1.04
tpcds_q36/duckdb:vortex-compact 40567423 40505307 1.00
tpcds_q37/duckdb:vortex-compact 25006849 23285728 1.07
tpcds_q38/duckdb:vortex-compact 48603069 48677738 1.00
tpcds_q39/duckdb:vortex-compact 37863654 36690548 1.03
tpcds_q40/duckdb:vortex-compact 25735338 24641774 1.04
tpcds_q41/duckdb:vortex-compact 16461638 15566057 1.06
tpcds_q42/duckdb:vortex-compact 21897699 21977949 1.00
tpcds_q43/duckdb:vortex-compact 35185607 36980255 0.95
tpcds_q44/duckdb:vortex-compact 30021984 28980271 1.04
tpcds_q45/duckdb:vortex-compact 37886451 37829379 1.00
tpcds_q46/duckdb:vortex-compact 72371345 70841206 1.02
tpcds_q47/duckdb:vortex-compact 62644434 62007261 1.01
tpcds_q48/duckdb:vortex-compact 53010486 52535665 1.01
tpcds_q49/duckdb:vortex-compact 56583637 55110021 1.03
tpcds_q50/duckdb:vortex-compact 45789002 45805671 1.00
tpcds_q51/duckdb:vortex-compact 108733260 108603077 1.00
tpcds_q52/duckdb:vortex-compact 22054540 22185443 0.99
tpcds_q53/duckdb:vortex-compact 39522437 38504396 1.03
tpcds_q54/duckdb:vortex-compact 41346321 40643664 1.02
tpcds_q55/duckdb:vortex-compact 23024357 22189662 1.04
tpcds_q56/duckdb:vortex-compact 35763369 35008596 1.02
tpcds_q57/duckdb:vortex-compact 43685428 43783539 1.00
tpcds_q58/duckdb:vortex-compact 44413992 40987916 1.08
tpcds_q59/duckdb:vortex-compact 88896140 92856637 0.96
tpcds_q60/duckdb:vortex-compact 38660478 37902958 1.02
tpcds_q61/duckdb:vortex-compact 🚨 67839085 61468758 1.10
tpcds_q62/duckdb:vortex-compact 28219608 26078533 1.08
tpcds_q63/duckdb:vortex-compact 40773832 37653229 1.08
tpcds_q64/duckdb:vortex-compact 113495887 116965998 0.97
tpcds_q65/duckdb:vortex-compact 34797842 33194710 1.05
tpcds_q66/duckdb:vortex-compact 41356816 41297299 1.00
tpcds_q67/duckdb:vortex-compact 155967527 155582200 1.00
tpcds_q68/duckdb:vortex-compact 61998028 62197130 1.00
tpcds_q69/duckdb:vortex-compact 63027372 62740708 1.00
tpcds_q70/duckdb:vortex-compact 37862542 37448220 1.01
tpcds_q71/duckdb:vortex-compact 34567906 33819928 1.02
tpcds_q72/duckdb:vortex-compact 193870902 196687085 0.99
tpcds_q73/duckdb:vortex-compact 37755889 37759834 1.00
tpcds_q74/duckdb:vortex-compact 80952531 88359586 0.92
tpcds_q75/duckdb:vortex-compact 71070055 74586316 0.95
tpcds_q76/duckdb:vortex-compact 34621651 35038812 0.99
tpcds_q77/duckdb:vortex-compact 43800009 45256354 0.97
tpcds_q78/duckdb:vortex-compact 91562260 88801079 1.03
tpcds_q79/duckdb:vortex-compact 53157751 55107029 0.96
tpcds_q80/duckdb:vortex-compact 79682197 84349127 0.94
tpcds_q81/duckdb:vortex-compact 33485288 36771768 0.91
tpcds_q82/duckdb:vortex-compact 26465784 27097747 0.98
tpcds_q83/duckdb:vortex-compact 34469861 34469318 1.00
tpcds_q84/duckdb:vortex-compact 27165003 27749139 0.98
tpcds_q85/duckdb:vortex-compact 58102577 61139251 0.95
tpcds_q86/duckdb:vortex-compact 25112213 24421084 1.03
tpcds_q87/duckdb:vortex-compact 51695486 52117688 0.99
tpcds_q88/duckdb:vortex-compact 40337475 40046837 1.01
tpcds_q89/duckdb:vortex-compact 38980900 37955725 1.03
tpcds_q90/duckdb:vortex-compact 15270044 15391286 0.99
tpcds_q91/duckdb:vortex-compact 52079955 49578632 1.05
tpcds_q92/duckdb:vortex-compact 🚀 46257125 55814672 0.83
tpcds_q93/duckdb:vortex-compact 31969365 32023207 1.00
tpcds_q94/duckdb:vortex-compact 33637896 32547936 1.03
tpcds_q95/duckdb:vortex-compact 160990400 163665164 0.98
tpcds_q96/duckdb:vortex-compact 17667115 17708285 1.00
tpcds_q97/duckdb:vortex-compact 45735021 46720115 0.98
tpcds_q98/duckdb:vortex-compact 29993741 28204665 1.06
tpcds_q99/duckdb:vortex-compact 32225372 32015245 1.01
duckdb / parquet (1.009x ➖, 1↑ 4↓)
name PR a1d2e1e (ns) base eda8c2c (ns) ratio (PR/base)
tpcds_q01/duckdb:parquet 28590847 30698995 0.93
tpcds_q02/duckdb:parquet 22628569 22913492 0.99
tpcds_q03/duckdb:parquet 11460567 11270820 1.02
tpcds_q04/duckdb:parquet 171617878 169572348 1.01
tpcds_q05/duckdb:parquet 30383461 27877649 1.09
tpcds_q06/duckdb:parquet 27746829 28000137 0.99
tpcds_q07/duckdb:parquet 20723803 21961999 0.94
tpcds_q08/duckdb:parquet 26836706 26607665 1.01
tpcds_q09/duckdb:parquet 40050990 39656023 1.01
tpcds_q10/duckdb:parquet 32114212 32483571 0.99
tpcds_q11/duckdb:parquet 🚨 88120364 80089036 1.10
tpcds_q12/duckdb:parquet 14825519 13726827 1.08
tpcds_q13/duckdb:parquet 33022438 33235193 0.99
tpcds_q14/duckdb:parquet 101521379 100794133 1.01
tpcds_q15/duckdb:parquet 30997482 31341219 0.99
tpcds_q16/duckdb:parquet 20842803 22070580 0.94
tpcds_q17/duckdb:parquet 38108979 38958163 0.98
tpcds_q18/duckdb:parquet 45850230 44013343 1.04
tpcds_q19/duckdb:parquet 28654824 29179710 0.98
tpcds_q20/duckdb:parquet 15661265 15134541 1.03
tpcds_q21/duckdb:parquet 🚀 10370613 11905376 0.87
tpcds_q22/duckdb:parquet 66256961 65543421 1.01
tpcds_q23/duckdb:parquet 79180279 79334251 1.00
tpcds_q24/duckdb:parquet 44411112 44895317 0.99
tpcds_q25/duckdb:parquet 33484692 32884496 1.02
tpcds_q26/duckdb:parquet 35530594 35248845 1.01
tpcds_q27/duckdb:parquet 48330270 49247175 0.98
tpcds_q28/duckdb:parquet 37864345 37092929 1.02
tpcds_q29/duckdb:parquet 36394802 36096357 1.01
tpcds_q30/duckdb:parquet 35991722 35210179 1.02
tpcds_q31/duckdb:parquet 24069207 23670215 1.02
tpcds_q32/duckdb:parquet 11957766 11695076 1.02
tpcds_q33/duckdb:parquet 21164457 20765322 1.02
tpcds_q34/duckdb:parquet 20323646 20012420 1.02
tpcds_q35/duckdb:parquet 58455032 59448795 0.98
tpcds_q36/duckdb:parquet 19700402 19566937 1.01
tpcds_q37/duckdb:parquet 12347574 12318047 1.00
tpcds_q38/duckdb:parquet 33457893 33126456 1.01
tpcds_q39/duckdb:parquet 29497796 29470331 1.00
tpcds_q40/duckdb:parquet 17853604 16992484 1.05
tpcds_q41/duckdb:parquet 8010663 7840915 1.02
tpcds_q42/duckdb:parquet 9576076 9771885 0.98
tpcds_q43/duckdb:parquet 15095838 15040258 1.00
tpcds_q44/duckdb:parquet 21501534 23123236 0.93
tpcds_q45/duckdb:parquet 26760071 26598717 1.01
tpcds_q46/duckdb:parquet 46588808 44271020 1.05
tpcds_q47/duckdb:parquet 43601197 44533644 0.98
tpcds_q48/duckdb:parquet 29116104 29007775 1.00
tpcds_q49/duckdb:parquet 25612550 23882075 1.07
tpcds_q50/duckdb:parquet 24345540 23968575 1.02
tpcds_q51/duckdb:parquet 94921944 94067148 1.01
tpcds_q52/duckdb:parquet 10296100 10074687 1.02
tpcds_q53/duckdb:parquet 15501911 14873369 1.04
tpcds_q54/duckdb:parquet 24392376 26229523 0.93
tpcds_q55/duckdb:parquet 9952777 9870986 1.01
tpcds_q56/duckdb:parquet 20582508 20175777 1.02
tpcds_q57/duckdb:parquet 34297821 34470754 0.99
tpcds_q58/duckdb:parquet 22070161 22263986 0.99
tpcds_q59/duckdb:parquet 35652619 35360132 1.01
tpcds_q60/duckdb:parquet 22019091 21778964 1.01
tpcds_q61/duckdb:parquet 30633331 30857397 0.99
tpcds_q62/duckdb:parquet 11319664 11475532 0.99
tpcds_q63/duckdb:parquet 14417947 14040654 1.03
tpcds_q64/duckdb:parquet 75471999 75160898 1.00
tpcds_q65/duckdb:parquet 20968220 19730370 1.06
tpcds_q66/duckdb:parquet 27642594 29855593 0.93
tpcds_q67/duckdb:parquet 138823585 134761470 1.03
tpcds_q68/duckdb:parquet 37142160 36475753 1.02
tpcds_q69/duckdb:parquet 35900402 36376641 0.99
tpcds_q70/duckdb:parquet 19398309 19071171 1.02
tpcds_q71/duckdb:parquet 19663132 19785132 0.99
tpcds_q72/duckdb:parquet 163726931 165982712 0.99
tpcds_q73/duckdb:parquet 17955255 17425637 1.03
tpcds_q74/duckdb:parquet 128046626 125190095 1.02
tpcds_q75/duckdb:parquet 53393866 54357861 0.98
tpcds_q76/duckdb:parquet 19469319 19138306 1.02
tpcds_q77/duckdb:parquet 22986458 21065039 1.09
tpcds_q78/duckdb:parquet 75609016 72997867 1.04
tpcds_q79/duckdb:parquet 27059489 26517895 1.02
tpcds_q80/duckdb:parquet 41817738 39458116 1.06
tpcds_q81/duckdb:parquet 31147432 31805568 0.98
tpcds_q82/duckdb:parquet 13144829 13516675 0.97
tpcds_q83/duckdb:parquet 🚨 17545103 15569703 1.13
tpcds_q84/duckdb:parquet 18545558 18319176 1.01
tpcds_q85/duckdb:parquet 38243447 38524647 0.99
tpcds_q86/duckdb:parquet 12311479 12635743 0.97
tpcds_q87/duckdb:parquet 36367476 35670240 1.02
tpcds_q88/duckdb:parquet 49016356 48888198 1.00
tpcds_q89/duckdb:parquet 16394790 15815399 1.04
tpcds_q90/duckdb:parquet 🚨 7847873 7086006 1.11
tpcds_q91/duckdb:parquet 22222255 22745000 0.98
tpcds_q92/duckdb:parquet 11083102 12162893 0.91
tpcds_q93/duckdb:parquet 30272734 28938387 1.05
tpcds_q94/duckdb:parquet 16931442 16664537 1.02
tpcds_q95/duckdb:parquet 🚨 130251440 116072897 1.12
tpcds_q96/duckdb:parquet 9053577 8397826 1.08
tpcds_q97/duckdb:parquet 34378141 34617139 0.99
tpcds_q98/duckdb:parquet 17946542 17468083 1.03
tpcds_q99/duckdb:parquet 20091299 19800593 1.01
duckdb / duckdb (0.985x ➖, 2↑ 0↓)
name PR a1d2e1e (ns) base eda8c2c (ns) ratio (PR/base)
tpcds_q01/duckdb:duckdb 20480435 20077743 1.02
tpcds_q02/duckdb:duckdb 17897895 18427213 0.97
tpcds_q03/duckdb:duckdb 8617478 8889866 0.97
tpcds_q04/duckdb:duckdb 178493488 180966702 0.99
tpcds_q05/duckdb:duckdb 20648296 19096637 1.08
tpcds_q06/duckdb:duckdb 23226544 23333777 1.00
tpcds_q07/duckdb:duckdb 39028131 41260848 0.95
tpcds_q08/duckdb:duckdb 121539975 122277988 0.99
tpcds_q09/duckdb:duckdb 20365829 20443281 1.00
tpcds_q10/duckdb:duckdb 23594582 25182510 0.94
tpcds_q11/duckdb:duckdb 88952231 90128133 0.99
tpcds_q12/duckdb:duckdb 11970274 11728369 1.02
tpcds_q13/duckdb:duckdb 25497740 24745371 1.03
tpcds_q14/duckdb:duckdb 93897315 93985541 1.00
tpcds_q15/duckdb:duckdb 24866622 25619523 0.97
tpcds_q16/duckdb:duckdb 18534305 19232022 0.96
tpcds_q17/duckdb:duckdb 21787140 23241724 0.94
tpcds_q18/duckdb:duckdb 44734578 46116551 0.97
tpcds_q19/duckdb:duckdb 16520015 17571319 0.94
tpcds_q20/duckdb:duckdb 12521981 12869034 0.97
tpcds_q21/duckdb:duckdb 7119416 7858777 0.91
tpcds_q22/duckdb:duckdb 65147559 64724366 1.01
tpcds_q23/duckdb:duckdb 75948752 75759956 1.00
tpcds_q24/duckdb:duckdb 24742327 25484462 0.97
tpcds_q25/duckdb:duckdb 17766555 18292614 0.97
tpcds_q26/duckdb:duckdb 27975576 28057743 1.00
tpcds_q27/duckdb:duckdb 40287716 40500750 0.99
tpcds_q28/duckdb:duckdb 22141293 21722339 1.02
tpcds_q29/duckdb:duckdb 20987106 22832703 0.92
tpcds_q30/duckdb:duckdb 29608525 30306760 0.98
tpcds_q31/duckdb:duckdb 47907131 50193056 0.95
tpcds_q32/duckdb:duckdb 7560021 8145738 0.93
tpcds_q33/duckdb:duckdb 13323703 13406085 0.99
tpcds_q34/duckdb:duckdb 15258081 16435920 0.93
tpcds_q35/duckdb:duckdb 31800672 32346786 0.98
tpcds_q36/duckdb:duckdb 72055796 73181142 0.98
tpcds_q37/duckdb:duckdb 8102372 8306207 0.98
tpcds_q38/duckdb:duckdb 32293035 32504137 0.99
tpcds_q39/duckdb:duckdb 26482776 26195091 1.01
tpcds_q40/duckdb:duckdb 13290779 14116361 0.94
tpcds_q41/duckdb:duckdb 8472666 8690640 0.97
tpcds_q42/duckdb:duckdb 🚀 6501407 7287195 0.89
tpcds_q43/duckdb:duckdb 11760254 11530185 1.02
tpcds_q44/duckdb:duckdb 13860578 13905470 1.00
tpcds_q45/duckdb:duckdb 18058014 17450765 1.03
tpcds_q46/duckdb:duckdb 36602511 38381467 0.95
tpcds_q47/duckdb:duckdb 41396755 41049233 1.01
tpcds_q48/duckdb:duckdb 23848105 22237607 1.07
tpcds_q49/duckdb:duckdb 17381433 15999778 1.09
tpcds_q50/duckdb:duckdb 14649336 14758321 0.99
tpcds_q51/duckdb:duckdb 92539214 92190615 1.00
tpcds_q52/duckdb:duckdb 7345244 7688185 0.96
tpcds_q53/duckdb:duckdb 13768568 13397495 1.03
tpcds_q54/duckdb:duckdb 17525313 17424038 1.01
tpcds_q55/duckdb:duckdb 6970783 7466064 0.93
tpcds_q56/duckdb:duckdb 14832578 14402118 1.03
tpcds_q57/duckdb:duckdb 31762742 31936813 0.99
tpcds_q58/duckdb:duckdb 13258226 13424538 0.99
tpcds_q59/duckdb:duckdb 36436512 36378953 1.00
tpcds_q60/duckdb:duckdb 14989830 15826178 0.95
tpcds_q61/duckdb:duckdb 14944998 15305449 0.98
tpcds_q62/duckdb:duckdb 9972639 10162166 0.98
tpcds_q63/duckdb:duckdb 12622952 13061819 0.97
tpcds_q64/duckdb:duckdb 56073686 57734626 0.97
tpcds_q65/duckdb:duckdb 32569149 35942325 0.91
tpcds_q66/duckdb:duckdb 27030934 25713836 1.05
tpcds_q67/duckdb:duckdb 131177547 130002038 1.01
tpcds_q68/duckdb:duckdb 25670295 25699633 1.00
tpcds_q69/duckdb:duckdb 24788133 26238563 0.94
tpcds_q70/duckdb:duckdb 14968160 14824890 1.01
tpcds_q71/duckdb:duckdb 12887521 12721974 1.01
tpcds_q72/duckdb:duckdb 43790386 42454071 1.03
tpcds_q73/duckdb:duckdb 11471004 10862066 1.06
tpcds_q74/duckdb:duckdb 148827103 145030732 1.03
tpcds_q75/duckdb:duckdb 43443915 42665149 1.02
tpcds_q76/duckdb:duckdb 11683047 12294431 0.95
tpcds_q77/duckdb:duckdb 12244932 12668886 0.97
tpcds_q78/duckdb:duckdb 64503412 64806058 1.00
tpcds_q79/duckdb:duckdb 19173324 19550345 0.98
tpcds_q80/duckdb:duckdb 27489251 29117784 0.94
tpcds_q81/duckdb:duckdb 40345608 40650328 0.99
tpcds_q82/duckdb:duckdb 8775115 9323497 0.94
tpcds_q83/duckdb:duckdb 9980236 9920589 1.01
tpcds_q84/duckdb:duckdb 14389511 14877010 0.97
tpcds_q85/duckdb:duckdb 24322138 25139719 0.97
tpcds_q86/duckdb:duckdb 11132345 11023657 1.01
tpcds_q87/duckdb:duckdb 34987583 34270505 1.02
tpcds_q88/duckdb:duckdb 26640242 26502041 1.01
tpcds_q89/duckdb:duckdb 14923751 15194557 0.98
tpcds_q90/duckdb:duckdb 5769120 5943564 0.97
tpcds_q91/duckdb:duckdb 12746227 13831262 0.92
tpcds_q92/duckdb:duckdb 9155721 9151193 1.00
tpcds_q93/duckdb:duckdb 🚀 21147296 23651386 0.89
tpcds_q94/duckdb:duckdb 13064069 12792328 1.02
tpcds_q95/duckdb:duckdb 115345313 115517355 1.00
tpcds_q96/duckdb:duckdb 4847883 4960243 0.98
tpcds_q97/duckdb:duckdb 31275970 30379621 1.03
tpcds_q98/duckdb:duckdb 13582214 13404753 1.01
tpcds_q99/duckdb:duckdb 16797334 17271477 0.97
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact +2.6% +0.9% +1.7% +19.4% ➖ noise
1 datafusion:vortex-file-compressed +1.2% +0.9% +0.3% +20.0% ➖ noise
1 duckdb:duckdb +2.0% +0.9% +1.1% +20.7% ➖ noise
1 duckdb:vortex-compact +6.8% +0.9% +5.8% +22.3% ➖ noise
1 duckdb:vortex-file-compressed +0.9% +0.9% -0.0% +37.9% ➖ noise
2 datafusion:vortex-compact -1.1% +0.5% -1.5% +10.0% ➖ noise
2 datafusion:vortex-file-compressed -0.8% +0.5% -1.3% +10.0% ➖ noise
2 duckdb:duckdb -2.9% +0.5% -3.3% +13.8% ➖ noise
2 duckdb:vortex-compact +6.7% +0.5% +6.2% +27.1% ➖ noise
2 duckdb:vortex-file-compressed +3.2% +0.5% +2.7% +32.0% ➖ noise
3 datafusion:vortex-compact +1.7% +2.7% -1.0% +10.0% ➖ noise
3 datafusion:vortex-file-compressed +0.8% +2.7% -1.9% +10.0% ➖ noise
3 duckdb:duckdb -3.1% +2.7% -5.6% +13.3% ➖ noise
3 duckdb:vortex-compact +2.6% +2.7% -0.1% +10.0% ➖ noise
3 duckdb:vortex-file-compressed +2.0% +2.7% -0.7% +10.0% ➖ noise
4 datafusion:vortex-compact +1.6% +0.2% +1.4% +11.6% ➖ noise
4 datafusion:vortex-file-compressed +4.8% +0.2% +4.6% +10.0% ➖ noise
4 duckdb:duckdb -1.4% +0.2% -1.6% +10.0% ➖ noise
4 duckdb:vortex-compact -3.9% +0.2% -4.2% +10.3% ➖ noise
4 duckdb:vortex-file-compressed -6.4% +0.2% -6.6% +10.5% ➖ noise
5 datafusion:vortex-compact +1.9% +2.4% -0.5% +19.4% ➖ noise
5 datafusion:vortex-file-compressed -0.4% +2.4% -2.8% +15.4% ➖ noise
5 duckdb:duckdb +8.1% +2.4% +5.6% +13.2% ➖ noise
5 duckdb:vortex-compact -0.1% +2.4% -2.4% +11.1% ➖ noise
5 duckdb:vortex-file-compressed +6.4% +2.4% +4.0% +10.0% ➖ noise
6 datafusion:vortex-compact +0.6% -0.3% +0.9% +10.0% ➖ noise
6 datafusion:vortex-file-compressed -3.1% -0.3% -2.9% +10.0% ➖ noise
6 duckdb:duckdb -0.5% -0.3% -0.2% +11.6% ➖ noise
6 duckdb:vortex-compact +2.4% -0.3% +2.7% +10.0% ➖ noise
6 duckdb:vortex-file-compressed +4.7% -0.3% +5.0% +10.0% ➖ noise
7 datafusion:vortex-compact -3.1% -1.8% -1.3% +10.0% ➖ noise
7 datafusion:vortex-file-compressed -2.8% -1.8% -1.0% +10.0% ➖ noise
7 duckdb:duckdb -5.4% -1.8% -3.7% +16.8% ➖ noise
7 duckdb:vortex-compact +5.3% -1.8% +7.3% +14.8% ➖ noise
7 duckdb:vortex-file-compressed +0.1% -1.8% +2.0% +31.3% ➖ noise
8 datafusion:vortex-compact +0.5% +2.0% -1.5% +10.0% ➖ noise
8 datafusion:vortex-file-compressed -0.4% +2.0% -2.3% +10.7% ➖ noise
8 duckdb:duckdb -0.6% +2.0% -2.6% +10.8% ➖ noise
8 duckdb:vortex-compact +1.2% +2.0% -0.8% +14.8% ➖ noise
8 duckdb:vortex-file-compressed +4.2% +2.0% +2.1% +10.0% ➖ noise
9 datafusion:vortex-compact +0.9% +10.8% -9.0% +10.0% ➖ noise
9 datafusion:vortex-file-compressed +0.6% +10.8% -9.2% +10.1% ✅ faster
9 duckdb:duckdb -0.4% +10.8% -10.1% +10.0% ✅ faster
9 duckdb:vortex-compact +0.8% +10.8% -9.0% +10.5% ➖ noise
9 duckdb:vortex-file-compressed +0.2% +10.8% -9.6% +10.6% ➖ noise
10 datafusion:vortex-compact -2.5% +0.4% -2.9% +10.0% ➖ noise
10 datafusion:vortex-file-compressed -1.6% +0.4% -2.0% +10.0% ➖ noise
10 duckdb:duckdb -6.3% +0.4% -6.7% +10.0% ➖ noise
10 duckdb:vortex-compact +5.1% +0.4% +4.7% +11.4% ➖ noise
10 duckdb:vortex-file-compressed +2.1% +0.4% +1.7% +10.0% ➖ noise
11 datafusion:vortex-compact -5.5% +4.8% -9.8% +10.0% ✅ faster
11 datafusion:vortex-file-compressed -4.4% +4.8% -8.9% +10.0% ➖ noise
11 duckdb:duckdb -1.3% +4.8% -5.9% +10.3% ➖ noise
11 duckdb:vortex-compact +4.0% +4.8% -0.8% +13.8% ➖ noise
11 duckdb:vortex-file-compressed +3.1% +4.8% -1.7% +10.6% ➖ noise
12 datafusion:vortex-compact +10.5% +3.4% +6.9% +15.6% ➖ noise
12 datafusion:vortex-file-compressed -0.8% +3.4% -4.1% +25.6% ➖ noise
12 duckdb:duckdb +2.1% +3.4% -1.3% +17.5% ➖ noise
12 duckdb:vortex-compact +1.6% +3.4% -1.8% +16.2% ➖ noise
12 duckdb:vortex-file-compressed +5.8% +3.4% +2.3% +13.7% ➖ noise
13 datafusion:vortex-compact +0.3% +2.0% -1.6% +16.8% ➖ noise
13 datafusion:vortex-file-compressed +1.4% +2.0% -0.6% +10.0% ➖ noise
13 duckdb:duckdb +3.0% +2.0% +1.0% +10.0% ➖ noise
13 duckdb:vortex-compact -0.9% +2.0% -2.8% +10.0% ➖ noise
13 duckdb:vortex-file-compressed +2.3% +2.0% +0.4% +10.0% ➖ noise
14 datafusion:vortex-compact -0.5% +2.0% -2.4% +10.0% ➖ noise
14 datafusion:vortex-file-compressed +0.5% +2.0% -1.5% +10.0% ➖ noise
14 duckdb:duckdb -0.1% +2.0% -2.1% +10.0% ➖ noise
14 duckdb:vortex-compact +3.9% +2.0% +1.9% +10.0% ➖ noise
14 duckdb:vortex-file-compressed +2.8% +2.0% +0.8% +10.0% ➖ noise
15 datafusion:vortex-compact -4.0% -2.8% -1.2% +12.4% ➖ noise
15 datafusion:vortex-file-compressed -1.0% -2.8% +1.9% +10.0% ➖ noise
15 duckdb:duckdb -2.9% -2.8% -0.1% +10.0% ➖ noise
15 duckdb:vortex-compact +2.5% -2.8% +5.5% +10.0% ➖ noise
15 duckdb:vortex-file-compressed +6.6% -2.8% +9.7% +11.0% ➖ noise
16 datafusion:vortex-compact +4.3% -1.8% +6.2% +23.4% ➖ noise
16 datafusion:vortex-file-compressed -0.7% -1.8% +1.1% +10.0% ➖ noise
16 duckdb:duckdb -3.6% -1.8% -1.8% +14.0% ➖ noise
16 duckdb:vortex-compact +2.8% -1.8% +4.7% +10.9% ➖ noise
16 duckdb:vortex-file-compressed +2.1% -1.8% +3.9% +10.0% ➖ noise
17 datafusion:vortex-compact -0.5% -4.2% +3.9% +10.0% ➖ noise
17 datafusion:vortex-file-compressed +1.8% -4.2% +6.3% +10.2% ➖ noise
17 duckdb:duckdb -6.3% -4.2% -2.1% +10.0% ➖ noise
17 duckdb:vortex-compact -1.0% -4.2% +3.3% +12.3% ➖ noise
17 duckdb:vortex-file-compressed +7.4% -4.2% +12.1% +12.4% ➖ noise
18 datafusion:vortex-compact -0.5% +2.4% -2.8% +10.0% ➖ noise
18 datafusion:vortex-file-compressed -0.7% +2.4% -3.0% +10.0% ➖ noise
18 duckdb:duckdb -3.0% +2.4% -5.2% +10.0% ➖ noise
18 duckdb:vortex-compact +3.6% +2.4% +1.2% +10.0% ➖ noise
18 duckdb:vortex-file-compressed +0.8% +2.4% -1.5% +12.2% ➖ noise
19 datafusion:vortex-compact -1.6% +0.5% -2.0% +17.0% ➖ noise
19 datafusion:vortex-file-compressed +3.4% +0.5% +2.9% +10.0% ➖ noise
19 duckdb:duckdb -6.0% +0.5% -6.4% +10.2% ➖ noise
19 duckdb:vortex-compact -2.2% +0.5% -2.7% +10.0% ➖ noise
19 duckdb:vortex-file-compressed +2.7% +0.5% +2.2% +10.0% ➖ noise
20 datafusion:vortex-compact -1.4% +2.9% -4.2% +11.4% ➖ noise
20 datafusion:vortex-file-compressed +4.7% +2.9% +1.7% +10.0% ➖ noise
20 duckdb:duckdb -2.7% +2.9% -5.5% +12.9% ➖ noise
20 duckdb:vortex-compact +3.7% +2.9% +0.7% +10.0% ➖ noise
20 duckdb:vortex-file-compressed +1.3% +2.9% -1.6% +10.0% ➖ noise
21 datafusion:vortex-compact +0.2% -4.7% +5.2% +10.5% ➖ noise
21 datafusion:vortex-file-compressed -2.9% -4.7% +1.9% +10.6% ➖ noise
21 duckdb:duckdb -9.4% -4.7% -4.9% +21.0% ➖ noise
21 duckdb:vortex-compact +8.3% -4.7% +13.7% +12.5% 🚨 regression
21 duckdb:vortex-file-compressed +2.5% -4.7% +7.6% +22.7% ➖ noise
22 datafusion:vortex-compact -6.1% +3.2% -9.0% +24.2% ➖ noise
22 datafusion:vortex-file-compressed -4.7% +3.2% -7.6% +25.2% ➖ noise
22 duckdb:duckdb +0.7% +3.2% -2.5% +14.6% ➖ noise
22 duckdb:vortex-compact +7.5% +3.2% +4.2% +12.6% ➖ noise
22 duckdb:vortex-file-compressed -6.1% +3.2% -9.0% +12.9% ➖ noise
23 datafusion:vortex-compact -1.8% +2.2% -3.8% +10.5% ➖ noise
23 datafusion:vortex-file-compressed +1.6% +2.2% -0.5% +10.0% ➖ noise
23 duckdb:duckdb +0.2% +2.2% -1.9% +12.7% ➖ noise
23 duckdb:vortex-compact +4.7% +2.2% +2.5% +16.2% ➖ noise
23 duckdb:vortex-file-compressed -1.7% +2.2% -3.7% +13.4% ➖ noise
24 datafusion:vortex-compact +0.2% -0.0% +0.2% +10.5% ➖ noise
24 datafusion:vortex-file-compressed +2.7% -0.0% +2.7% +11.3% ➖ noise
24 duckdb:duckdb -2.9% -0.0% -2.9% +10.1% ➖ noise
24 duckdb:vortex-compact -2.7% -0.0% -2.7% +11.1% ➖ noise
24 duckdb:vortex-file-compressed +2.8% -0.0% +2.8% +13.5% ➖ noise
25 datafusion:vortex-compact +1.4% +1.6% -0.2% +10.0% ➖ noise
25 datafusion:vortex-file-compressed +1.2% +1.6% -0.5% +10.0% ➖ noise
25 duckdb:duckdb -2.9% +1.6% -4.4% +10.0% ➖ noise
25 duckdb:vortex-compact +2.8% +1.6% +1.2% +10.0% ➖ noise
25 duckdb:vortex-file-compressed +2.5% +1.6% +0.9% +10.0% ➖ noise
26 datafusion:vortex-compact +2.9% +1.8% +1.1% +16.0% ➖ noise
26 datafusion:vortex-file-compressed -1.1% +1.8% -2.9% +13.6% ➖ noise
26 duckdb:duckdb -0.3% +1.8% -2.1% +15.8% ➖ noise
26 duckdb:vortex-compact +3.9% +1.8% +2.0% +10.7% ➖ noise
26 duckdb:vortex-file-compressed +4.4% +1.8% +2.6% +19.4% ➖ noise
27 datafusion:vortex-compact +0.6% +0.6% -0.0% +10.7% ➖ noise
27 datafusion:vortex-file-compressed -1.4% +0.6% -1.9% +12.1% ➖ noise
27 duckdb:duckdb -0.5% +0.6% -1.1% +20.1% ➖ noise
27 duckdb:vortex-compact +1.9% +0.6% +1.3% +11.7% ➖ noise
27 duckdb:vortex-file-compressed +3.2% +0.6% +2.6% +18.2% ➖ noise
28 datafusion:vortex-compact -5.6% +2.5% -7.9% +11.0% ➖ noise
28 datafusion:vortex-file-compressed -1.4% +2.5% -3.8% +10.0% ➖ noise
28 duckdb:duckdb +1.9% +2.5% -0.6% +10.0% ➖ noise
28 duckdb:vortex-compact -1.9% +2.5% -4.3% +10.0% ➖ noise
28 duckdb:vortex-file-compressed -1.8% +2.5% -4.2% +10.0% ➖ noise
29 datafusion:vortex-compact -2.4% +1.4% -3.7% +10.0% ➖ noise
29 datafusion:vortex-file-compressed +0.2% +1.4% -1.2% +14.8% ➖ noise
29 duckdb:duckdb -8.1% +1.4% -9.4% +41.6% ➖ noise
29 duckdb:vortex-compact -0.0% +1.4% -1.4% +11.1% ➖ noise
29 duckdb:vortex-file-compressed +4.0% +1.4% +2.6% +10.0% ➖ noise
30 datafusion:vortex-compact -2.8% +3.3% -5.9% +10.0% ➖ noise
30 datafusion:vortex-file-compressed +6.5% +3.3% +3.1% +10.0% ➖ noise
30 duckdb:duckdb -2.3% +3.3% -5.4% +10.0% ➖ noise
30 duckdb:vortex-compact -1.2% +3.3% -4.4% +10.0% ➖ noise
30 duckdb:vortex-file-compressed +5.7% +3.3% +2.3% +15.7% ➖ noise
31 datafusion:vortex-compact +3.0% +0.3% +2.6% +10.0% ➖ noise
31 datafusion:vortex-file-compressed +3.1% +0.3% +2.7% +10.0% ➖ noise
31 duckdb:duckdb -4.6% +0.3% -4.9% +10.9% ➖ noise
31 duckdb:vortex-compact +1.7% +0.3% +1.3% +14.3% ➖ noise
31 duckdb:vortex-file-compressed +5.6% +0.3% +5.3% +11.4% ➖ noise
32 datafusion:vortex-compact +3.2% +1.8% +1.4% +12.2% ➖ noise
32 datafusion:vortex-file-compressed +2.6% +1.8% +0.8% +14.9% ➖ noise
32 duckdb:duckdb -7.2% +1.8% -8.8% +15.6% ➖ noise
32 duckdb:vortex-compact +1.5% +1.8% -0.2% +13.1% ➖ noise
32 duckdb:vortex-file-compressed +3.8% +1.8% +2.0% +13.2% ➖ noise
33 datafusion:vortex-compact +0.2% +2.7% -2.5% +10.0% ➖ noise
33 datafusion:vortex-file-compressed -1.3% +2.7% -3.9% +10.0% ➖ noise
33 duckdb:duckdb -0.6% +2.7% -3.2% +14.6% ➖ noise
33 duckdb:vortex-compact +4.4% +2.7% +1.6% +10.0% ➖ noise
33 duckdb:vortex-file-compressed +3.4% +2.7% +0.6% +10.0% ➖ noise
34 datafusion:vortex-compact -0.3% +1.9% -2.2% +10.0% ➖ noise
34 datafusion:vortex-file-compressed +1.8% +1.9% -0.2% +10.0% ➖ noise
34 duckdb:duckdb -7.2% +1.9% -8.9% +11.1% ➖ noise
34 duckdb:vortex-compact -1.0% +1.9% -2.8% +10.0% ➖ noise
34 duckdb:vortex-file-compressed -1.3% +1.9% -3.2% +10.0% ➖ noise
35 datafusion:vortex-compact -4.9% +0.1% -5.1% +10.0% ➖ noise
35 datafusion:vortex-file-compressed +3.1% +0.1% +3.0% +10.0% ➖ noise
35 duckdb:duckdb -1.7% +0.1% -1.8% +17.3% ➖ noise
35 duckdb:vortex-compact +4.1% +0.1% +3.9% +10.0% ➖ noise
35 duckdb:vortex-file-compressed +5.3% +0.1% +5.1% +10.0% ➖ noise
36 datafusion:vortex-compact +4.1% +0.9% +3.1% +10.0% ➖ noise
36 datafusion:vortex-file-compressed -1.2% +0.9% -2.1% +10.0% ➖ noise
36 duckdb:duckdb -1.5% +0.9% -2.4% +10.0% ➖ noise
36 duckdb:vortex-compact +0.2% +0.9% -0.8% +10.0% ➖ noise
36 duckdb:vortex-file-compressed +6.2% +0.9% +5.2% +10.0% ➖ noise
37 datafusion:vortex-compact +2.6% -0.9% +3.5% +10.0% ➖ noise
37 datafusion:vortex-file-compressed +1.6% -0.9% +2.6% +10.4% ➖ noise
37 duckdb:duckdb -2.5% -0.9% -1.5% +17.9% ➖ noise
37 duckdb:vortex-compact +7.4% -0.9% +8.4% +12.4% ➖ noise
37 duckdb:vortex-file-compressed +7.9% -0.9% +8.9% +10.0% ➖ noise
38 datafusion:vortex-compact -0.2% -0.3% +0.1% +10.0% ➖ noise
38 datafusion:vortex-file-compressed +1.3% -0.3% +1.6% +10.0% ➖ noise
38 duckdb:duckdb -0.6% -0.3% -0.4% +12.7% ➖ noise
38 duckdb:vortex-compact -0.2% -0.3% +0.1% +20.2% ➖ noise
38 duckdb:vortex-file-compressed -1.5% -0.3% -1.2% +17.6% ➖ noise
39 datafusion:vortex-compact +2.7% +0.2% +2.5% +14.1% ➖ noise
39 datafusion:vortex-file-compressed +2.2% +0.2% +2.0% +12.6% ➖ noise
39 duckdb:duckdb +1.1% +0.2% +0.9% +22.9% ➖ noise
39 duckdb:vortex-compact +3.2% +0.2% +3.0% +15.2% ➖ noise
39 duckdb:vortex-file-compressed +8.9% +0.2% +8.7% +12.2% ➖ noise
40 datafusion:vortex-compact -0.3% +2.5% -2.7% +10.0% ➖ noise
40 datafusion:vortex-file-compressed -1.3% +2.5% -3.7% +10.0% ➖ noise
40 duckdb:duckdb -5.8% +2.5% -8.1% +10.0% ➖ noise
40 duckdb:vortex-compact +4.4% +2.5% +1.9% +10.7% ➖ noise
40 duckdb:vortex-file-compressed +4.6% +2.5% +2.0% +13.3% ➖ noise
41 datafusion:vortex-compact -6.4% +3.9% -9.9% +10.1% ✅ faster
41 datafusion:vortex-file-compressed -0.7% +3.9% -4.4% +10.0% ➖ noise
41 duckdb:duckdb -2.5% +3.9% -6.2% +10.4% ➖ noise
41 duckdb:vortex-compact +5.8% +3.9% +1.8% +10.0% ➖ noise
41 duckdb:vortex-file-compressed +4.2% +3.9% +0.3% +10.0% ➖ noise
42 datafusion:vortex-compact -2.7% -1.7% -1.0% +10.0% ➖ noise
42 datafusion:vortex-file-compressed -1.9% -1.7% -0.1% +10.0% ➖ noise
42 duckdb:duckdb -10.8% -1.7% -9.2% +13.8% ➖ noise
42 duckdb:vortex-compact -0.4% -1.7% +1.4% +10.0% ➖ noise
42 duckdb:vortex-file-compressed +0.7% -1.7% +2.5% +14.2% ➖ noise
43 datafusion:vortex-compact -1.1% -2.0% +0.9% +10.0% ➖ noise
43 datafusion:vortex-file-compressed +3.1% -2.0% +5.3% +10.0% ➖ noise
43 duckdb:duckdb +2.0% -2.0% +4.1% +10.5% ➖ noise
43 duckdb:vortex-compact -4.9% -2.0% -2.9% +18.5% ➖ noise
43 duckdb:vortex-file-compressed -9.3% -2.0% -7.4% +14.9% ➖ noise
44 datafusion:vortex-compact +0.8% -3.8% +4.7% +10.0% ➖ noise
44 datafusion:vortex-file-compressed +2.8% -3.8% +6.8% +12.9% ➖ noise
44 duckdb:duckdb -0.3% -3.8% +3.6% +12.7% ➖ noise
44 duckdb:vortex-compact +3.6% -3.8% +7.7% +10.0% ➖ noise
44 duckdb:vortex-file-compressed +4.9% -3.8% +9.1% +10.6% ➖ noise
45 datafusion:vortex-compact +3.1% +2.4% +0.6% +10.0% ➖ noise
45 datafusion:vortex-file-compressed +0.7% +2.4% -1.7% +10.0% ➖ noise
45 duckdb:duckdb +3.5% +2.4% +1.0% +10.0% ➖ noise
45 duckdb:vortex-compact +0.2% +2.4% -2.2% +11.6% ➖ noise
45 duckdb:vortex-file-compressed +3.9% +2.4% +1.4% +11.7% ➖ noise
46 datafusion:vortex-compact +0.9% +1.9% -0.9% +10.0% ➖ noise
46 datafusion:vortex-file-compressed +2.2% +1.9% +0.3% +10.1% ➖ noise
46 duckdb:duckdb -4.6% +1.9% -6.4% +10.0% ➖ noise
46 duckdb:vortex-compact +2.2% +1.9% +0.3% +10.0% ➖ noise
46 duckdb:vortex-file-compressed -1.1% +1.9% -2.9% +10.0% ➖ noise
47 datafusion:vortex-compact -2.6% -0.6% -2.1% +10.0% ➖ noise
47 datafusion:vortex-file-compressed -1.6% -0.6% -1.0% +10.0% ➖ noise
47 duckdb:duckdb +0.8% -0.6% +1.5% +10.0% ➖ noise
47 duckdb:vortex-compact +1.0% -0.6% +1.6% +10.0% ➖ noise
47 duckdb:vortex-file-compressed -0.5% -0.6% +0.1% +10.0% ➖ noise
48 datafusion:vortex-compact -3.7% +0.6% -4.3% +10.0% ➖ noise
48 datafusion:vortex-file-compressed -0.3% +0.6% -0.9% +11.5% ➖ noise
48 duckdb:duckdb +7.2% +0.6% +6.6% +10.0% ➖ noise
48 duckdb:vortex-compact +0.9% +0.6% +0.3% +10.9% ➖ noise
48 duckdb:vortex-file-compressed +8.6% +0.6% +7.9% +12.1% ➖ noise
49 datafusion:vortex-compact +1.9% +3.6% -1.7% +10.5% ➖ noise
49 datafusion:vortex-file-compressed -0.6% +3.6% -4.1% +10.0% ➖ noise
49 duckdb:duckdb +8.6% +3.6% +4.8% +25.6% ➖ noise
49 duckdb:vortex-compact +2.7% +3.6% -0.9% +11.6% ➖ noise
49 duckdb:vortex-file-compressed +5.0% +3.6% +1.4% +17.4% ➖ noise
50 datafusion:vortex-compact +3.1% +1.3% +1.8% +10.0% ➖ noise
50 datafusion:vortex-file-compressed +0.4% +1.3% -0.9% +10.0% ➖ noise
50 duckdb:duckdb -0.7% +1.3% -2.0% +12.0% ➖ noise
50 duckdb:vortex-compact -0.0% +1.3% -1.3% +10.0% ➖ noise
50 duckdb:vortex-file-compressed +1.9% +1.3% +0.6% +10.0% ➖ noise
51 datafusion:vortex-compact -1.1% -0.3% -0.8% +10.0% ➖ noise
51 datafusion:vortex-file-compressed -0.5% -0.3% -0.2% +10.0% ➖ noise
51 duckdb:duckdb +0.4% -0.3% +0.7% +10.0% ➖ noise
51 duckdb:vortex-compact +0.1% -0.3% +0.4% +15.1% ➖ noise
51 duckdb:vortex-file-compressed +1.1% -0.3% +1.4% +10.0% ➖ noise
52 datafusion:vortex-compact -3.6% +3.2% -6.5% +11.0% ➖ noise
52 datafusion:vortex-file-compressed -2.1% +3.2% -5.1% +14.8% ➖ noise
52 duckdb:duckdb -4.5% +3.2% -7.4% +17.9% ➖ noise
52 duckdb:vortex-compact -0.6% +3.2% -3.7% +11.1% ➖ noise
52 duckdb:vortex-file-compressed +0.2% +3.2% -2.9% +11.4% ➖ noise
53 datafusion:vortex-compact -2.3% +4.5% -6.5% +11.0% ➖ noise
53 datafusion:vortex-file-compressed -0.5% +4.5% -4.8% +10.0% ➖ noise
53 duckdb:duckdb +2.8% +4.5% -1.7% +10.5% ➖ noise
53 duckdb:vortex-compact +2.6% +4.5% -1.8% +16.9% ➖ noise
53 duckdb:vortex-file-compressed +6.8% +4.5% +2.2% +10.0% ➖ noise
54 datafusion:vortex-compact +0.9% -0.9% +1.8% +10.0% ➖ noise
54 datafusion:vortex-file-compressed +1.7% -0.9% +2.7% +10.0% ➖ noise
54 duckdb:duckdb +0.6% -0.9% +1.5% +10.0% ➖ noise
54 duckdb:vortex-compact +1.7% -0.9% +2.7% +16.0% ➖ noise
54 duckdb:vortex-file-compressed +2.8% -0.9% +3.7% +10.0% ➖ noise
55 datafusion:vortex-compact +2.5% +0.5% +2.0% +10.8% ➖ noise
55 datafusion:vortex-file-compressed -0.9% +0.5% -1.5% +10.0% ➖ noise
55 duckdb:duckdb -6.6% +0.5% -7.1% +11.0% ➖ noise
55 duckdb:vortex-compact +3.8% +0.5% +3.2% +10.0% ➖ noise
55 duckdb:vortex-file-compressed +8.6% +0.5% +8.1% +20.4% ➖ noise
56 datafusion:vortex-compact +3.1% +0.0% +3.1% +10.0% ➖ noise
56 datafusion:vortex-file-compressed -1.8% +0.0% -1.8% +10.0% ➖ noise
56 duckdb:duckdb +3.0% +0.0% +3.0% +10.0% ➖ noise
56 duckdb:vortex-compact +2.2% +0.0% +2.1% +10.0% ➖ noise
56 duckdb:vortex-file-compressed +0.7% +0.0% +0.7% +19.1% ➖ noise
57 datafusion:vortex-compact -7.1% +1.0% -8.0% +10.0% ➖ noise
57 datafusion:vortex-file-compressed +2.7% +1.0% +1.6% +10.0% ➖ noise
57 duckdb:duckdb -0.5% +1.0% -1.5% +10.0% ➖ noise
57 duckdb:vortex-compact -0.2% +1.0% -1.2% +11.2% ➖ noise
57 duckdb:vortex-file-compressed -1.4% +1.0% -2.4% +10.0% ➖ noise
58 datafusion:vortex-compact -4.7% +0.3% -5.0% +10.0% ➖ noise
58 datafusion:vortex-file-compressed +1.8% +0.3% +1.5% +10.0% ➖ noise
58 duckdb:duckdb -1.2% +0.3% -1.6% +19.3% ➖ noise
58 duckdb:vortex-compact +8.4% +0.3% +8.0% +16.9% ➖ noise
58 duckdb:vortex-file-compressed -0.1% +0.3% -0.4% +10.0% ➖ noise
59 datafusion:vortex-compact -1.5% +1.1% -2.6% +10.0% ➖ noise
59 datafusion:vortex-file-compressed +0.2% +1.1% -0.9% +10.0% ➖ noise
59 duckdb:duckdb +0.2% +1.1% -0.9% +10.0% ➖ noise
59 duckdb:vortex-compact -4.3% +1.1% -5.3% +16.1% ➖ noise
59 duckdb:vortex-file-compressed -1.7% +1.1% -2.8% +10.0% ➖ noise
60 datafusion:vortex-compact -0.7% +2.3% -2.9% +10.0% ➖ noise
60 datafusion:vortex-file-compressed +1.8% +2.3% -0.5% +10.0% ➖ noise
60 duckdb:duckdb -5.3% +2.3% -7.4% +10.0% ➖ noise
60 duckdb:vortex-compact +2.0% +2.3% -0.3% +11.8% ➖ noise
60 duckdb:vortex-file-compressed -2.6% +2.3% -4.9% +10.0% ➖ noise
61 datafusion:vortex-compact +0.5% -0.4% +0.9% +10.0% ➖ noise
61 datafusion:vortex-file-compressed -1.4% -0.4% -1.0% +10.0% ➖ noise
61 duckdb:duckdb -2.4% -0.4% -2.0% +10.0% ➖ noise
61 duckdb:vortex-compact +10.4% -0.4% +10.8% +10.0% 🚨 regression
61 duckdb:vortex-file-compressed +3.0% -0.4% +3.4% +14.5% ➖ noise
62 datafusion:vortex-compact +12.5% -4.1% +17.3% +20.3% ➖ noise
62 datafusion:vortex-file-compressed +10.8% -4.1% +15.6% +24.7% ➖ noise
62 duckdb:duckdb -1.9% -4.1% +2.3% +15.0% ➖ noise
62 duckdb:vortex-compact +8.2% -4.1% +12.8% +17.8% ➖ noise
62 duckdb:vortex-file-compressed +15.4% -4.1% +20.3% +19.0% 🚨 regression
63 datafusion:vortex-compact +0.1% +3.1% -2.9% +10.0% ➖ noise
63 datafusion:vortex-file-compressed +2.7% +3.1% -0.4% +10.0% ➖ noise
63 duckdb:duckdb -3.4% +3.1% -6.3% +10.0% ➖ noise
63 duckdb:vortex-compact +8.3% +3.1% +5.0% +12.3% ➖ noise
63 duckdb:vortex-file-compressed +7.1% +3.1% +3.9% +11.5% ➖ noise
64 datafusion:vortex-compact +0.9% +0.1% +0.8% +10.0% ➖ noise
64 datafusion:vortex-file-compressed -0.1% +0.1% -0.2% +10.0% ➖ noise
64 duckdb:duckdb -2.9% +0.1% -3.0% +10.0% ➖ noise
64 duckdb:vortex-compact -3.0% +0.1% -3.1% +10.0% ➖ noise
64 duckdb:vortex-file-compressed +1.4% +0.1% +1.3% +10.0% ➖ noise
65 datafusion:vortex-compact +1.8% +3.6% -1.6% +10.7% ➖ noise
65 datafusion:vortex-file-compressed -1.0% +3.6% -4.4% +12.3% ➖ noise
65 duckdb:duckdb -9.4% +3.6% -12.5% +16.5% ➖ noise
65 duckdb:vortex-compact +4.8% +3.6% +1.2% +12.3% ➖ noise
65 duckdb:vortex-file-compressed +1.4% +3.6% -2.1% +36.8% ➖ noise
66 datafusion:vortex-compact -0.3% -4.0% +3.9% +10.0% ➖ noise
66 datafusion:vortex-file-compressed +0.7% -4.0% +4.9% +12.9% ➖ noise
66 duckdb:duckdb +5.1% -4.0% +9.5% +13.1% ➖ noise
66 duckdb:vortex-compact +0.1% -4.0% +4.4% +10.9% ➖ noise
66 duckdb:vortex-file-compressed +5.4% -4.0% +9.8% +14.1% ➖ noise
67 datafusion:vortex-compact -2.4% -0.0% -2.4% +12.1% ➖ noise
67 datafusion:vortex-file-compressed -9.2% -0.0% -9.2% +10.0% ✅ faster
67 duckdb:duckdb +0.9% -0.0% +0.9% +10.0% ➖ noise
67 duckdb:vortex-compact +0.2% -0.0% +0.3% +10.0% ➖ noise
67 duckdb:vortex-file-compressed +2.8% -0.0% +2.8% +10.0% ➖ noise
68 datafusion:vortex-compact +2.0% +1.4% +0.6% +10.0% ➖ noise
68 datafusion:vortex-file-compressed -6.9% +1.4% -8.2% +19.6% ➖ noise
68 duckdb:duckdb -0.1% +1.4% -1.5% +10.0% ➖ noise
68 duckdb:vortex-compact -0.3% +1.4% -1.7% +10.0% ➖ noise
68 duckdb:vortex-file-compressed +0.5% +1.4% -0.9% +11.5% ➖ noise
69 datafusion:vortex-compact +0.5% +0.3% +0.2% +14.0% ➖ noise
69 datafusion:vortex-file-compressed -2.0% +0.3% -2.3% +10.0% ➖ noise
69 duckdb:duckdb -5.5% +0.3% -5.8% +10.0% ➖ noise
69 duckdb:vortex-compact +0.5% +0.3% +0.2% +10.0% ➖ noise
69 duckdb:vortex-file-compressed +4.0% +0.3% +3.7% +10.0% ➖ noise
70 datafusion:vortex-compact +0.5% +0.4% +0.1% +10.0% ➖ noise
70 datafusion:vortex-file-compressed -5.0% +0.4% -5.4% +10.0% ➖ noise
70 duckdb:duckdb +1.0% +0.4% +0.6% +12.7% ➖ noise
70 duckdb:vortex-compact +1.1% +0.4% +0.7% +10.7% ➖ noise
70 duckdb:vortex-file-compressed +5.0% +0.4% +4.7% +16.5% ➖ noise
71 datafusion:vortex-compact -0.3% -0.7% +0.4% +10.0% ➖ noise
71 datafusion:vortex-file-compressed -3.2% -0.7% -2.6% +10.0% ➖ noise
71 duckdb:duckdb +1.3% -0.7% +2.0% +13.8% ➖ noise
71 duckdb:vortex-compact +2.2% -0.7% +2.9% +15.2% ➖ noise
71 duckdb:vortex-file-compressed +8.9% -0.7% +9.7% +10.3% ➖ noise
72 datafusion:vortex-compact -0.2% -1.5% +1.3% +10.0% ➖ noise
72 datafusion:vortex-file-compressed -14.4% -1.5% -13.2% +10.3% ✅ faster
72 duckdb:duckdb +3.1% -1.5% +4.7% +10.0% ➖ noise
72 duckdb:vortex-compact -1.4% -1.5% +0.0% +10.0% ➖ noise
72 duckdb:vortex-file-compressed +1.8% -1.5% +3.3% +10.0% ➖ noise
73 datafusion:vortex-compact -0.2% +1.7% -1.9% +10.0% ➖ noise
73 datafusion:vortex-file-compressed +2.1% +1.7% +0.4% +10.0% ➖ noise
73 duckdb:duckdb +5.6% +1.7% +3.9% +13.3% ➖ noise
73 duckdb:vortex-compact -0.0% +1.7% -1.6% +10.0% ➖ noise
73 duckdb:vortex-file-compressed +2.3% +1.7% +0.6% +25.3% ➖ noise
74 datafusion:vortex-compact -2.1% +2.6% -4.6% +10.0% ➖ noise
74 datafusion:vortex-file-compressed -6.6% +2.6% -9.0% +13.1% ➖ noise
74 duckdb:duckdb +2.6% +2.6% +0.0% +10.0% ➖ noise
74 duckdb:vortex-compact -8.4% +2.6% -10.7% +18.3% ➖ noise
74 duckdb:vortex-file-compressed -24.9% +2.6% -26.8% +21.0% ✅ faster
75 datafusion:vortex-compact -0.5% -1.2% +0.7% +10.0% ➖ noise
75 datafusion:vortex-file-compressed +0.6% -1.2% +1.8% +10.0% ➖ noise
75 duckdb:duckdb +1.8% -1.2% +3.0% +10.0% ➖ noise
75 duckdb:vortex-compact -4.7% -1.2% -3.6% +11.6% ➖ noise
75 duckdb:vortex-file-compressed +7.1% -1.2% +8.4% +15.4% ➖ noise
76 datafusion:vortex-compact +4.1% -1.1% +5.3% +13.3% ➖ noise
76 datafusion:vortex-file-compressed +0.5% -1.1% +1.6% +41.5% ➖ noise
76 duckdb:duckdb -5.0% -1.1% -3.9% +16.4% ➖ noise
76 duckdb:vortex-compact -1.2% -1.1% -0.1% +12.0% ➖ noise
76 duckdb:vortex-file-compressed +0.2% -1.1% +1.4% +11.8% ➖ noise
77 datafusion:vortex-compact -1.0% +4.1% -4.9% +10.0% ➖ noise
77 datafusion:vortex-file-compressed -1.2% +4.1% -5.1% +10.0% ➖ noise
77 duckdb:duckdb -3.3% +4.1% -7.2% +11.9% ➖ noise
77 duckdb:vortex-compact -3.2% +4.1% -7.1% +14.3% ➖ noise
77 duckdb:vortex-file-compressed +3.8% +4.1% -0.3% +12.3% ➖ noise
78 datafusion:vortex-compact -2.0% +1.7% -3.6% +10.0% ➖ noise
78 datafusion:vortex-file-compressed -2.2% +1.7% -3.8% +10.0% ➖ noise
78 duckdb:duckdb -0.5% +1.7% -2.1% +10.0% ➖ noise
78 duckdb:vortex-compact +3.1% +1.7% +1.4% +10.0% ➖ noise
78 duckdb:vortex-file-compressed +1.3% +1.7% -0.3% +10.0% ➖ noise
79 datafusion:vortex-compact +3.0% +2.3% +0.6% +14.1% ➖ noise
79 datafusion:vortex-file-compressed -2.9% +2.3% -5.0% +19.7% ➖ noise
79 duckdb:duckdb -1.9% +2.3% -4.1% +11.0% ➖ noise
79 duckdb:vortex-compact -3.5% +2.3% -5.7% +17.6% ➖ noise
79 duckdb:vortex-file-compressed -1.5% +2.3% -3.7% +19.3% ➖ noise
80 datafusion:vortex-compact +1.9% +2.3% -0.4% +10.0% ➖ noise
80 datafusion:vortex-file-compressed -5.4% +2.3% -7.4% +10.0% ➖ noise
80 duckdb:duckdb -5.6% +2.3% -7.7% +10.4% ➖ noise
80 duckdb:vortex-compact -5.5% +2.3% -7.6% +10.0% ➖ noise
80 duckdb:vortex-file-compressed -10.0% +2.3% -12.0% +10.0% ✅ faster
81 datafusion:vortex-compact +2.0% -0.4% +2.5% +17.8% ➖ noise
81 datafusion:vortex-file-compressed -1.4% -0.4% -0.9% +10.0% ➖ noise
81 duckdb:duckdb -0.7% -0.4% -0.3% +10.0% ➖ noise
81 duckdb:vortex-compact -8.9% -0.4% -8.5% +12.9% ➖ noise
81 duckdb:vortex-file-compressed +5.2% -0.4% +5.6% +10.0% ➖ noise
82 datafusion:vortex-compact -0.2% -2.6% +2.5% +10.0% ➖ noise
82 datafusion:vortex-file-compressed -0.0% -2.6% +2.6% +10.0% ➖ noise
82 duckdb:duckdb -5.9% -2.6% -3.4% +12.9% ➖ noise
82 duckdb:vortex-compact -2.3% -2.6% +0.2% +11.6% ➖ noise
82 duckdb:vortex-file-compressed -0.9% -2.6% +1.8% +10.0% ➖ noise
83 datafusion:vortex-compact +2.9% +7.5% -4.3% +10.0% ➖ noise
83 datafusion:vortex-file-compressed -1.4% +7.5% -8.2% +10.6% ➖ noise
83 duckdb:duckdb +0.6% +7.5% -6.4% +31.5% ➖ noise
83 duckdb:vortex-compact +0.0% +7.5% -7.0% +16.7% ➖ noise
83 duckdb:vortex-file-compressed +8.4% +7.5% +0.9% +13.6% ➖ noise
84 datafusion:vortex-compact +2.7% +1.4% +1.3% +12.1% ➖ noise
84 datafusion:vortex-file-compressed +1.6% +1.4% +0.2% +28.8% ➖ noise
84 duckdb:duckdb -3.3% +1.4% -4.6% +11.3% ➖ noise
84 duckdb:vortex-compact -2.1% +1.4% -3.4% +10.0% ➖ noise
84 duckdb:vortex-file-compressed -0.7% +1.4% -2.1% +10.0% ➖ noise
85 datafusion:vortex-compact +0.2% +0.8% -0.6% +10.0% ➖ noise
85 datafusion:vortex-file-compressed -1.9% +0.8% -2.7% +10.0% ➖ noise
85 duckdb:duckdb -3.3% +0.8% -4.0% +12.1% ➖ noise
85 duckdb:vortex-compact -5.0% +0.8% -5.7% +10.0% ➖ noise
85 duckdb:vortex-file-compressed -0.6% +0.8% -1.3% +10.0% ➖ noise
86 datafusion:vortex-compact +18.0% +2.0% +15.6% +16.6% ➖ noise
86 datafusion:vortex-file-compressed +0.8% +2.0% -1.2% +14.6% ➖ noise
86 duckdb:duckdb +1.0% +2.0% -1.0% +19.6% ➖ noise
86 duckdb:vortex-compact +2.8% +2.0% +0.8% +15.1% ➖ noise
86 duckdb:vortex-file-compressed +14.1% +2.0% +11.9% +17.0% ➖ noise
87 datafusion:vortex-compact +0.9% +2.9% -1.9% +10.0% ➖ noise
87 datafusion:vortex-file-compressed +0.7% +2.9% -2.1% +10.0% ➖ noise
87 duckdb:duckdb +2.1% +2.9% -0.7% +10.0% ➖ noise
87 duckdb:vortex-compact -0.8% +2.9% -3.6% +10.0% ➖ noise
87 duckdb:vortex-file-compressed +1.3% +2.9% -1.5% +12.2% ➖ noise
88 datafusion:vortex-compact +0.9% +0.5% +0.4% +10.0% ➖ noise
88 datafusion:vortex-file-compressed -3.5% +0.5% -4.0% +10.0% ➖ noise
88 duckdb:duckdb +0.5% +0.5% +0.1% +10.0% ➖ noise
88 duckdb:vortex-compact +0.7% +0.5% +0.3% +10.0% ➖ noise
88 duckdb:vortex-file-compressed +1.5% +0.5% +1.1% +10.0% ➖ noise
89 datafusion:vortex-compact -2.9% +0.5% -3.4% +13.6% ➖ noise
89 datafusion:vortex-file-compressed -0.1% +0.5% -0.6% +10.0% ➖ noise
89 duckdb:duckdb -1.8% +0.5% -2.3% +10.5% ➖ noise
89 duckdb:vortex-compact +2.7% +0.5% +2.2% +13.3% ➖ noise
89 duckdb:vortex-file-compressed +7.1% +0.5% +6.6% +10.0% ➖ noise
90 datafusion:vortex-compact +1.2% +1.9% -0.7% +14.0% ➖ noise
90 datafusion:vortex-file-compressed +0.2% +1.9% -1.7% +10.0% ➖ noise
90 duckdb:duckdb -2.9% +1.9% -4.7% +10.5% ➖ noise
90 duckdb:vortex-compact -0.8% +1.9% -2.6% +13.4% ➖ noise
90 duckdb:vortex-file-compressed +2.4% +1.9% +0.5% +19.1% ➖ noise
91 datafusion:vortex-compact +1.8% -0.8% +2.7% +10.0% ➖ noise
91 datafusion:vortex-file-compressed +1.2% -0.8% +2.0% +10.0% ➖ noise
91 duckdb:duckdb -7.8% -0.8% -7.1% +10.0% ➖ noise
91 duckdb:vortex-compact +5.0% -0.8% +5.9% +10.0% ➖ noise
91 duckdb:vortex-file-compressed +8.2% -0.8% +9.1% +10.0% ➖ noise
92 datafusion:vortex-compact +7.5% -3.6% +11.4% +19.0% ➖ noise
92 datafusion:vortex-file-compressed +5.5% -3.6% +9.4% +12.0% ➖ noise
92 duckdb:duckdb +0.0% -3.6% +3.7% +15.0% ➖ noise
92 duckdb:vortex-compact -17.1% -3.6% -14.1% +21.3% ➖ noise
92 duckdb:vortex-file-compressed -11.5% -3.6% -8.3% +21.3% ➖ noise
93 datafusion:vortex-compact +1.5% +4.3% -2.6% +10.1% ➖ noise
93 datafusion:vortex-file-compressed +0.2% +4.3% -3.9% +11.2% ➖ noise
93 duckdb:duckdb -10.6% +4.3% -14.2% +12.1% ✅ faster
93 duckdb:vortex-compact -0.2% +4.3% -4.2% +13.7% ➖ noise
93 duckdb:vortex-file-compressed -3.9% +4.3% -7.8% +15.3% ➖ noise
94 datafusion:vortex-compact -3.2% +4.4% -7.3% +14.4% ➖ noise
94 datafusion:vortex-file-compressed +6.2% +4.4% +1.7% +10.3% ➖ noise
94 duckdb:duckdb +2.1% +4.4% -2.2% +13.9% ➖ noise
94 duckdb:vortex-compact +3.3% +4.4% -1.0% +12.6% ➖ noise
94 duckdb:vortex-file-compressed +0.2% +4.4% -4.0% +13.4% ➖ noise
95 datafusion:vortex-compact +0.1% +6.9% -6.3% +11.2% ➖ noise
95 datafusion:vortex-file-compressed -2.2% +6.9% -8.5% +11.5% ➖ noise
95 duckdb:duckdb -0.1% +6.9% -6.6% +18.3% ➖ noise
95 duckdb:vortex-compact -1.6% +6.9% -8.0% +15.9% ➖ noise
95 duckdb:vortex-file-compressed -4.5% +6.9% -10.6% +21.6% ➖ noise
96 datafusion:vortex-compact +1.2% +6.5% -5.0% +10.0% ➖ noise
96 datafusion:vortex-file-compressed -6.3% +6.5% -12.0% +10.6% ✅ faster
96 duckdb:duckdb -2.3% +6.5% -8.2% +11.1% ➖ noise
96 duckdb:vortex-compact -0.2% +6.5% -6.3% +12.2% ➖ noise
96 duckdb:vortex-file-compressed +1.4% +6.5% -4.8% +11.9% ➖ noise
97 datafusion:vortex-compact -0.9% +2.6% -3.4% +10.0% ➖ noise
97 datafusion:vortex-file-compressed -4.1% +2.6% -6.6% +10.0% ➖ noise
97 duckdb:duckdb +3.0% +2.6% +0.3% +14.5% ➖ noise
97 duckdb:vortex-compact -2.1% +2.6% -4.6% +13.4% ➖ noise
97 duckdb:vortex-file-compressed +3.1% +2.6% +0.5% +10.0% ➖ noise
98 datafusion:vortex-compact -2.4% +0.4% -2.8% +10.0% ➖ noise
98 datafusion:vortex-file-compressed +0.3% +0.4% -0.0% +10.7% ➖ noise
98 duckdb:duckdb +1.3% +0.4% +1.0% +16.2% ➖ noise
98 duckdb:vortex-compact +6.3% +0.4% +6.0% +11.8% ➖ noise
98 duckdb:vortex-file-compressed +0.3% +0.4% -0.1% +10.8% ➖ noise
99 datafusion:vortex-compact +4.8% -1.2% +6.0% +25.2% ➖ noise
99 datafusion:vortex-file-compressed -0.8% -1.2% +0.4% +16.2% ➖ noise
99 duckdb:duckdb -2.7% -1.2% -1.6% +12.1% ➖ noise
99 duckdb:vortex-compact +0.7% -1.2% +1.9% +21.6% ➖ noise
99 duckdb:vortex-file-compressed +26.1% -1.2% +27.6% +27.1% 🚨 regression

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 6, 2026

File Sizes: TPC-DS SF=1 on NVME

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 6, 2026

Benchmarks: FineWeb S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +9.1%
Vortex (geomean): 1.103x ➖
Parquet (geomean): 1.011x ➖
Shifts: Parquet (control) +1.1% · Median polish +6.7%


datafusion / vortex-file-compressed (1.304x ❌, 0↑ 3↓)
name PR a1d2e1e (ns) base eda8c2c (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 38146260 39770585 0.96
fineweb_q01/datafusion:vortex-file-compressed 551955657 576462037 0.96
fineweb_q02/datafusion:vortex-file-compressed 🚨 635527291 487461392 1.30
fineweb_q03/datafusion:vortex-file-compressed 1586992371 1397919483 1.14
fineweb_q04/datafusion:vortex-file-compressed 1646942072 1372760924 1.20
fineweb_q05/datafusion:vortex-file-compressed 1838117458 1416250750 1.30
fineweb_q06/datafusion:vortex-file-compressed 🚨 2635251832 1535539363 1.72
fineweb_q07/datafusion:vortex-file-compressed 1766065685 1403939983 1.26
fineweb_q08/datafusion:vortex-file-compressed 🚨 1193015183 501067459 2.38
datafusion / vortex-compact (1.069x ➖, 0↑ 0↓)
name PR a1d2e1e (ns) base eda8c2c (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 36022996 35479616 1.02
fineweb_q01/datafusion:vortex-compact 624628024 517095390 1.21
fineweb_q02/datafusion:vortex-compact 577327099 513413174 1.12
fineweb_q03/datafusion:vortex-compact 1535397143 1497333743 1.03
fineweb_q04/datafusion:vortex-compact 1858547970 1722511149 1.08
fineweb_q05/datafusion:vortex-compact 1498651219 1430143086 1.05
fineweb_q06/datafusion:vortex-compact 1482838253 1389300519 1.07
fineweb_q07/datafusion:vortex-compact 1221185992 1134328004 1.08
fineweb_q08/datafusion:vortex-compact 396323153 398432520 0.99
datafusion / parquet (1.000x ➖, 1↑ 0↓)
name PR a1d2e1e (ns) base eda8c2c (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 1456202600 1652969514 0.88
fineweb_q01/datafusion:parquet 2129045862 1841362594 1.16
fineweb_q02/datafusion:parquet 2012111943 1767989932 1.14
fineweb_q03/datafusion:parquet 1924917453 1779915853 1.08
fineweb_q04/datafusion:parquet 2213809881 1991414785 1.11
fineweb_q05/datafusion:parquet 2131264283 2258548474 0.94
fineweb_q06/datafusion:parquet 2116396123 1950534654 1.09
fineweb_q07/datafusion:parquet 🚀 1829605675 2673025061 0.68
fineweb_q08/datafusion:parquet 2021029570 1974993484 1.02
duckdb / vortex-file-compressed (1.005x ➖, 0↑ 0↓)
name PR a1d2e1e (ns) base eda8c2c (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 87969122 84656123 1.04
fineweb_q01/duckdb:vortex-file-compressed 535493826 587505540 0.91
fineweb_q02/duckdb:vortex-file-compressed 444677220 611856046 0.73
fineweb_q03/duckdb:vortex-file-compressed 1688814954 1451420057 1.16
fineweb_q04/duckdb:vortex-file-compressed 1746116623 1526194833 1.14
fineweb_q05/duckdb:vortex-file-compressed 1636311140 1445895730 1.13
fineweb_q06/duckdb:vortex-file-compressed 1686857602 1646146636 1.02
fineweb_q07/duckdb:vortex-file-compressed 1527338440 1414215592 1.08
fineweb_q08/duckdb:vortex-file-compressed 672599153 736725821 0.91
duckdb / vortex-compact (1.058x ➖, 0↑ 0↓)
name PR a1d2e1e (ns) base eda8c2c (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 78775727 85895370 0.92
fineweb_q01/duckdb:vortex-compact 594932272 554288184 1.07
fineweb_q02/duckdb:vortex-compact 582103198 570980971 1.02
fineweb_q03/duckdb:vortex-compact 1757960456 1580337661 1.11
fineweb_q04/duckdb:vortex-compact 1878957001 1748557591 1.07
fineweb_q05/duckdb:vortex-compact 1720515349 1449960215 1.19
fineweb_q06/duckdb:vortex-compact 1595482059 1408594959 1.13
fineweb_q07/duckdb:vortex-compact 1384418307 1340544358 1.03
fineweb_q08/duckdb:vortex-compact 494632701 497500808 0.99
duckdb / parquet (1.023x ➖, 0↑ 0↓)
name PR a1d2e1e (ns) base eda8c2c (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 1158327170 1178489125 0.98
fineweb_q01/duckdb:parquet 1369316067 1434803290 0.95
fineweb_q02/duckdb:parquet 1388045681 1353057758 1.03
fineweb_q03/duckdb:parquet 4016432113 3946915358 1.02
fineweb_q04/duckdb:parquet 1980899596 1871136269 1.06
fineweb_q05/duckdb:parquet 2290173900 2088846129 1.10
fineweb_q06/duckdb:parquet 4441918361 4525604815 0.98
fineweb_q07/duckdb:parquet 2820851830 2578457445 1.09
fineweb_q08/duckdb:parquet 1126401452 1122949480 1.00
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-compact +1.5% -6.9% +9.1% +190.0% ➖ noise
0 datafusion:vortex-file-compressed -4.1% -6.9% +3.1% +135.7% ➖ noise
0 duckdb:vortex-compact -8.3% -6.9% -1.4% +94.9% ➖ noise
0 duckdb:vortex-file-compressed +3.9% -6.9% +11.7% +48.9% ➖ noise
1 datafusion:vortex-compact +20.8% +5.0% +15.0% +74.0% ➖ noise
1 datafusion:vortex-file-compressed -4.3% +5.0% -8.9% +78.5% ➖ noise
1 duckdb:vortex-compact +7.3% +5.0% +2.2% +30.0% ➖ noise
1 duckdb:vortex-file-compressed -8.9% +5.0% -13.2% +45.7% ➖ noise
2 datafusion:vortex-compact +12.4% +8.1% +4.1% +38.4% ➖ noise
2 datafusion:vortex-file-compressed +30.4% +8.1% +20.7% +44.2% ➖ noise
2 duckdb:vortex-compact +1.9% +8.1% -5.6% +30.0% ➖ noise
2 duckdb:vortex-file-compressed -27.3% +8.1% -32.7% +59.5% ➖ noise
3 datafusion:vortex-compact +2.5% +4.9% -2.3% +30.0% ➖ noise
3 datafusion:vortex-file-compressed +13.5% +4.9% +8.2% +30.0% ➖ noise
3 duckdb:vortex-compact +11.2% +4.9% +6.0% +30.0% ➖ noise
3 duckdb:vortex-file-compressed +16.4% +4.9% +10.9% +30.0% ➖ noise
4 datafusion:vortex-compact +7.9% +8.5% -0.5% +30.0% ➖ noise
4 datafusion:vortex-file-compressed +20.0% +8.5% +10.6% +30.0% ➖ noise
4 duckdb:vortex-compact +7.5% +8.5% -0.9% +30.0% ➖ noise
4 duckdb:vortex-file-compressed +14.4% +8.5% +5.5% +30.0% ➖ noise
5 datafusion:vortex-compact +4.8% +1.7% +3.0% +30.0% ➖ noise
5 datafusion:vortex-file-compressed +29.8% +1.7% +27.6% +30.0% ➖ noise
5 duckdb:vortex-compact +18.7% +1.7% +16.7% +30.0% ➖ noise
5 duckdb:vortex-file-compressed +13.2% +1.7% +11.3% +30.0% ➖ noise
6 datafusion:vortex-compact +6.7% +3.2% +3.4% +30.0% ➖ noise
6 datafusion:vortex-file-compressed +71.6% +3.2% +66.3% +48.3% 🚨 regression
6 duckdb:vortex-compact +13.3% +3.2% +9.8% +30.0% ➖ noise
6 duckdb:vortex-file-compressed +2.5% +3.2% -0.7% +30.0% ➖ noise
7 datafusion:vortex-compact +7.7% -13.5% +24.4% +30.0% ➖ noise
7 datafusion:vortex-file-compressed +25.8% -13.5% +45.4% +37.9% 🚨 regression
7 duckdb:vortex-compact +3.3% -13.5% +19.3% +30.0% ➖ noise
7 duckdb:vortex-file-compressed +8.0% -13.5% +24.8% +30.0% ➖ noise
8 datafusion:vortex-compact -0.5% +1.3% -1.8% +30.0% ➖ noise
8 datafusion:vortex-file-compressed +138.1% +1.3% +135.0% +34.2% 🚨 regression
8 duckdb:vortex-compact -0.6% +1.3% -1.9% +38.1% ➖ noise
8 duckdb:vortex-file-compressed -8.7% +1.3% -9.9% +62.8% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 6, 2026

Benchmarks: Statistical and Population Genetics

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.5%
Vortex (geomean): 0.990x ➖
Parquet (geomean): 0.995x ➖
Shifts: Parquet (control) -0.5% · Median polish -0.9%


duckdb / vortex-file-compressed (1.005x ➖, 0↑ 1↓)
name PR a1d2e1e (ns) base eda8c2c (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-file-compressed 11818214 12155742 0.97
statpopgen_q01/duckdb:vortex-file-compressed 🚨 26656595 20585092 1.29
statpopgen_q02/duckdb:vortex-file-compressed 1394495663 1382684632 1.01
statpopgen_q03/duckdb:vortex-file-compressed 3170799181 3183435289 1.00
statpopgen_q04/duckdb:vortex-file-compressed 3170088567 3174305647 1.00
statpopgen_q05/duckdb:vortex-file-compressed 1449066875 1477776320 0.98
statpopgen_q06/duckdb:vortex-file-compressed 2143082032 2163023512 0.99
statpopgen_q07/duckdb:vortex-file-compressed 206280647 222711028 0.93
statpopgen_q08/duckdb:vortex-file-compressed 251183346 255355837 0.98
statpopgen_q09/duckdb:vortex-file-compressed 2868948527 2975226827 0.96
statpopgen_q10/duckdb:vortex-file-compressed 4725138317 4811791996 0.98
duckdb / vortex-compact (0.975x ➖, 0↑ 0↓)
name PR a1d2e1e (ns) base eda8c2c (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-compact 11296609 11882043 0.95
statpopgen_q01/duckdb:vortex-compact 167807328 170691405 0.98
statpopgen_q02/duckdb:vortex-compact 1830500652 1854079475 0.99
statpopgen_q03/duckdb:vortex-compact 3559932925 3570080758 1.00
statpopgen_q04/duckdb:vortex-compact 3576314631 3759199222 0.95
statpopgen_q05/duckdb:vortex-compact 1843325979 1999783659 0.92
statpopgen_q06/duckdb:vortex-compact 2683180828 2770316413 0.97
statpopgen_q07/duckdb:vortex-compact 891672379 905914802 0.98
statpopgen_q08/duckdb:vortex-compact 928031840 939857914 0.99
statpopgen_q09/duckdb:vortex-compact 3347446123 3350946604 1.00
statpopgen_q10/duckdb:vortex-compact 5410304098 5449429268 0.99
duckdb / parquet (0.995x ➖, 0↑ 0↓)
name PR a1d2e1e (ns) base eda8c2c (ns) ratio (PR/base)
statpopgen_q00/duckdb:parquet 325437803 331856786 0.98
statpopgen_q01/duckdb:parquet 414271668 415391731 1.00
statpopgen_q02/duckdb:parquet 1005840537 1013110197 0.99
statpopgen_q03/duckdb:parquet 1513421824 1505040485 1.01
statpopgen_q04/duckdb:parquet 1503964647 1510645216 1.00
statpopgen_q05/duckdb:parquet 1004953166 1032059514 0.97
statpopgen_q06/duckdb:parquet 1498120902 1508123916 0.99
statpopgen_q07/duckdb:parquet 1336829625 1309195977 1.02
statpopgen_q08/duckdb:parquet 1358676575 1316224538 1.03
statpopgen_q09/duckdb:parquet 1369424008 1397885578 0.98
statpopgen_q10/duckdb:parquet 2639563649 2721057817 0.97
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 duckdb:vortex-compact -4.9% -1.9% -3.1% +10.0% ➖ noise
0 duckdb:vortex-file-compressed -2.8% -1.9% -0.9% +12.5% ➖ noise
1 duckdb:vortex-compact -1.7% -0.3% -1.4% +10.0% ➖ noise
1 duckdb:vortex-file-compressed +29.5% -0.3% +29.8% +196.8% ➖ noise
2 duckdb:vortex-compact -1.3% -0.7% -0.6% +10.0% ➖ noise
2 duckdb:vortex-file-compressed +0.9% -0.7% +1.6% +10.0% ➖ noise
3 duckdb:vortex-compact -0.3% +0.6% -0.8% +10.0% ➖ noise
3 duckdb:vortex-file-compressed -0.4% +0.6% -0.9% +10.0% ➖ noise
4 duckdb:vortex-compact -4.9% -0.4% -4.4% +10.0% ➖ noise
4 duckdb:vortex-file-compressed -0.1% -0.4% +0.3% +10.0% ➖ noise
5 duckdb:vortex-compact -7.8% -2.6% -5.3% +10.0% ➖ noise
5 duckdb:vortex-file-compressed -1.9% -2.6% +0.7% +10.0% ➖ noise
6 duckdb:vortex-compact -3.1% -0.7% -2.5% +10.0% ➖ noise
6 duckdb:vortex-file-compressed -0.9% -0.7% -0.3% +10.0% ➖ noise
7 duckdb:vortex-compact -1.6% +2.1% -3.6% +10.0% ➖ noise
7 duckdb:vortex-file-compressed -7.4% +2.1% -9.3% +10.0% ✅ faster
8 duckdb:vortex-compact -1.3% +3.2% -4.3% +10.0% ➖ noise
8 duckdb:vortex-file-compressed -1.6% +3.2% -4.7% +10.0% ➖ noise
9 duckdb:vortex-compact -0.1% -2.0% +2.0% +10.0% ➖ noise
9 duckdb:vortex-file-compressed -3.6% -2.0% -1.6% +10.0% ➖ noise
10 duckdb:vortex-compact -0.7% -3.0% +2.3% +10.0% ➖ noise
10 duckdb:vortex-file-compressed -1.8% -3.0% +1.2% +10.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 6, 2026

File Sizes: Statistical and Population Genetics

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 6, 2026

Benchmarks: TPC-H SF=10 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -3.5%
Vortex (geomean): 0.877x ✅
Parquet (geomean): 0.913x ➖
Shifts: Parquet (control) -8.7% · Median polish -11.8%


datafusion / vortex-file-compressed (0.858x ✅, 20↑ 0↓)
name PR a1d2e1e (ns) base eda8c2c (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 🚀 381865105 425130260 0.90
tpch_q02/datafusion:vortex-file-compressed 🚀 105035494 122093590 0.86
tpch_q03/datafusion:vortex-file-compressed 🚀 212639774 255249811 0.83
tpch_q04/datafusion:vortex-file-compressed 🚀 113182108 133336017 0.85
tpch_q05/datafusion:vortex-file-compressed 🚀 365884280 442338765 0.83
tpch_q06/datafusion:vortex-file-compressed 🚀 43390748 51093469 0.85
tpch_q07/datafusion:vortex-file-compressed 🚀 496853934 610015758 0.81
tpch_q08/datafusion:vortex-file-compressed 🚀 353627766 420593387 0.84
tpch_q09/datafusion:vortex-file-compressed 🚀 618222782 737353632 0.84
tpch_q10/datafusion:vortex-file-compressed 🚀 228683100 268752030 0.85
tpch_q11/datafusion:vortex-file-compressed 🚀 80408821 94171963 0.85
tpch_q12/datafusion:vortex-file-compressed 🚀 119342670 141227813 0.85
tpch_q13/datafusion:vortex-file-compressed 🚀 211793296 248449094 0.85
tpch_q14/datafusion:vortex-file-compressed 🚀 56363524 63096306 0.89
tpch_q15/datafusion:vortex-file-compressed 🚀 104164769 120678960 0.86
tpch_q16/datafusion:vortex-file-compressed 🚀 74220553 83391468 0.89
tpch_q17/datafusion:vortex-file-compressed 🚀 625771578 743251538 0.84
tpch_q18/datafusion:vortex-file-compressed 🚀 824014751 982740091 0.84
tpch_q19/datafusion:vortex-file-compressed 90033463 97388719 0.92
tpch_q20/datafusion:vortex-file-compressed 🚀 165829667 193806147 0.86
tpch_q21/datafusion:vortex-file-compressed 🚀 642521188 767761046 0.84
tpch_q22/datafusion:vortex-file-compressed 65031797 70421687 0.92
datafusion / vortex-compact (0.856x ✅, 21↑ 0↓)
name PR a1d2e1e (ns) base eda8c2c (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 🚀 442283740 497270805 0.89
tpch_q02/datafusion:vortex-compact 🚀 108545323 127912585 0.85
tpch_q03/datafusion:vortex-compact 🚀 214177830 258240617 0.83
tpch_q04/datafusion:vortex-compact 🚀 120593246 135454593 0.89
tpch_q05/datafusion:vortex-compact 🚀 372954177 442100325 0.84
tpch_q06/datafusion:vortex-compact 🚀 62996916 72039721 0.87
tpch_q07/datafusion:vortex-compact 🚀 512071244 623271283 0.82
tpch_q08/datafusion:vortex-compact 🚀 356175503 417996378 0.85
tpch_q09/datafusion:vortex-compact 🚀 628862461 754389088 0.83
tpch_q10/datafusion:vortex-compact 🚀 245016054 286721809 0.85
tpch_q11/datafusion:vortex-compact 🚀 81369392 95951583 0.85
tpch_q12/datafusion:vortex-compact 🚀 163558288 189732498 0.86
tpch_q13/datafusion:vortex-compact 🚀 259659541 295067542 0.88
tpch_q14/datafusion:vortex-compact 🚀 73177596 84799734 0.86
tpch_q15/datafusion:vortex-compact 🚀 158967835 181196994 0.88
tpch_q16/datafusion:vortex-compact 🚀 79014937 91581268 0.86
tpch_q17/datafusion:vortex-compact 🚀 624423228 775157120 0.81
tpch_q18/datafusion:vortex-compact 🚀 824853160 988383277 0.83
tpch_q19/datafusion:vortex-compact 130218268 141325660 0.92
tpch_q20/datafusion:vortex-compact 🚀 187285031 219271903 0.85
tpch_q21/datafusion:vortex-compact 🚀 648545004 791440657 0.82
tpch_q22/datafusion:vortex-compact 🚀 71123235 81129850 0.88
datafusion / parquet (0.882x ✅, 18↑ 0↓)
name PR a1d2e1e (ns) base eda8c2c (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 🚀 460335648 519225678 0.89
tpch_q02/datafusion:parquet 🚀 167958551 187680335 0.89
tpch_q03/datafusion:parquet 🚀 272368847 318197000 0.86
tpch_q04/datafusion:parquet 124522229 137456728 0.91
tpch_q05/datafusion:parquet 🚀 422392800 509821286 0.83
tpch_q06/datafusion:parquet 🚀 117937564 131703017 0.90
tpch_q07/datafusion:parquet 🚀 595437940 705023472 0.84
tpch_q08/datafusion:parquet 🚀 447004684 519378938 0.86
tpch_q09/datafusion:parquet 🚀 721268102 853448316 0.85
tpch_q10/datafusion:parquet 🚀 481866475 554329133 0.87
tpch_q11/datafusion:parquet 🚀 113665360 130551723 0.87
tpch_q12/datafusion:parquet 194452788 204039116 0.95
tpch_q13/datafusion:parquet 327535986 355858814 0.92
tpch_q14/datafusion:parquet 🚀 155149621 172901914 0.90
tpch_q15/datafusion:parquet 🚀 245646199 275911659 0.89
tpch_q16/datafusion:parquet 🚀 120219835 137893939 0.87
tpch_q17/datafusion:parquet 🚀 666024511 777447642 0.86
tpch_q18/datafusion:parquet 🚀 872871611 1005905653 0.87
tpch_q19/datafusion:parquet 🚀 251463736 280644967 0.90
tpch_q20/datafusion:parquet 🚀 282641499 319682014 0.88
tpch_q21/datafusion:parquet 🚀 671499682 789503668 0.85
tpch_q22/datafusion:parquet 215779057 221639315 0.97
datafusion / arrow (0.851x ✅, 21↑ 0↓)
name PR a1d2e1e (ns) base eda8c2c (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 🚀 587483639 675053666 0.87
tpch_q02/datafusion:arrow 🚀 161130509 185995091 0.87
tpch_q03/datafusion:arrow 🚀 459719609 551477519 0.83
tpch_q04/datafusion:arrow 🚀 335344318 401487323 0.84
tpch_q05/datafusion:arrow 🚀 922294147 1067000413 0.86
tpch_q06/datafusion:arrow 🚀 275775203 330194074 0.84
tpch_q07/datafusion:arrow 🚀 1141601406 1402678116 0.81
tpch_q08/datafusion:arrow 🚀 1121044748 1312007315 0.85
tpch_q09/datafusion:arrow 🚀 1327985507 1547313941 0.86
tpch_q10/datafusion:arrow 🚀 576633586 710958898 0.81
tpch_q11/datafusion:arrow 🚀 135583277 150783624 0.90
tpch_q12/datafusion:arrow 🚀 774096210 883241441 0.88
tpch_q13/datafusion:arrow 503724626 543202532 0.93
tpch_q14/datafusion:arrow 🚀 313054809 382819226 0.82
tpch_q15/datafusion:arrow 🚀 681043979 846196998 0.80
tpch_q16/datafusion:arrow 🚀 102280728 116859374 0.88
tpch_q17/datafusion:arrow 🚀 1297989355 1526852131 0.85
tpch_q18/datafusion:arrow 🚀 1845180889 2204053104 0.84
tpch_q19/datafusion:arrow 🚀 476561033 575396168 0.83
tpch_q20/datafusion:arrow 🚀 475604875 582903821 0.82
tpch_q21/datafusion:arrow 🚀 2979762314 3349100250 0.89
tpch_q22/datafusion:arrow 🚀 126552042 147182136 0.86
duckdb / vortex-file-compressed (0.888x ✅, 14↑ 0↓)
name PR a1d2e1e (ns) base eda8c2c (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 170054964 180931842 0.94
tpch_q02/duckdb:vortex-file-compressed 🚀 50112882 56536467 0.89
tpch_q03/duckdb:vortex-file-compressed 🚀 123434476 145047977 0.85
tpch_q04/duckdb:vortex-file-compressed 🚀 150634863 178439691 0.84
tpch_q05/duckdb:vortex-file-compressed 🚀 125560122 142500477 0.88
tpch_q06/duckdb:vortex-file-compressed 🚀 45424201 53300661 0.85
tpch_q07/duckdb:vortex-file-compressed 🚀 140886027 167196288 0.84
tpch_q08/duckdb:vortex-file-compressed 🚀 167457399 198823340 0.84
tpch_q09/duckdb:vortex-file-compressed 324323293 354092187 0.92
tpch_q10/duckdb:vortex-file-compressed 🚀 140788291 159764460 0.88
tpch_q11/duckdb:vortex-file-compressed 32489146 35846487 0.91
tpch_q12/duckdb:vortex-file-compressed 🚀 92136846 104334091 0.88
tpch_q13/duckdb:vortex-file-compressed 226078043 249344206 0.91
tpch_q14/duckdb:vortex-file-compressed 🚀 64631376 72985738 0.89
tpch_q15/duckdb:vortex-file-compressed 86222578 95756951 0.90
tpch_q16/duckdb:vortex-file-compressed 🚀 76305085 85500513 0.89
tpch_q17/duckdb:vortex-file-compressed 🚀 96859546 107873747 0.90
tpch_q18/duckdb:vortex-file-compressed 🚀 283675717 316009226 0.90
tpch_q19/duckdb:vortex-file-compressed 83896658 89565604 0.94
tpch_q20/duckdb:vortex-file-compressed 157457296 173863251 0.91
tpch_q21/duckdb:vortex-file-compressed 🚀 558850001 648504501 0.86
tpch_q22/duckdb:vortex-file-compressed 70492314 76047894 0.93
duckdb / vortex-compact (0.907x ➖, 10↑ 0↓)
name PR a1d2e1e (ns) base eda8c2c (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 227746440 238963860 0.95
tpch_q02/duckdb:vortex-compact 55221016 59605854 0.93
tpch_q03/duckdb:vortex-compact 🚀 136503012 154491190 0.88
tpch_q04/duckdb:vortex-compact 🚀 168388888 189464465 0.89
tpch_q05/duckdb:vortex-compact 🚀 140929428 158822091 0.89
tpch_q06/duckdb:vortex-compact 84211126 87571767 0.96
tpch_q07/duckdb:vortex-compact 193689881 212738451 0.91
tpch_q08/duckdb:vortex-compact 🚀 184805259 210964127 0.88
tpch_q09/duckdb:vortex-compact 348018015 383115453 0.91
tpch_q10/duckdb:vortex-compact 🚀 174883505 195039313 0.90
tpch_q11/duckdb:vortex-compact 🚀 39378690 44087028 0.89
tpch_q12/duckdb:vortex-compact 199873898 221372640 0.90
tpch_q13/duckdb:vortex-compact 276158800 305643177 0.90
tpch_q14/duckdb:vortex-compact 🚀 98031970 109139690 0.90
tpch_q15/duckdb:vortex-compact 114746301 122910690 0.93
tpch_q16/duckdb:vortex-compact 82850544 89493906 0.93
tpch_q17/duckdb:vortex-compact 🚀 110397782 124573029 0.89
tpch_q18/duckdb:vortex-compact 284427416 315849624 0.90
tpch_q19/duckdb:vortex-compact 107046824 113403957 0.94
tpch_q20/duckdb:vortex-compact 🚀 198908648 225291586 0.88
tpch_q21/duckdb:vortex-compact 🚀 599889314 686154411 0.87
tpch_q22/duckdb:vortex-compact 84744265 91485918 0.93
duckdb / parquet (0.946x ➖, 1↑ 0↓)
name PR a1d2e1e (ns) base eda8c2c (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 260223745 260882398 1.00
tpch_q02/duckdb:parquet 🚀 94483431 106147619 0.89
tpch_q03/duckdb:parquet 205112459 223022370 0.92
tpch_q04/duckdb:parquet 133905129 139896416 0.96
tpch_q05/duckdb:parquet 213761310 228911755 0.93
tpch_q06/duckdb:parquet 65313040 68245128 0.96
tpch_q07/duckdb:parquet 181077730 189698648 0.95
tpch_q08/duckdb:parquet 250383612 273392724 0.92
tpch_q09/duckdb:parquet 495773007 531966282 0.93
tpch_q10/duckdb:parquet 608380868 643478520 0.95
tpch_q11/duckdb:parquet 57945979 61659793 0.94
tpch_q12/duckdb:parquet 121852590 129525894 0.94
tpch_q13/duckdb:parquet 444488592 470613367 0.94
tpch_q14/duckdb:parquet 174342510 181720736 0.96
tpch_q15/duckdb:parquet 94472038 99990888 0.94
tpch_q16/duckdb:parquet 161646088 169967229 0.95
tpch_q17/duckdb:parquet 176182341 178917615 0.98
tpch_q18/duckdb:parquet 354495864 372585648 0.95
tpch_q19/duckdb:parquet 279244270 297507360 0.94
tpch_q20/duckdb:parquet 230055567 233081606 0.99
tpch_q21/duckdb:parquet 551650330 607247423 0.91
tpch_q22/duckdb:parquet 289997673 300237002 0.97
duckdb / duckdb (0.932x ➖, 2↑ 0↓)
name PR a1d2e1e (ns) base eda8c2c (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 116492439 120712854 0.97
tpch_q02/duckdb:duckdb 🚀 44849464 52419945 0.86
tpch_q03/duckdb:duckdb 96255279 106372195 0.90
tpch_q04/duckdb:duckdb 132143869 144613391 0.91
tpch_q05/duckdb:duckdb 108319630 117971275 0.92
tpch_q06/duckdb:duckdb 37122566 40757822 0.91
tpch_q07/duckdb:duckdb 85960816 91130549 0.94
tpch_q08/duckdb:duckdb 109713907 117767503 0.93
tpch_q09/duckdb:duckdb 276005161 298852629 0.92
tpch_q10/duckdb:duckdb 204844672 225841015 0.91
tpch_q11/duckdb:duckdb 15813112 15975803 0.99
tpch_q12/duckdb:duckdb 84523699 89737366 0.94
tpch_q13/duckdb:duckdb 🚀 219786861 244391638 0.90
tpch_q14/duckdb:duckdb 69797273 75807235 0.92
tpch_q15/duckdb:duckdb 78517559 82311674 0.95
tpch_q16/duckdb:duckdb 73943796 79812186 0.93
tpch_q17/duckdb:duckdb 84323749 87861546 0.96
tpch_q18/duckdb:duckdb 211505683 225870026 0.94
tpch_q19/duckdb:duckdb 114984654 122984522 0.93
tpch_q20/duckdb:duckdb 112447577 117818721 0.95
tpch_q21/duckdb:duckdb 298881049 324041678 0.92
tpch_q22/duckdb:duckdb 69301930 70016389 0.99
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:arrow -13.0% -6.0% -7.5% +10.0% ➖ noise
1 datafusion:vortex-compact -11.1% -6.0% -5.4% +10.0% ➖ noise
1 datafusion:vortex-file-compressed -10.2% -6.0% -4.5% +10.0% ➖ noise
1 duckdb:duckdb -3.5% -6.0% +2.6% +10.0% ➖ noise
1 duckdb:vortex-compact -4.7% -6.0% +1.3% +10.0% ➖ noise
1 duckdb:vortex-file-compressed -6.0% -6.0% -0.1% +10.0% ➖ noise
2 datafusion:arrow -13.4% -10.7% -2.9% +10.0% ➖ noise
2 datafusion:vortex-compact -15.1% -10.7% -4.9% +10.0% ➖ noise
2 datafusion:vortex-file-compressed -14.0% -10.7% -3.6% +10.0% ➖ noise
2 duckdb:duckdb -14.4% -10.7% -4.1% +10.0% ➖ noise
2 duckdb:vortex-compact -7.4% -10.7% +3.8% +10.0% ➖ noise
2 duckdb:vortex-file-compressed -11.4% -10.7% -0.7% +12.9% ➖ noise
3 datafusion:arrow -16.6% -11.3% -6.0% +10.0% ➖ noise
3 datafusion:vortex-compact -17.1% -11.3% -6.5% +10.0% ➖ noise
3 datafusion:vortex-file-compressed -16.7% -11.3% -6.1% +10.0% ➖ noise
3 duckdb:duckdb -9.5% -11.3% +2.0% +10.0% ➖ noise
3 duckdb:vortex-compact -11.6% -11.3% -0.4% +10.0% ➖ noise
3 duckdb:vortex-file-compressed -14.9% -11.3% -4.1% +10.0% ➖ noise
4 datafusion:arrow -16.5% -6.9% -10.3% +10.0% ✅ faster
4 datafusion:vortex-compact -11.0% -6.9% -4.4% +10.0% ➖ noise
4 datafusion:vortex-file-compressed -15.1% -6.9% -8.8% +10.0% ➖ noise
4 duckdb:duckdb -8.6% -6.9% -1.9% +10.0% ➖ noise
4 duckdb:vortex-compact -11.1% -6.9% -4.6% +10.0% ➖ noise
4 duckdb:vortex-file-compressed -15.6% -6.9% -9.3% +10.0% ✅ faster
5 datafusion:arrow -13.6% -12.0% -1.7% +10.0% ➖ noise
5 datafusion:vortex-compact -15.6% -12.0% -4.1% +10.0% ➖ noise
5 datafusion:vortex-file-compressed -17.3% -12.0% -6.0% +10.0% ➖ noise
5 duckdb:duckdb -8.2% -12.0% +4.4% +10.0% ➖ noise
5 duckdb:vortex-compact -11.3% -12.0% +0.9% +10.0% ➖ noise
5 duckdb:vortex-file-compressed -11.9% -12.0% +0.2% +10.0% ➖ noise
6 datafusion:arrow -16.5% -7.4% -9.8% +10.0% ✅ faster
6 datafusion:vortex-compact -12.6% -7.4% -5.5% +10.0% ➖ noise
6 datafusion:vortex-file-compressed -15.1% -7.4% -8.3% +10.0% ➖ noise
6 duckdb:duckdb -8.9% -7.4% -1.6% +10.0% ➖ noise
6 duckdb:vortex-compact -3.8% -7.4% +3.9% +10.0% ➖ noise
6 duckdb:vortex-file-compressed -14.8% -7.4% -7.9% +11.7% ➖ noise
7 datafusion:arrow -18.6% -10.2% -9.4% +10.0% ✅ faster
7 datafusion:vortex-compact -17.8% -10.2% -8.5% +10.0% ➖ noise
7 datafusion:vortex-file-compressed -18.6% -10.2% -9.3% +10.0% ✅ faster
7 duckdb:duckdb -5.7% -10.2% +5.1% +10.0% ➖ noise
7 duckdb:vortex-compact -9.0% -10.2% +1.4% +10.0% ➖ noise
7 duckdb:vortex-file-compressed -15.7% -10.2% -6.2% +10.0% ➖ noise
8 datafusion:arrow -14.6% -11.2% -3.8% +10.0% ➖ noise
8 datafusion:vortex-compact -14.8% -11.2% -4.0% +10.0% ➖ noise
8 datafusion:vortex-file-compressed -15.9% -11.2% -5.3% +10.0% ➖ noise
8 duckdb:duckdb -6.8% -11.2% +4.9% +10.0% ➖ noise
8 duckdb:vortex-compact -12.4% -11.2% -1.3% +10.0% ➖ noise
8 duckdb:vortex-file-compressed -15.8% -11.2% -5.1% +10.0% ➖ noise
9 datafusion:arrow -14.2% -11.3% -3.3% +10.0% ➖ noise
9 datafusion:vortex-compact -16.6% -11.3% -6.1% +10.0% ➖ noise
9 datafusion:vortex-file-compressed -16.2% -11.3% -5.5% +10.0% ➖ noise
9 duckdb:duckdb -7.6% -11.3% +4.1% +10.0% ➖ noise
9 duckdb:vortex-compact -9.2% -11.3% +2.4% +10.0% ➖ noise
9 duckdb:vortex-file-compressed -8.4% -11.3% +3.2% +10.0% ➖ noise
10 datafusion:arrow -18.9% -9.3% -10.5% +10.0% ✅ faster
10 datafusion:vortex-compact -14.5% -9.3% -5.7% +10.0% ➖ noise
10 datafusion:vortex-file-compressed -14.9% -9.3% -6.1% +10.0% ➖ noise
10 duckdb:duckdb -9.3% -9.3% +0.1% +10.0% ➖ noise
10 duckdb:vortex-compact -10.3% -9.3% -1.1% +10.0% ➖ noise
10 duckdb:vortex-file-compressed -11.9% -9.3% -2.8% +10.0% ➖ noise
11 datafusion:arrow -10.1% -9.5% -0.6% +10.0% ➖ noise
11 datafusion:vortex-compact -15.2% -9.5% -6.2% +10.0% ➖ noise
11 datafusion:vortex-file-compressed -14.6% -9.5% -5.6% +10.0% ➖ noise
11 duckdb:duckdb -1.0% -9.5% +9.4% +12.7% ➖ noise
11 duckdb:vortex-compact -10.7% -9.5% -1.3% +11.6% ➖ noise
11 duckdb:vortex-file-compressed -9.4% -9.5% +0.2% +16.4% ➖ noise
12 datafusion:arrow -12.4% -5.3% -7.4% +31.6% ➖ noise
12 datafusion:vortex-compact -13.8% -5.3% -9.0% +10.0% ➖ noise
12 datafusion:vortex-file-compressed -15.5% -5.3% -10.8% +10.0% ✅ faster
12 duckdb:duckdb -5.8% -5.3% -0.5% +10.0% ➖ noise
12 duckdb:vortex-compact -9.7% -5.3% -4.6% +10.0% ➖ noise
12 duckdb:vortex-file-compressed -11.7% -5.3% -6.7% +10.0% ➖ noise
13 datafusion:arrow -7.3% -6.8% -0.5% +10.0% ➖ noise
13 datafusion:vortex-compact -12.0% -6.8% -5.6% +10.0% ➖ noise
13 datafusion:vortex-file-compressed -14.8% -6.8% -8.6% +10.0% ➖ noise
13 duckdb:duckdb -10.1% -6.8% -3.5% +10.0% ➖ noise
13 duckdb:vortex-compact -9.6% -6.8% -3.1% +10.0% ➖ noise
13 duckdb:vortex-file-compressed -9.3% -6.8% -2.8% +10.0% ➖ noise
14 datafusion:arrow -18.2% -7.2% -11.9% +10.0% ✅ faster
14 datafusion:vortex-compact -13.7% -7.2% -7.0% +10.0% ➖ noise
14 datafusion:vortex-file-compressed -10.7% -7.2% -3.7% +10.0% ➖ noise
14 duckdb:duckdb -7.9% -7.2% -0.8% +10.0% ➖ noise
14 duckdb:vortex-compact -10.2% -7.2% -3.2% +10.0% ➖ noise
14 duckdb:vortex-file-compressed -11.4% -7.2% -4.6% +10.0% ➖ noise
15 datafusion:arrow -19.5% -8.3% -12.2% +10.0% ✅ faster
15 datafusion:vortex-compact -12.3% -8.3% -4.3% +10.0% ➖ noise
15 datafusion:vortex-file-compressed -13.7% -8.3% -5.9% +10.0% ➖ noise
15 duckdb:duckdb -4.6% -8.3% +4.0% +10.0% ➖ noise
15 duckdb:vortex-compact -6.6% -8.3% +1.8% +10.0% ➖ noise
15 duckdb:vortex-file-compressed -10.0% -8.3% -1.8% +10.0% ➖ noise
16 datafusion:arrow -12.5% -8.9% -3.9% +10.0% ➖ noise
16 datafusion:vortex-compact -13.7% -8.9% -5.2% +10.0% ➖ noise
16 datafusion:vortex-file-compressed -11.0% -8.9% -2.3% +10.0% ➖ noise
16 duckdb:duckdb -7.4% -8.9% +1.7% +10.0% ➖ noise
16 duckdb:vortex-compact -7.4% -8.9% +1.7% +10.0% ➖ noise
16 duckdb:vortex-file-compressed -10.8% -8.9% -2.0% +10.0% ➖ noise
17 datafusion:arrow -15.0% -8.2% -7.4% +10.0% ➖ noise
17 datafusion:vortex-compact -19.4% -8.2% -12.3% +10.0% ✅ faster
17 datafusion:vortex-file-compressed -15.8% -8.2% -8.3% +10.0% ➖ noise
17 duckdb:duckdb -4.0% -8.2% +4.5% +10.0% ➖ noise
17 duckdb:vortex-compact -11.4% -8.2% -3.5% +10.0% ➖ noise
17 duckdb:vortex-file-compressed -10.2% -8.2% -2.2% +10.0% ➖ noise
18 datafusion:arrow -16.3% -9.1% -7.9% +10.0% ➖ noise
18 datafusion:vortex-compact -16.5% -9.1% -8.2% +10.0% ➖ noise
18 datafusion:vortex-file-compressed -16.2% -9.1% -7.7% +10.0% ➖ noise
18 duckdb:duckdb -6.4% -9.1% +3.1% +10.0% ➖ noise
18 duckdb:vortex-compact -9.9% -9.1% -0.9% +10.0% ➖ noise
18 duckdb:vortex-file-compressed -10.2% -9.1% -1.2% +10.0% ➖ noise
19 datafusion:arrow -17.2% -8.3% -9.7% +10.0% ✅ faster
19 datafusion:vortex-compact -7.9% -8.3% +0.5% +10.0% ➖ noise
19 datafusion:vortex-file-compressed -7.6% -8.3% +0.8% +10.0% ➖ noise
19 duckdb:duckdb -6.5% -8.3% +1.9% +10.0% ➖ noise
19 duckdb:vortex-compact -5.6% -8.3% +2.9% +10.0% ➖ noise
19 duckdb:vortex-file-compressed -6.3% -8.3% +2.1% +10.0% ➖ noise
20 datafusion:arrow -18.4% -6.6% -12.7% +10.0% ✅ faster
20 datafusion:vortex-compact -14.6% -6.6% -8.6% +10.0% ➖ noise
20 datafusion:vortex-file-compressed -14.4% -6.6% -8.4% +10.0% ➖ noise
20 duckdb:duckdb -4.6% -6.6% +2.2% +10.0% ➖ noise
20 duckdb:vortex-compact -11.7% -6.6% -5.5% +10.0% ➖ noise
20 duckdb:vortex-file-compressed -9.4% -6.6% -3.1% +10.0% ➖ noise
21 datafusion:arrow -11.0% -12.1% +1.2% +10.0% ➖ noise
21 datafusion:vortex-compact -18.1% -12.1% -6.8% +10.0% ➖ noise
21 datafusion:vortex-file-compressed -16.3% -12.1% -4.8% +10.0% ➖ noise
21 duckdb:duckdb -7.8% -12.1% +4.9% +10.0% ➖ noise
21 duckdb:vortex-compact -12.6% -12.1% -0.5% +10.0% ➖ noise
21 duckdb:vortex-file-compressed -13.8% -12.1% -2.0% +10.0% ➖ noise
22 datafusion:arrow -14.0% -3.0% -11.3% +10.0% ✅ faster
22 datafusion:vortex-compact -12.3% -3.0% -9.6% +10.0% ✅ faster
22 datafusion:vortex-file-compressed -7.7% -3.0% -4.8% +10.0% ➖ noise
22 duckdb:duckdb -1.0% -3.0% +2.1% +10.0% ➖ noise
22 duckdb:vortex-compact -7.4% -3.0% -4.5% +10.0% ➖ noise
22 duckdb:vortex-file-compressed -7.3% -3.0% -4.4% +10.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 6, 2026

File Sizes: TPC-H SF=10 on NVME

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 6, 2026

Benchmarks: Random Access

Vortex (geomean): 1.176x ❌
Parquet (geomean): 1.115x ❌


unknown / unknown (1.139x ❌, 0↑ 39↓)
name PR a1d2e1e (ns) base eda8c2c (ns) ratio (PR/base)
random-access/feature-vectors/correlated/lance-tokio-local-disk 2213718 2409363 0.92
random-access/feature-vectors/correlated/lance-tokio-local-disk-footer 🚨 1733187 1489314 1.16
random-access/feature-vectors/correlated/parquet-tokio-local-disk 9163209717 8451898736 1.08
random-access/feature-vectors/correlated/parquet-tokio-local-disk-footer 9179029774 8377197276 1.10
random-access/feature-vectors/correlated/vortex-tokio-local-disk 7774070 7884408 0.99
random-access/feature-vectors/correlated/vortex-tokio-local-disk-footer 🚨 8263642 7206443 1.15
random-access/feature-vectors/uniform/lance-tokio-local-disk 🚨 6621986 5795105 1.14
random-access/feature-vectors/uniform/lance-tokio-local-disk-footer 🚨 7469594 6579455 1.14
random-access/feature-vectors/uniform/parquet-tokio-local-disk 9148577522 8345008431 1.10
random-access/feature-vectors/uniform/parquet-tokio-local-disk-footer 9098946587 8429648060 1.08
random-access/feature-vectors/uniform/vortex-tokio-local-disk 🚨 14974278 13263220 1.13
random-access/feature-vectors/uniform/vortex-tokio-local-disk-footer 🚨 15021504 13126572 1.14
random-access/lance-tokio-local-disk 🚨 861482 763691 1.13
random-access/lance-tokio-local-disk-footer 🚨 1569278 1322630 1.19
random-access/nested-lists/correlated/lance-tokio-local-disk 🚨 285415 250175 1.14
random-access/nested-lists/correlated/lance-tokio-local-disk-footer 🚨 775430 626559 1.24
random-access/nested-lists/correlated/parquet-tokio-local-disk 137121541 128112427 1.07
random-access/nested-lists/correlated/parquet-tokio-local-disk-footer 139521848 128154950 1.09
random-access/nested-lists/correlated/vortex-tokio-local-disk 🚨 741925 592779 1.25
random-access/nested-lists/correlated/vortex-tokio-local-disk-footer 🚨 729703 561644 1.30
random-access/nested-lists/uniform/lance-tokio-local-disk 🚨 1262248 1124302 1.12
random-access/nested-lists/uniform/lance-tokio-local-disk-footer 🚨 1749617 1500752 1.17
random-access/nested-lists/uniform/parquet-tokio-local-disk 139355323 128109909 1.09
random-access/nested-lists/uniform/parquet-tokio-local-disk-footer 135927051 127729601 1.06
random-access/nested-lists/uniform/vortex-tokio-local-disk 🚨 2539899 2092909 1.21
random-access/nested-lists/uniform/vortex-tokio-local-disk-footer 🚨 2644194 2092742 1.26
random-access/nested-structs/correlated/lance-tokio-local-disk 🚨 448459 399044 1.12
random-access/nested-structs/correlated/lance-tokio-local-disk-footer 🚨 692522 598415 1.16
random-access/nested-structs/correlated/parquet-tokio-local-disk 🚨 25085167 21211885 1.18
random-access/nested-structs/correlated/parquet-tokio-local-disk-footer 🚨 25359216 20616655 1.23
random-access/nested-structs/correlated/vortex-tokio-local-disk 🚨 934714 751824 1.24
random-access/nested-structs/correlated/vortex-tokio-local-disk-footer 🚨 915593 766326 1.19
random-access/nested-structs/uniform/lance-tokio-local-disk 🚨 3099986 2783982 1.11
random-access/nested-structs/uniform/lance-tokio-local-disk-footer 🚨 3471053 2998310 1.16
random-access/nested-structs/uniform/parquet-tokio-local-disk 🚨 25109744 20565742 1.22
random-access/nested-structs/uniform/parquet-tokio-local-disk-footer 🚨 25261234 21188953 1.19
random-access/nested-structs/uniform/vortex-tokio-local-disk 🚨 2087501 1587028 1.32
random-access/nested-structs/uniform/vortex-tokio-local-disk-footer 🚨 2057859 1658564 1.24
random-access/parquet-tokio-local-disk 181190149 165289419 1.10
random-access/parquet-tokio-local-disk-footer 🚨 182299543 165533078 1.10
random-access/taxi/correlated/lance-tokio-local-disk 🚨 1068988 952004 1.12
random-access/taxi/correlated/lance-tokio-local-disk-footer 🚨 1906535 1598348 1.19
random-access/taxi/correlated/parquet-tokio-local-disk 🚨 277495520 251566709 1.10
random-access/taxi/correlated/parquet-tokio-local-disk-footer 🚨 275394755 248488268 1.11
random-access/taxi/correlated/vortex-tokio-local-disk 🚨 1996789 1777352 1.12
random-access/taxi/correlated/vortex-tokio-local-disk-footer 🚨 2272513 1789668 1.27
random-access/taxi/uniform/lance-tokio-local-disk 🚨 10989243 9950049 1.10
random-access/taxi/uniform/lance-tokio-local-disk-footer 11675804 11336563 1.03
random-access/taxi/uniform/parquet-tokio-local-disk 291135854 267216492 1.09
random-access/taxi/uniform/parquet-tokio-local-disk-footer 🚨 292762690 265241109 1.10
random-access/taxi/uniform/vortex-tokio-local-disk 🚨 5317150 4610144 1.15
random-access/taxi/uniform/vortex-tokio-local-disk-footer 🚨 5317202 4601600 1.16
random-access/vortex-tokio-local-disk 1412000 1358686 1.04
random-access/vortex-tokio-local-disk-footer 1426752 1350856 1.06

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 6, 2026

Benchmarks: Clickbench on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.6%
Vortex (geomean): 0.946x ➖
Parquet (geomean): 0.948x ➖
Shifts: Parquet (control) -5.2% · Median polish -4.5%


datafusion / vortex-file-compressed (0.949x ➖, 1↑ 0↓)
name PR a1d2e1e (ns) base eda8c2c (ns) ratio (PR/base)
clickbench_q00/datafusion:vortex-file-compressed 1638821 1712410 0.96
clickbench_q01/datafusion:vortex-file-compressed 19674939 19907930 0.99
clickbench_q02/datafusion:vortex-file-compressed 38240275 39567920 0.97
clickbench_q03/datafusion:vortex-file-compressed 43146901 43911729 0.98
clickbench_q04/datafusion:vortex-file-compressed 286958402 310773146 0.92
clickbench_q05/datafusion:vortex-file-compressed 🚀 295418659 330484595 0.89
clickbench_q06/datafusion:vortex-file-compressed 1919030 1907795 1.01
clickbench_q07/datafusion:vortex-file-compressed 23152247 22465777 1.03
clickbench_q08/datafusion:vortex-file-compressed 356189114 372748320 0.96
clickbench_q09/datafusion:vortex-file-compressed 542030423 585196971 0.93
clickbench_q10/datafusion:vortex-file-compressed 75670962 77404346 0.98
clickbench_q11/datafusion:vortex-file-compressed 87652367 90809724 0.97
clickbench_q12/datafusion:vortex-file-compressed 262983919 284100343 0.93
clickbench_q13/datafusion:vortex-file-compressed 404232394 440807416 0.92
clickbench_q14/datafusion:vortex-file-compressed 253491820 276776855 0.92
clickbench_q15/datafusion:vortex-file-compressed 334500627 346028390 0.97
clickbench_q16/datafusion:vortex-file-compressed 639918095 691281136 0.93
clickbench_q17/datafusion:vortex-file-compressed 638259165 682925931 0.93
clickbench_q18/datafusion:vortex-file-compressed 1290045227 1396288933 0.92
clickbench_q19/datafusion:vortex-file-compressed 30083306 31163744 0.97
clickbench_q20/datafusion:vortex-file-compressed 339111302 342671199 0.99
clickbench_q21/datafusion:vortex-file-compressed 369236611 395423746 0.93
clickbench_q22/datafusion:vortex-file-compressed 446069639 469868314 0.95
clickbench_q23/datafusion:vortex-file-compressed 641006539 702822132 0.91
clickbench_q24/datafusion:vortex-file-compressed 47533618 47029112 1.01
clickbench_q25/datafusion:vortex-file-compressed 71092077 75851027 0.94
clickbench_q26/datafusion:vortex-file-compressed 46898491 48850958 0.96
clickbench_q27/datafusion:vortex-file-compressed 711798456 730268408 0.97
clickbench_q28/datafusion:vortex-file-compressed 6541755653 6830418456 0.96
clickbench_q29/datafusion:vortex-file-compressed 229886068 240915693 0.95
clickbench_q30/datafusion:vortex-file-compressed 221972587 233661403 0.95
clickbench_q31/datafusion:vortex-file-compressed 257533705 275188022 0.94
clickbench_q32/datafusion:vortex-file-compressed 1117496694 1195931248 0.93
clickbench_q33/datafusion:vortex-file-compressed 1291294965 1367890391 0.94
clickbench_q34/datafusion:vortex-file-compressed 1290158749 1386964227 0.93
clickbench_q35/datafusion:vortex-file-compressed 451944827 472091560 0.96
clickbench_q36/datafusion:vortex-file-compressed 71374159 75946105 0.94
clickbench_q37/datafusion:vortex-file-compressed 35094959 38162846 0.92
clickbench_q38/datafusion:vortex-file-compressed 18935190 19751821 0.96
clickbench_q39/datafusion:vortex-file-compressed 134011563 137418156 0.98
clickbench_q40/datafusion:vortex-file-compressed 15588581 17169585 0.91
clickbench_q41/datafusion:vortex-file-compressed 15101205 16344442 0.92
clickbench_q42/datafusion:vortex-file-compressed 16438408 18038228 0.91
datafusion / parquet (0.936x ➖, 5↑ 0↓)
name PR a1d2e1e (ns) base eda8c2c (ns) ratio (PR/base)
clickbench_q00/datafusion:parquet 1563451 1552967 1.01
clickbench_q01/datafusion:parquet 19184178 19195112 1.00
clickbench_q02/datafusion:parquet 47026504 48430563 0.97
clickbench_q03/datafusion:parquet 36468587 39565777 0.92
clickbench_q04/datafusion:parquet 🚀 293722468 328884679 0.89
clickbench_q05/datafusion:parquet 351057629 366982573 0.96
clickbench_q06/datafusion:parquet 1590554 1580351 1.01
clickbench_q07/datafusion:parquet 22523795 23169250 0.97
clickbench_q08/datafusion:parquet 363946105 395878246 0.92
clickbench_q09/datafusion:parquet 603961123 642875763 0.94
clickbench_q10/datafusion:parquet 103865379 110375578 0.94
clickbench_q11/datafusion:parquet 127956356 138234157 0.93
clickbench_q12/datafusion:parquet 335069026 356192329 0.94
clickbench_q13/datafusion:parquet 🚀 472106523 530887287 0.89
clickbench_q14/datafusion:parquet 332665643 361685664 0.92
clickbench_q15/datafusion:parquet 338429230 355572472 0.95
clickbench_q16/datafusion:parquet 644447096 703603268 0.92
clickbench_q17/datafusion:parquet 646664619 685528801 0.94
clickbench_q18/datafusion:parquet 1296657522 1406620162 0.92
clickbench_q19/datafusion:parquet 29684804 30002159 0.99
clickbench_q20/datafusion:parquet 593582822 634798229 0.94
clickbench_q21/datafusion:parquet 657162549 696237095 0.94
clickbench_q22/datafusion:parquet 948229549 1015171172 0.93
clickbench_q23/datafusion:parquet 3572696760 3851036985 0.93
clickbench_q24/datafusion:parquet 🚀 75958949 87719341 0.87
clickbench_q25/datafusion:parquet 133014260 140302613 0.95
clickbench_q26/datafusion:parquet 79563303 84847557 0.94
clickbench_q27/datafusion:parquet 1026103784 1112830637 0.92
clickbench_q28/datafusion:parquet 🚀 5893960130 6801845309 0.87
clickbench_q29/datafusion:parquet 237188416 246892916 0.96
clickbench_q30/datafusion:parquet 319048932 342747513 0.93
clickbench_q31/datafusion:parquet 363919710 384853084 0.95
clickbench_q32/datafusion:parquet 🚀 1139304953 1287988119 0.88
clickbench_q33/datafusion:parquet 1453717332 1596191479 0.91
clickbench_q34/datafusion:parquet 1454378952 1552278511 0.94
clickbench_q35/datafusion:parquet 456599041 492591066 0.93
clickbench_q36/datafusion:parquet 136323982 146399284 0.93
clickbench_q37/datafusion:parquet 54707893 58798981 0.93
clickbench_q38/datafusion:parquet 83053739 91014970 0.91
clickbench_q39/datafusion:parquet 258962784 268202816 0.97
clickbench_q40/datafusion:parquet 30028700 30934663 0.97
clickbench_q41/datafusion:parquet 26562311 28650994 0.93
clickbench_q42/datafusion:parquet 29656606 31403961 0.94
duckdb / vortex-file-compressed (0.944x ➖, 4↑ 1↓)
name PR a1d2e1e (ns) base eda8c2c (ns) ratio (PR/base)
clickbench_q00/duckdb:vortex-file-compressed 🚀 6049015 6869342 0.88
clickbench_q01/duckdb:vortex-file-compressed 12960206 13999478 0.93
clickbench_q02/duckdb:vortex-file-compressed 25829552 27076370 0.95
clickbench_q03/duckdb:vortex-file-compressed 28936883 30574173 0.95
clickbench_q04/duckdb:vortex-file-compressed 182808523 189053813 0.97
clickbench_q05/duckdb:vortex-file-compressed 172134382 180065997 0.96
clickbench_q06/duckdb:vortex-file-compressed 19572888 20853482 0.94
clickbench_q07/duckdb:vortex-file-compressed 13896088 14610591 0.95
clickbench_q08/duckdb:vortex-file-compressed 258306936 262083139 0.99
clickbench_q09/duckdb:vortex-file-compressed 329728931 351486799 0.94
clickbench_q10/duckdb:vortex-file-compressed 66530584 69034942 0.96
clickbench_q11/duckdb:vortex-file-compressed 76309596 80217252 0.95
clickbench_q12/duckdb:vortex-file-compressed 199199706 204634084 0.97
clickbench_q13/duckdb:vortex-file-compressed 393571879 412432035 0.95
clickbench_q14/duckdb:vortex-file-compressed 224625094 242181075 0.93
clickbench_q15/duckdb:vortex-file-compressed 241304970 252879162 0.95
clickbench_q16/duckdb:vortex-file-compressed 586175650 608771671 0.96
clickbench_q17/duckdb:vortex-file-compressed 470148883 492092882 0.96
clickbench_q18/duckdb:vortex-file-compressed 974675415 1020889480 0.95
clickbench_q19/duckdb:vortex-file-compressed 20131252 22028543 0.91
clickbench_q20/duckdb:vortex-file-compressed 333007262 355617259 0.94
clickbench_q21/duckdb:vortex-file-compressed 362804405 392756276 0.92
clickbench_q22/duckdb:vortex-file-compressed 🚀 506418015 616024958 0.82
clickbench_q23/duckdb:vortex-file-compressed 🚨 440158976 359456569 1.22
clickbench_q24/duckdb:vortex-file-compressed 🚀 35746667 41151948 0.87
clickbench_q25/duckdb:vortex-file-compressed 72177751 74265830 0.97
clickbench_q26/duckdb:vortex-file-compressed 🚀 45733365 52443180 0.87
clickbench_q27/duckdb:vortex-file-compressed 467348843 485740450 0.96
clickbench_q28/duckdb:vortex-file-compressed 2949523278 3066283219 0.96
clickbench_q29/duckdb:vortex-file-compressed 27562026 28375112 0.97
clickbench_q30/duckdb:vortex-file-compressed 183707641 196892981 0.93
clickbench_q31/duckdb:vortex-file-compressed 277806238 293874132 0.95
clickbench_q32/duckdb:vortex-file-compressed 1215009482 1166809941 1.04
clickbench_q33/duckdb:vortex-file-compressed 1115285310 1222934085 0.91
clickbench_q34/duckdb:vortex-file-compressed 1204451725 1272123994 0.95
clickbench_q35/duckdb:vortex-file-compressed 374357305 397608974 0.94
clickbench_q36/duckdb:vortex-file-compressed 25508911 28166211 0.91
clickbench_q37/duckdb:vortex-file-compressed 20892566 20938583 1.00
clickbench_q38/duckdb:vortex-file-compressed 20418365 22513923 0.91
clickbench_q39/duckdb:vortex-file-compressed 39869463 43662889 0.91
clickbench_q40/duckdb:vortex-file-compressed 19254849 21248452 0.91
clickbench_q41/duckdb:vortex-file-compressed 19566021 21282156 0.92
clickbench_q42/duckdb:vortex-file-compressed 21281707 23617669 0.90
duckdb / parquet (0.961x ➖, 1↑ 0↓)
name PR a1d2e1e (ns) base eda8c2c (ns) ratio (PR/base)
clickbench_q00/duckdb:parquet 25482329 26288269 0.97
clickbench_q01/duckdb:parquet 27320807 28210552 0.97
clickbench_q02/duckdb:parquet 47192582 49668587 0.95
clickbench_q03/duckdb:parquet 38252873 38969048 0.98
clickbench_q04/duckdb:parquet 201369789 210467253 0.96
clickbench_q05/duckdb:parquet 264897983 275573512 0.96
clickbench_q06/duckdb:parquet 45634806 46568642 0.98
clickbench_q07/duckdb:parquet 29333801 30227481 0.97
clickbench_q08/duckdb:parquet 270452315 274537791 0.99
clickbench_q09/duckdb:parquet 395749782 410253362 0.96
clickbench_q10/duckdb:parquet 79204856 83292420 0.95
clickbench_q11/duckdb:parquet 97666316 100514522 0.97
clickbench_q12/duckdb:parquet 292599788 297639084 0.98
clickbench_q13/duckdb:parquet 476317463 508476367 0.94
clickbench_q14/duckdb:parquet 320315761 331231296 0.97
clickbench_q15/duckdb:parquet 256003565 275367460 0.93
clickbench_q16/duckdb:parquet 634501220 673686444 0.94
clickbench_q17/duckdb:parquet 531891512 572234716 0.93
clickbench_q18/duckdb:parquet 1074759600 1136648169 0.95
clickbench_q19/duckdb:parquet 25210995 26395637 0.96
clickbench_q20/duckdb:parquet 422388633 442727390 0.95
clickbench_q21/duckdb:parquet 540458724 559288547 0.97
clickbench_q22/duckdb:parquet 924681315 959428104 0.96
clickbench_q23/duckdb:parquet 294630640 317741229 0.93
clickbench_q24/duckdb:parquet 68715158 68797715 1.00
clickbench_q25/duckdb:parquet 156214153 158502482 0.99
clickbench_q26/duckdb:parquet 49951851 49820549 1.00
clickbench_q27/duckdb:parquet 644117180 665386216 0.97
clickbench_q28/duckdb:parquet 4833510402 4957172498 0.98
clickbench_q29/duckdb:parquet 40082949 41081567 0.98
clickbench_q30/duckdb:parquet 299074879 311423833 0.96
clickbench_q31/duckdb:parquet 358750893 383161626 0.94
clickbench_q32/duckdb:parquet 1161145402 1175729173 0.99
clickbench_q33/duckdb:parquet 1303156364 1355208438 0.96
clickbench_q34/duckdb:parquet 1262397372 1387738183 0.91
clickbench_q35/duckdb:parquet 357906771 374036673 0.96
clickbench_q36/duckdb:parquet 43975612 48685040 0.90
clickbench_q37/duckdb:parquet 33014781 33513449 0.99
clickbench_q38/duckdb:parquet 32399669 33498550 0.97
clickbench_q39/duckdb:parquet 86413320 87512339 0.99
clickbench_q40/duckdb:parquet 🚀 16960631 19817914 0.86
clickbench_q41/duckdb:parquet 18536884 18429399 1.01
clickbench_q42/duckdb:parquet 20627530 20788853 0.99
duckdb / duckdb (0.970x ➖, 4↑ 0↓)
name PR a1d2e1e (ns) base eda8c2c (ns) ratio (PR/base)
clickbench_q00/duckdb:duckdb 17383157 17623014 0.99
clickbench_q01/duckdb:duckdb 32940922 32825705 1.00
clickbench_q02/duckdb:duckdb 46078394 45516257 1.01
clickbench_q03/duckdb:duckdb 47195352 46724959 1.01
clickbench_q04/duckdb:duckdb 187409947 197434524 0.95
clickbench_q05/duckdb:duckdb 268551895 271517227 0.99
clickbench_q06/duckdb:duckdb 🚀 29080778 36051335 0.81
clickbench_q07/duckdb:duckdb 36023075 35074383 1.03
clickbench_q08/duckdb:duckdb 247873999 251455160 0.99
clickbench_q09/duckdb:duckdb 363346890 376505546 0.97
clickbench_q10/duckdb:duckdb 99045318 100363608 0.99
clickbench_q11/duckdb:duckdb 106432000 109298953 0.97
clickbench_q12/duckdb:duckdb 236505886 247650339 0.95
clickbench_q13/duckdb:duckdb 459527101 492072631 0.93
clickbench_q14/duckdb:duckdb 277059579 284912162 0.97
clickbench_q15/duckdb:duckdb 217257350 233626348 0.93
clickbench_q16/duckdb:duckdb 628376482 655985797 0.96
clickbench_q17/duckdb:duckdb 528944711 560960924 0.94
clickbench_q18/duckdb:duckdb 1158322945 1204368333 0.96
clickbench_q19/duckdb:duckdb 35316406 34868293 1.01
clickbench_q20/duckdb:duckdb 997521986 927338772 1.08
clickbench_q21/duckdb:duckdb 965762147 1002931107 0.96
clickbench_q22/duckdb:duckdb 1094047481 1107920266 0.99
clickbench_q23/duckdb:duckdb 260875686 269769189 0.97
clickbench_q24/duckdb:duckdb 62456667 60943400 1.02
clickbench_q25/duckdb:duckdb 143837972 145442984 0.99
clickbench_q26/duckdb:duckdb 60258379 61158254 0.99
clickbench_q27/duckdb:duckdb 998254040 1085611629 0.92
clickbench_q28/duckdb:duckdb 4640274753 4704742252 0.99
clickbench_q29/duckdb:duckdb 49106530 48841352 1.01
clickbench_q30/duckdb:duckdb 256079802 272041897 0.94
clickbench_q31/duckdb:duckdb 400658627 424751533 0.94
clickbench_q32/duckdb:duckdb 🚀 1403830530 1565210509 0.90
clickbench_q33/duckdb:duckdb 🚀 1828706425 2072398458 0.88
clickbench_q34/duckdb:duckdb 🚀 1979503315 2215795421 0.89
clickbench_q35/duckdb:duckdb 275928898 284579128 0.97
clickbench_q36/duckdb:duckdb 43435616 42627592 1.02
clickbench_q37/duckdb:duckdb 31963392 31381492 1.02
clickbench_q38/duckdb:duckdb 30948769 31249610 0.99
clickbench_q39/duckdb:duckdb 64542716 71673739 0.90
clickbench_q40/duckdb:duckdb 32386395 31668446 1.02
clickbench_q41/duckdb:duckdb 30649912 30672268 1.00
clickbench_q42/duckdb:duckdb 31862285 31691568 1.01
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-file-compressed -4.3% -1.2% -3.1% +782.6% ➖ noise
0 duckdb:duckdb -1.4% -1.2% -0.1% +291.3% ➖ noise
0 duckdb:vortex-file-compressed -11.9% -1.2% -10.9% +490.1% ➖ noise
1 datafusion:vortex-file-compressed -1.2% -1.6% +0.5% +28.9% ➖ noise
1 duckdb:duckdb +0.4% -1.6% +2.0% +56.0% ➖ noise
1 duckdb:vortex-file-compressed -7.4% -1.6% -5.9% +23.3% ➖ noise
2 datafusion:vortex-file-compressed -3.4% -3.9% +0.6% +13.8% ➖ noise
2 duckdb:duckdb +1.2% -3.9% +5.4% +17.1% ➖ noise
2 duckdb:vortex-file-compressed -4.6% -3.9% -0.7% +11.6% ➖ noise
3 datafusion:vortex-file-compressed -1.7% -4.9% +3.3% +140.5% ➖ noise
3 duckdb:duckdb +1.0% -4.9% +6.2% +33.8% ➖ noise
3 duckdb:vortex-file-compressed -5.4% -4.9% -0.5% +31.5% ➖ noise
4 datafusion:vortex-file-compressed -7.7% -7.6% -0.1% +10.0% ➖ noise
4 duckdb:duckdb -5.1% -7.6% +2.7% +10.0% ➖ noise
4 duckdb:vortex-file-compressed -3.3% -7.6% +4.6% +10.0% ➖ noise
5 datafusion:vortex-file-compressed -10.6% -4.1% -6.8% +10.0% ➖ noise
5 duckdb:duckdb -1.1% -4.1% +3.1% +10.0% ➖ noise
5 duckdb:vortex-file-compressed -4.4% -4.1% -0.3% +10.0% ➖ noise
6 datafusion:vortex-file-compressed +0.6% -0.7% +1.3% +79.0% ➖ noise
6 duckdb:duckdb -19.3% -0.7% -18.8% +28.2% ➖ noise
6 duckdb:vortex-file-compressed -6.1% -0.7% -5.5% +16.7% ➖ noise
7 datafusion:vortex-file-compressed +3.1% -2.9% +6.1% +10.8% ➖ noise
7 duckdb:duckdb +2.7% -2.9% +5.7% +10.0% ➖ noise
7 duckdb:vortex-file-compressed -4.9% -2.9% -2.1% +10.0% ➖ noise
8 datafusion:vortex-file-compressed -4.4% -4.8% +0.4% +10.0% ➖ noise
8 duckdb:duckdb -1.4% -4.8% +3.6% +10.0% ➖ noise
8 duckdb:vortex-file-compressed -1.4% -4.8% +3.6% +10.0% ➖ noise
9 datafusion:vortex-file-compressed -7.4% -4.8% -2.7% +10.0% ➖ noise
9 duckdb:duckdb -3.5% -4.8% +1.4% +10.0% ➖ noise
9 duckdb:vortex-file-compressed -6.2% -4.8% -1.5% +10.0% ➖ noise
10 datafusion:vortex-file-compressed -2.2% -5.4% +3.3% +10.0% ➖ noise
10 duckdb:duckdb -1.3% -5.4% +4.3% +10.0% ➖ noise
10 duckdb:vortex-file-compressed -3.6% -5.4% +1.9% +10.0% ➖ noise
11 datafusion:vortex-file-compressed -3.5% -5.2% +1.8% +10.0% ➖ noise
11 duckdb:duckdb -2.6% -5.2% +2.7% +10.0% ➖ noise
11 duckdb:vortex-file-compressed -4.9% -5.2% +0.3% +10.0% ➖ noise
12 datafusion:vortex-file-compressed -7.4% -3.8% -3.7% +10.0% ➖ noise
12 duckdb:duckdb -4.5% -3.8% -0.7% +10.0% ➖ noise
12 duckdb:vortex-file-compressed -2.7% -3.8% +1.2% +10.0% ➖ noise
13 datafusion:vortex-file-compressed -8.3% -8.7% +0.5% +10.0% ➖ noise
13 duckdb:duckdb -6.6% -8.7% +2.3% +10.0% ➖ noise
13 duckdb:vortex-file-compressed -4.6% -8.7% +4.6% +10.0% ➖ noise
14 datafusion:vortex-file-compressed -8.4% -5.7% -2.9% +10.0% ➖ noise
14 duckdb:duckdb -2.8% -5.7% +3.1% +10.0% ➖ noise
14 duckdb:vortex-file-compressed -7.2% -5.7% -1.7% +10.0% ➖ noise
15 datafusion:vortex-file-compressed -3.3% -5.9% +2.8% +10.0% ➖ noise
15 duckdb:duckdb -7.0% -5.9% -1.1% +10.0% ➖ noise
15 duckdb:vortex-file-compressed -4.6% -5.9% +1.4% +10.0% ➖ noise
16 datafusion:vortex-file-compressed -7.4% -7.1% -0.3% +10.0% ➖ noise
16 duckdb:duckdb -4.2% -7.1% +3.1% +10.0% ➖ noise
16 duckdb:vortex-file-compressed -3.7% -7.1% +3.7% +10.0% ➖ noise
17 datafusion:vortex-file-compressed -6.5% -6.4% -0.2% +10.0% ➖ noise
17 duckdb:duckdb -5.7% -6.4% +0.7% +10.0% ➖ noise
17 duckdb:vortex-file-compressed -4.5% -6.4% +2.0% +10.0% ➖ noise
18 datafusion:vortex-file-compressed -7.6% -6.6% -1.0% +10.0% ➖ noise
18 duckdb:duckdb -3.8% -6.6% +3.0% +10.0% ➖ noise
18 duckdb:vortex-file-compressed -4.5% -6.6% +2.3% +10.0% ➖ noise
19 datafusion:vortex-file-compressed -3.5% -2.8% -0.7% +26.9% ➖ noise
19 duckdb:duckdb +1.3% -2.8% +4.2% +20.5% ➖ noise
19 duckdb:vortex-file-compressed -8.6% -2.8% -6.0% +24.8% ➖ noise
20 datafusion:vortex-file-compressed -1.0% -5.5% +4.8% +208.9% ➖ noise
20 duckdb:duckdb +7.6% -5.5% +13.9% +23.8% ➖ noise
20 duckdb:vortex-file-compressed -6.4% -5.5% -0.9% +37.7% ➖ noise
21 datafusion:vortex-file-compressed -6.6% -4.5% -2.2% +10.0% ➖ noise
21 duckdb:duckdb -3.7% -4.5% +0.8% +10.0% ➖ noise
21 duckdb:vortex-file-compressed -7.6% -4.5% -3.3% +10.0% ➖ noise
22 datafusion:vortex-file-compressed -5.1% -5.1% +0.1% +13.7% ➖ noise
22 duckdb:duckdb -1.3% -5.1% +4.1% +17.5% ➖ noise
22 duckdb:vortex-file-compressed -17.8% -5.1% -13.4% +18.4% ➖ noise
23 datafusion:vortex-file-compressed -8.8% -7.3% -1.7% +43.8% ➖ noise
23 duckdb:duckdb -3.3% -7.3% +4.3% +10.0% ➖ noise
23 duckdb:vortex-file-compressed +22.5% -7.3% +32.0% +10.0% 🚨 regression
24 datafusion:vortex-file-compressed +1.1% -7.0% +8.7% +10.9% ➖ noise
24 duckdb:duckdb +2.5% -7.0% +10.2% +13.4% ➖ noise
24 duckdb:vortex-file-compressed -13.1% -7.0% -6.6% +15.2% ➖ noise
25 datafusion:vortex-file-compressed -6.3% -3.3% -3.0% +10.0% ➖ noise
25 duckdb:duckdb -1.1% -3.3% +2.3% +10.0% ➖ noise
25 duckdb:vortex-file-compressed -2.8% -3.3% +0.5% +11.6% ➖ noise
26 datafusion:vortex-file-compressed -4.0% -3.0% -1.0% +10.0% ➖ noise
26 duckdb:duckdb -1.5% -3.0% +1.6% +12.0% ➖ noise
26 duckdb:vortex-file-compressed -12.8% -3.0% -10.1% +11.6% ➖ noise
27 datafusion:vortex-file-compressed -2.5% -5.5% +3.2% +10.0% ➖ noise
27 duckdb:duckdb -8.0% -5.5% -2.7% +14.5% ➖ noise
27 duckdb:vortex-file-compressed -3.8% -5.5% +1.8% +10.0% ➖ noise
28 datafusion:vortex-file-compressed -4.2% -8.1% +4.2% +10.0% ➖ noise
28 duckdb:duckdb -1.4% -8.1% +7.3% +10.0% ➖ noise
28 duckdb:vortex-file-compressed -3.8% -8.1% +4.6% +10.0% ➖ noise
29 datafusion:vortex-file-compressed -4.6% -3.2% -1.4% +10.4% ➖ noise
29 duckdb:duckdb +0.5% -3.2% +3.8% +10.0% ➖ noise
29 duckdb:vortex-file-compressed -2.9% -3.2% +0.3% +12.8% ➖ noise
30 datafusion:vortex-file-compressed -5.0% -5.5% +0.5% +10.0% ➖ noise
30 duckdb:duckdb -5.9% -5.5% -0.4% +10.0% ➖ noise
30 duckdb:vortex-file-compressed -6.7% -5.5% -1.3% +10.0% ➖ noise
31 datafusion:vortex-file-compressed -6.4% -5.9% -0.5% +10.0% ➖ noise
31 duckdb:duckdb -5.7% -5.9% +0.2% +10.0% ➖ noise
31 duckdb:vortex-file-compressed -5.5% -5.9% +0.5% +10.0% ➖ noise
32 datafusion:vortex-file-compressed -6.6% -6.5% -0.0% +10.0% ➖ noise
32 duckdb:duckdb -10.3% -6.5% -4.0% +10.0% ➖ noise
32 duckdb:vortex-file-compressed +4.1% -6.5% +11.4% +10.0% 🚨 regression
33 datafusion:vortex-file-compressed -5.6% -6.4% +0.9% +10.0% ➖ noise
33 duckdb:duckdb -11.8% -6.4% -5.7% +10.0% ➖ noise
33 duckdb:vortex-file-compressed -8.8% -6.4% -2.5% +10.0% ➖ noise
34 datafusion:vortex-file-compressed -7.0% -7.7% +0.8% +10.0% ➖ noise
34 duckdb:duckdb -10.7% -7.7% -3.2% +14.3% ➖ noise
34 duckdb:vortex-file-compressed -5.3% -7.7% +2.6% +10.0% ➖ noise
35 datafusion:vortex-file-compressed -4.3% -5.8% +1.6% +10.0% ➖ noise
35 duckdb:duckdb -3.0% -5.8% +3.0% +10.0% ➖ noise
35 duckdb:vortex-file-compressed -5.8% -5.8% -0.0% +10.0% ➖ noise
36 datafusion:vortex-file-compressed -6.0% -8.3% +2.5% +10.9% ➖ noise
36 duckdb:duckdb +1.9% -8.3% +11.1% +16.4% ➖ noise
36 duckdb:vortex-file-compressed -9.4% -8.3% -1.2% +14.1% ➖ noise
37 datafusion:vortex-file-compressed -8.0% -4.3% -3.9% +10.0% ➖ noise
37 duckdb:duckdb +1.9% -4.3% +6.4% +10.0% ➖ noise
37 duckdb:vortex-file-compressed -0.2% -4.3% +4.2% +10.1% ➖ noise
38 datafusion:vortex-file-compressed -4.1% -6.1% +2.0% +11.1% ➖ noise
38 duckdb:duckdb -1.0% -6.1% +5.4% +11.9% ➖ noise
38 duckdb:vortex-file-compressed -9.3% -6.1% -3.5% +15.7% ➖ noise
39 datafusion:vortex-file-compressed -2.5% -2.4% -0.1% +10.0% ➖ noise
39 duckdb:duckdb -9.9% -2.4% -7.8% +18.3% ➖ noise
39 duckdb:vortex-file-compressed -8.7% -2.4% -6.5% +10.0% ➖ noise
40 datafusion:vortex-file-compressed -9.2% -8.9% -0.4% +10.0% ➖ noise
40 duckdb:duckdb +2.3% -8.9% +12.2% +10.4% 🚨 regression
40 duckdb:vortex-file-compressed -9.4% -8.9% -0.6% +10.8% ➖ noise
41 datafusion:vortex-file-compressed -7.6% -3.4% -4.3% +10.0% ➖ noise
41 duckdb:duckdb -0.1% -3.4% +3.5% +10.0% ➖ noise
41 duckdb:vortex-file-compressed -8.1% -3.4% -4.8% +11.1% ➖ noise
42 datafusion:vortex-file-compressed -8.9% -3.2% -5.9% +10.9% ➖ noise
42 duckdb:duckdb +0.5% -3.2% +3.9% +10.3% ➖ noise
42 duckdb:vortex-file-compressed -9.9% -3.2% -6.9% +11.5% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 6, 2026

File Sizes: Clickbench on NVME

File Size Changes (1 files changed, -0.0% overall, 0↑ 1↓)
File Scale Format Base HEAD Change %
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%

Totals:

  • vortex-compact: 7.06 GB → 7.06 GB (-0.0%)
  • vortex-file-compressed: 14.01 GB → 14.01 GB (0.0%)

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 6, 2026

Benchmarks: TPC-H SF=1 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -8.4%
Vortex (geomean): 0.962x ➖
Parquet (geomean): 1.050x ➖
Shifts: Parquet (control) +5.0% · Median polish +0.3%


datafusion / vortex-file-compressed (0.961x ➖, 1↑ 1↓)
name PR a1d2e1e (ns) base eda8c2c (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 265255857 255958942 1.04
tpch_q02/datafusion:vortex-file-compressed 456126090 415420846 1.10
tpch_q03/datafusion:vortex-file-compressed 432160300 490899488 0.88
tpch_q04/datafusion:vortex-file-compressed 🚨 449151246 341807490 1.31
tpch_q05/datafusion:vortex-file-compressed 477390785 457966971 1.04
tpch_q06/datafusion:vortex-file-compressed 420688697 405040450 1.04
tpch_q07/datafusion:vortex-file-compressed 526908759 463481715 1.14
tpch_q08/datafusion:vortex-file-compressed 637651931 646491709 0.99
tpch_q09/datafusion:vortex-file-compressed 398169640 425662910 0.94
tpch_q10/datafusion:vortex-file-compressed 479259804 486795047 0.98
tpch_q11/datafusion:vortex-file-compressed 302419767 308161031 0.98
tpch_q12/datafusion:vortex-file-compressed 524556374 554962023 0.95
tpch_q13/datafusion:vortex-file-compressed 🚀 140637243 212122722 0.66
tpch_q14/datafusion:vortex-file-compressed 302726884 288233330 1.05
tpch_q15/datafusion:vortex-file-compressed 512638210 543078385 0.94
tpch_q16/datafusion:vortex-file-compressed 229418163 300408567 0.76
tpch_q17/datafusion:vortex-file-compressed 369372296 464107818 0.80
tpch_q18/datafusion:vortex-file-compressed 370810502 385172005 0.96
tpch_q19/datafusion:vortex-file-compressed 422684598 524706375 0.81
tpch_q20/datafusion:vortex-file-compressed 519675776 514447995 1.01
tpch_q21/datafusion:vortex-file-compressed 778209791 614034993 1.27
tpch_q22/datafusion:vortex-file-compressed 127053180 164302793 0.77
datafusion / vortex-compact (0.938x ➖, 3↑ 0↓)
name PR a1d2e1e (ns) base eda8c2c (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 270934169 257458158 1.05
tpch_q02/datafusion:vortex-compact 512845690 458007683 1.12
tpch_q03/datafusion:vortex-compact 467911895 439320518 1.07
tpch_q04/datafusion:vortex-compact 🚀 294286566 462503389 0.64
tpch_q05/datafusion:vortex-compact 🚀 471498503 750538260 0.63
tpch_q06/datafusion:vortex-compact 313170058 426398480 0.73
tpch_q07/datafusion:vortex-compact 398443681 417289327 0.95
tpch_q08/datafusion:vortex-compact 551042636 613853528 0.90
tpch_q09/datafusion:vortex-compact 426804900 486526050 0.88
tpch_q10/datafusion:vortex-compact 🚀 443650365 680148223 0.65
tpch_q11/datafusion:vortex-compact 295581720 326060158 0.91
tpch_q12/datafusion:vortex-compact 567593292 487432071 1.16
tpch_q13/datafusion:vortex-compact 192101011 255596306 0.75
tpch_q14/datafusion:vortex-compact 298619189 291628844 1.02
tpch_q15/datafusion:vortex-compact 509025718 440326483 1.16
tpch_q16/datafusion:vortex-compact 193971900 185633100 1.04
tpch_q17/datafusion:vortex-compact 358670545 423925717 0.85
tpch_q18/datafusion:vortex-compact 353488944 310002429 1.14
tpch_q19/datafusion:vortex-compact 572051397 462164322 1.24
tpch_q20/datafusion:vortex-compact 499567304 479351205 1.04
tpch_q21/datafusion:vortex-compact 593599811 574341609 1.03
tpch_q22/datafusion:vortex-compact 105123586 97712211 1.08
datafusion / parquet (1.075x ➖, 0↑ 3↓)
name PR a1d2e1e (ns) base eda8c2c (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 232380527 224625995 1.03
tpch_q02/datafusion:parquet 395222911 414015172 0.95
tpch_q03/datafusion:parquet 381518267 308850612 1.24
tpch_q04/datafusion:parquet 199373619 164342477 1.21
tpch_q05/datafusion:parquet 558934910 481541217 1.16
tpch_q06/datafusion:parquet 🚨 222648997 165975058 1.34
tpch_q07/datafusion:parquet 492669879 498744603 0.99
tpch_q08/datafusion:parquet 677396138 572016952 1.18
tpch_q09/datafusion:parquet 🚨 790146133 473878299 1.67
tpch_q10/datafusion:parquet 🚨 883609463 521350889 1.69
tpch_q11/datafusion:parquet 321788134 436614200 0.74
tpch_q12/datafusion:parquet 234178324 275003899 0.85
tpch_q13/datafusion:parquet 443228030 455205985 0.97
tpch_q14/datafusion:parquet 185283841 206764986 0.90
tpch_q15/datafusion:parquet 330533207 338003205 0.98
tpch_q16/datafusion:parquet 173587710 194589339 0.89
tpch_q17/datafusion:parquet 438516292 371186313 1.18
tpch_q18/datafusion:parquet 447351625 465734529 0.96
tpch_q19/datafusion:parquet 324649085 366527535 0.89
tpch_q20/datafusion:parquet 330800144 318347806 1.04
tpch_q21/datafusion:parquet 686813844 586543601 1.17
tpch_q22/datafusion:parquet 182813757 166657703 1.10
duckdb / vortex-file-compressed (0.993x ➖, 0↑ 0↓)
name PR a1d2e1e (ns) base eda8c2c (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 271224290 297913860 0.91
tpch_q02/duckdb:vortex-file-compressed 973504858 993101434 0.98
tpch_q03/duckdb:vortex-file-compressed 680002882 734220457 0.93
tpch_q04/duckdb:vortex-file-compressed 481597819 398305330 1.21
tpch_q05/duckdb:vortex-file-compressed 1001644852 1033810854 0.97
tpch_q06/duckdb:vortex-file-compressed 409379971 402253018 1.02
tpch_q07/duckdb:vortex-file-compressed 795966811 831931167 0.96
tpch_q08/duckdb:vortex-file-compressed 1003592826 1003093781 1.00
tpch_q09/duckdb:vortex-file-compressed 870667368 872320013 1.00
tpch_q10/duckdb:vortex-file-compressed 776858872 787693370 0.99
tpch_q11/duckdb:vortex-file-compressed 535039824 524231270 1.02
tpch_q12/duckdb:vortex-file-compressed 463811547 520420294 0.89
tpch_q13/duckdb:vortex-file-compressed 475992110 481575789 0.99
tpch_q14/duckdb:vortex-file-compressed 525452469 536513724 0.98
tpch_q15/duckdb:vortex-file-compressed 286494625 288169330 0.99
tpch_q16/duckdb:vortex-file-compressed 387142971 396346088 0.98
tpch_q17/duckdb:vortex-file-compressed 699742803 686629348 1.02
tpch_q18/duckdb:vortex-file-compressed 555047941 528410614 1.05
tpch_q19/duckdb:vortex-file-compressed 457568329 443879445 1.03
tpch_q20/duckdb:vortex-file-compressed 853454925 851752891 1.00
tpch_q21/duckdb:vortex-file-compressed 1096498608 1113926803 0.98
tpch_q22/duckdb:vortex-file-compressed 387471661 393650314 0.98
duckdb / vortex-compact (0.957x ➖, 0↑ 0↓)
name PR a1d2e1e (ns) base eda8c2c (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 319197163 285732369 1.12
tpch_q02/duckdb:vortex-compact 952094237 932143922 1.02
tpch_q03/duckdb:vortex-compact 650987408 653287287 1.00
tpch_q04/duckdb:vortex-compact 380681644 392770302 0.97
tpch_q05/duckdb:vortex-compact 943103926 923177413 1.02
tpch_q06/duckdb:vortex-compact 420660960 448028499 0.94
tpch_q07/duckdb:vortex-compact 828135426 861465639 0.96
tpch_q08/duckdb:vortex-compact 978360713 968135484 1.01
tpch_q09/duckdb:vortex-compact 874025815 970732780 0.90
tpch_q10/duckdb:vortex-compact 686052944 679775642 1.01
tpch_q11/duckdb:vortex-compact 503393161 457795192 1.10
tpch_q12/duckdb:vortex-compact 471397066 483940815 0.97
tpch_q13/duckdb:vortex-compact 435110681 448926207 0.97
tpch_q14/duckdb:vortex-compact 463263258 500230979 0.93
tpch_q15/duckdb:vortex-compact 280228632 306908140 0.91
tpch_q16/duckdb:vortex-compact 342968835 410500228 0.84
tpch_q17/duckdb:vortex-compact 639211336 653548143 0.98
tpch_q18/duckdb:vortex-compact 471001410 514183106 0.92
tpch_q19/duckdb:vortex-compact 437360047 561347957 0.78
tpch_q20/duckdb:vortex-compact 734964600 867965940 0.85
tpch_q21/duckdb:vortex-compact 1024513414 1127667947 0.91
tpch_q22/duckdb:vortex-compact 381721154 371143342 1.03
duckdb / parquet (1.026x ➖, 0↑ 0↓)
name PR a1d2e1e (ns) base eda8c2c (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 478915320 479271499 1.00
tpch_q02/duckdb:parquet 1175578404 1146445615 1.03
tpch_q03/duckdb:parquet 1126294921 1058153226 1.06
tpch_q04/duckdb:parquet 672518551 646942683 1.04
tpch_q05/duckdb:parquet 1277400399 1276672447 1.00
tpch_q06/duckdb:parquet 457477484 486895208 0.94
tpch_q07/duckdb:parquet 1237858353 1103721461 1.12
tpch_q08/duckdb:parquet 1552449935 1644767166 0.94
tpch_q09/duckdb:parquet 1566000280 1576431913 0.99
tpch_q10/duckdb:parquet 1388457778 1316196403 1.05
tpch_q11/duckdb:parquet 814733108 744961074 1.09
tpch_q12/duckdb:parquet 706029939 729556978 0.97
tpch_q13/duckdb:parquet 915433588 929506567 0.98
tpch_q14/duckdb:parquet 712668276 653190782 1.09
tpch_q15/duckdb:parquet 569635381 515897297 1.10
tpch_q16/duckdb:parquet 656428562 689163067 0.95
tpch_q17/duckdb:parquet 840787439 826561335 1.02
tpch_q18/duckdb:parquet 893137551 865198795 1.03
tpch_q19/duckdb:parquet 823173700 813154953 1.01
tpch_q20/duckdb:parquet 1254037206 1124536815 1.12
tpch_q21/duckdb:parquet 1042862448 1066407864 0.98
tpch_q22/duckdb:parquet 601906114 566369906 1.06
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact +5.2% +1.7% +3.5% +70.5% ➖ noise
1 datafusion:vortex-file-compressed +3.6% +1.7% +1.9% +60.5% ➖ noise
1 duckdb:vortex-compact +11.7% +1.7% +9.9% +43.3% ➖ noise
1 duckdb:vortex-file-compressed -9.0% +1.7% -10.5% +54.5% ➖ noise
2 datafusion:vortex-compact +12.0% -1.1% +13.2% +33.8% ➖ noise
2 datafusion:vortex-file-compressed +9.8% -1.1% +11.0% +30.0% ➖ noise
2 duckdb:vortex-compact +2.1% -1.1% +3.2% +30.0% ➖ noise
2 duckdb:vortex-file-compressed -2.0% -1.1% -0.9% +30.0% ➖ noise
3 datafusion:vortex-compact +6.5% +14.7% -7.1% +62.4% ➖ noise
3 datafusion:vortex-file-compressed -12.0% +14.7% -23.2% +48.1% ➖ noise
3 duckdb:vortex-compact -0.4% +14.7% -13.1% +30.0% ➖ noise
3 duckdb:vortex-file-compressed -7.4% +14.7% -19.2% +30.0% ➖ noise
4 datafusion:vortex-compact -36.4% +12.3% -43.3% +47.4% ✅ faster
4 datafusion:vortex-file-compressed +31.4% +12.3% +17.0% +60.3% ➖ noise
4 duckdb:vortex-compact -3.1% +12.3% -13.7% +30.0% ➖ noise
4 duckdb:vortex-file-compressed +20.9% +12.3% +7.7% +40.5% ➖ noise
5 datafusion:vortex-compact -37.2% +7.8% -41.7% +40.5% ✅ faster
5 datafusion:vortex-file-compressed +4.2% +7.8% -3.3% +30.0% ➖ noise
5 duckdb:vortex-compact +2.2% +7.8% -5.2% +30.0% ➖ noise
5 duckdb:vortex-file-compressed -3.1% +7.8% -10.1% +30.0% ➖ noise
6 datafusion:vortex-compact -26.6% +12.3% -34.6% +30.3% ✅ faster
6 datafusion:vortex-file-compressed +3.9% +12.3% -7.5% +30.0% ➖ noise
6 duckdb:vortex-compact -6.1% +12.3% -16.4% +30.0% ➖ noise
6 duckdb:vortex-file-compressed +1.8% +12.3% -9.3% +30.0% ➖ noise
7 datafusion:vortex-compact -4.5% +5.3% -9.3% +30.0% ➖ noise
7 datafusion:vortex-file-compressed +13.7% +5.3% +8.0% +30.0% ➖ noise
7 duckdb:vortex-compact -3.9% +5.3% -8.7% +30.0% ➖ noise
7 duckdb:vortex-file-compressed -4.3% +5.3% -9.1% +30.0% ➖ noise
8 datafusion:vortex-compact -10.2% +5.7% -15.1% +30.0% ➖ noise
8 datafusion:vortex-file-compressed -1.4% +5.7% -6.7% +30.0% ➖ noise
8 duckdb:vortex-compact +1.1% +5.7% -4.4% +30.0% ➖ noise
8 duckdb:vortex-file-compressed +0.0% +5.7% -5.4% +30.0% ➖ noise
9 datafusion:vortex-compact -12.3% +28.7% -31.8% +30.0% ✅ faster
9 datafusion:vortex-file-compressed -6.5% +28.7% -27.3% +30.0% ✅ faster
9 duckdb:vortex-compact -10.0% +28.7% -30.0% +30.0% ✅ faster
9 duckdb:vortex-file-compressed -0.2% +28.7% -22.4% +30.0% ➖ noise
10 datafusion:vortex-compact -34.8% +33.7% -51.2% +40.5% ✅ faster
10 datafusion:vortex-file-compressed -1.5% +33.7% -26.4% +33.3% ✅ faster
10 duckdb:vortex-compact +0.9% +33.7% -24.5% +36.3% ➖ noise
10 duckdb:vortex-file-compressed -1.4% +33.7% -26.2% +31.5% ✅ faster
11 datafusion:vortex-compact -9.3% -10.2% +1.0% +30.0% ➖ noise
11 datafusion:vortex-file-compressed -1.9% -10.2% +9.3% +30.0% ➖ noise
11 duckdb:vortex-compact +10.0% -10.2% +22.5% +30.0% ➖ noise
11 duckdb:vortex-file-compressed +2.1% -10.2% +13.7% +30.0% ➖ noise
12 datafusion:vortex-compact +16.4% -9.2% +28.3% +35.8% ➖ noise
12 datafusion:vortex-file-compressed -5.5% -9.2% +4.1% +30.0% ➖ noise
12 duckdb:vortex-compact -2.6% -9.2% +7.3% +30.0% ➖ noise
12 duckdb:vortex-file-compressed -10.9% -9.2% -1.8% +30.0% ➖ noise
13 datafusion:vortex-compact -24.8% -2.1% -23.3% +49.0% ➖ noise
13 datafusion:vortex-file-compressed -33.7% -2.1% -32.3% +37.7% ✅ faster
13 duckdb:vortex-compact -3.1% -2.1% -1.0% +30.0% ➖ noise
13 duckdb:vortex-file-compressed -1.2% -2.1% +0.9% +35.7% ➖ noise
14 datafusion:vortex-compact +2.4% -1.1% +3.6% +37.7% ➖ noise
14 datafusion:vortex-file-compressed +5.0% -1.1% +6.2% +30.5% ➖ noise
14 duckdb:vortex-compact -7.4% -1.1% -6.3% +30.0% ➖ noise
14 duckdb:vortex-file-compressed -2.1% -1.1% -1.0% +30.0% ➖ noise
15 datafusion:vortex-compact +15.6% +3.9% +11.3% +53.4% ➖ noise
15 datafusion:vortex-file-compressed -5.6% +3.9% -9.2% +54.4% ➖ noise
15 duckdb:vortex-compact -8.7% +3.9% -12.1% +54.7% ➖ noise
15 duckdb:vortex-file-compressed -0.6% +3.9% -4.3% +60.7% ➖ noise
16 datafusion:vortex-compact +4.5% -7.8% +13.4% +30.0% ➖ noise
16 datafusion:vortex-file-compressed -23.6% -7.8% -17.2% +33.1% ➖ noise
16 duckdb:vortex-compact -16.5% -7.8% -9.4% +30.0% ➖ noise
16 duckdb:vortex-file-compressed -2.3% -7.8% +6.0% +30.0% ➖ noise
17 datafusion:vortex-compact -15.4% +9.6% -22.8% +30.0% ➖ noise
17 datafusion:vortex-file-compressed -20.4% +9.6% -27.4% +30.0% ✅ faster
17 duckdb:vortex-compact -2.2% +9.6% -10.8% +30.0% ➖ noise
17 duckdb:vortex-file-compressed +1.9% +9.6% -7.0% +30.0% ➖ noise
18 datafusion:vortex-compact +14.0% -0.4% +14.5% +30.0% ➖ noise
18 datafusion:vortex-file-compressed -3.7% -0.4% -3.3% +30.0% ➖ noise
18 duckdb:vortex-compact -8.4% -0.4% -8.0% +30.0% ➖ noise
18 duckdb:vortex-file-compressed +5.0% -0.4% +5.5% +30.0% ➖ noise
19 datafusion:vortex-compact +23.8% -5.3% +30.7% +30.0% 🚨 regression
19 datafusion:vortex-file-compressed -19.4% -5.3% -14.9% +30.0% ➖ noise
19 duckdb:vortex-compact -22.1% -5.3% -17.7% +30.0% ➖ noise
19 duckdb:vortex-file-compressed +3.1% -5.3% +8.9% +30.0% ➖ noise
20 datafusion:vortex-compact +4.2% +7.6% -3.2% +30.0% ➖ noise
20 datafusion:vortex-file-compressed +1.0% +7.6% -6.2% +30.0% ➖ noise
20 duckdb:vortex-compact -15.3% +7.6% -21.3% +30.0% ➖ noise
20 duckdb:vortex-file-compressed +0.2% +7.6% -6.9% +30.0% ➖ noise
21 datafusion:vortex-compact +3.4% +7.0% -3.4% +30.0% ➖ noise
21 datafusion:vortex-file-compressed +26.7% +7.0% +18.4% +30.0% ➖ noise
21 duckdb:vortex-compact -9.1% +7.0% -15.1% +30.0% ➖ noise
21 duckdb:vortex-file-compressed -1.6% +7.0% -8.0% +30.0% ➖ noise
22 datafusion:vortex-compact +7.6% +8.0% -0.4% +30.0% ➖ noise
22 datafusion:vortex-file-compressed -22.7% +8.0% -28.4% +39.6% ✅ faster
22 duckdb:vortex-compact +2.9% +8.0% -4.7% +30.0% ➖ noise
22 duckdb:vortex-file-compressed -1.6% +8.0% -8.8% +30.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 6, 2026

Benchmarks: Compression

Vortex (geomean): 1.007x ➖
Parquet (geomean): 1.017x ➖


unknown / unknown (1.022x ➖, 1↑ 9↓)
name PR a1d2e1e (ns) base eda8c2c (ns) ratio (PR/base)
compress time/Arade 1197523402 1132211167 1.06
compress time/Bimbo 7144719835 6905971377 1.03
compress time/CMSprovider 2930225750 2854572254 1.03
compress time/Euro2016 455838881 432244538 1.05
compress time/Food 406941042 395309946 1.03
compress time/HashTags 850407876 827735538 1.03
compress time/TPC-H l_comment canonical 1367159320 1309547144 1.04
compress time/TPC-H l_comment chunked 1367859370 1307406556 1.05
compress time/taxi 740254945 717188510 1.03
compress time/wide table cols=100 chunks=1 rows=1000 12860714 11708979 1.10
compress time/wide table cols=100 chunks=50 rows=1000 11846142 11942692 0.99
compress time/wide table cols=1000 chunks=1 rows=1000 126375225 132720428 0.95
compress time/wide table cols=1000 chunks=50 rows=1000 132352197 129759097 1.02
compress time/wide table cols=10000 chunks=1 rows=1000 1509153879 1427418785 1.06
compress time/wide table cols=10000 chunks=50 rows=1000 1487306937 1462705500 1.02
decompress time/Arade 27099333 25660918 1.06
decompress time/Bimbo 82751140 81003277 1.02
decompress time/CMSprovider 🚨 86692378 74153567 1.17
decompress time/Euro2016 19836734 18315572 1.08
decompress time/Food 8225968 7949861 1.03
decompress time/HashTags 71515033 69710959 1.03
decompress time/TPC-H l_comment canonical 41389802 39080444 1.06
decompress time/TPC-H l_comment chunked 42251166 39227947 1.08
decompress time/taxi 15362373 16906881 0.91
decompress time/wide table cols=100 chunks=1 rows=1000 🚨 2727727 2380075 1.15
decompress time/wide table cols=100 chunks=50 rows=1000 🚨 2696594 2422821 1.11
decompress time/wide table cols=1000 chunks=1 rows=1000 23846740 22614972 1.05
decompress time/wide table cols=1000 chunks=50 rows=1000 🚨 25253687 22709462 1.11
decompress time/wide table cols=10000 chunks=1 rows=1000 🚨 282027075 252205106 1.12
decompress time/wide table cols=10000 chunks=50 rows=1000 285919371 261694312 1.09
parquet size/Arade 258014282 258014282 1.00
parquet size/Bimbo 384517292 384517292 1.00
parquet size/CMSprovider 376885545 376885545 1.00
parquet size/Euro2016 122975499 122975499 1.00
parquet size/Food 35699500 35699500 1.00
parquet size/HashTags 133510943 133510943 1.00
parquet size/TPC-H l_comment canonical 158358238 158358238 1.00
parquet size/TPC-H l_comment chunked 158358238 158358238 1.00
parquet size/taxi 55283635 55283635 1.00
parquet size/wide table cols=100 chunks=1 rows=1000 932404 932404 1.00
parquet size/wide table cols=100 chunks=50 rows=1000 932404 932404 1.00
parquet size/wide table cols=1000 chunks=1 rows=1000 9324004 9324004 1.00
parquet size/wide table cols=1000 chunks=50 rows=1000 9324004 9324004 1.00
parquet size/wide table cols=10000 chunks=1 rows=1000 93240004 93240004 1.00
parquet size/wide table cols=10000 chunks=50 rows=1000 93240004 93240004 1.00
parquet_rs-zstd compress time/Arade 2638698212 2635948553 1.00
parquet_rs-zstd compress time/Bimbo 12743429259 12623939810 1.01
parquet_rs-zstd compress time/CMSprovider 7211109223 6777851624 1.06
parquet_rs-zstd compress time/Euro2016 1337866113 1295501878 1.03
parquet_rs-zstd compress time/Food 804663462 789518088 1.02
parquet_rs-zstd compress time/HashTags 2271458325 2124649174 1.07
parquet_rs-zstd compress time/TPC-H l_comment canonical 3268216987 3161765521 1.03
parquet_rs-zstd compress time/TPC-H l_comment chunked 3276200536 3138465573 1.04
parquet_rs-zstd compress time/taxi 1230098602 1203645132 1.02
parquet_rs-zstd compress time/wide table cols=100 chunks=1 rows=1000 🚨 6797534 6020093 1.13
parquet_rs-zstd compress time/wide table cols=100 chunks=50 rows=1000 6487900 6141940 1.06
parquet_rs-zstd compress time/wide table cols=1000 chunks=1 rows=1000 78847186 73759588 1.07
parquet_rs-zstd compress time/wide table cols=1000 chunks=50 rows=1000 79970038 73424143 1.09
parquet_rs-zstd compress time/wide table cols=10000 chunks=1 rows=1000 803339123 789082101 1.02
parquet_rs-zstd compress time/wide table cols=10000 chunks=50 rows=1000 781729288 806014981 0.97
parquet_rs-zstd decompress time/Arade 626863762 629557428 1.00
parquet_rs-zstd decompress time/Bimbo 1700150985 1679079170 1.01
parquet_rs-zstd decompress time/CMSprovider 1743035253 1689325886 1.03
parquet_rs-zstd decompress time/Euro2016 382747915 372475899 1.03
parquet_rs-zstd decompress time/Food 201230434 197295756 1.02
parquet_rs-zstd decompress time/HashTags 🚨 680516194 616511702 1.10
parquet_rs-zstd decompress time/TPC-H l_comment canonical 598222997 589301567 1.02
parquet_rs-zstd decompress time/TPC-H l_comment chunked 597705147 584158824 1.02
parquet_rs-zstd decompress time/taxi 246440042 247148674 1.00
parquet_rs-zstd decompress time/wide table cols=100 chunks=1 rows=1000 2891169 2777299 1.04
parquet_rs-zstd decompress time/wide table cols=100 chunks=50 rows=1000 2920799 2855851 1.02
parquet_rs-zstd decompress time/wide table cols=1000 chunks=1 rows=1000 34341448 32118713 1.07
parquet_rs-zstd decompress time/wide table cols=1000 chunks=50 rows=1000 35554180 32731332 1.09
parquet_rs-zstd decompress time/wide table cols=10000 chunks=1 rows=1000 352221234 345497896 1.02
parquet_rs-zstd decompress time/wide table cols=10000 chunks=50 rows=1000 348062878 342171710 1.02
vortex-file-compressed size/Arade 145363796 145363796 1.00
vortex-file-compressed size/Bimbo 468763332 468763332 1.00
vortex-file-compressed size/CMSprovider 417907812 417907812 1.00
vortex-file-compressed size/Euro2016 163364604 163757340 1.00
vortex-file-compressed size/Food 41926936 41926936 1.00
vortex-file-compressed size/HashTags 195647828 195647828 1.00
vortex-file-compressed size/TPC-H l_comment canonical 179087360 179087360 1.00
vortex-file-compressed size/TPC-H l_comment chunked 179087360 179087360 1.00
vortex-file-compressed size/taxi 52363948 52363948 1.00
vortex-file-compressed size/wide table cols=100 chunks=1 rows=1000 930848 930848 1.00
vortex-file-compressed size/wide table cols=100 chunks=50 rows=1000 930848 930848 1.00
vortex-file-compressed size/wide table cols=1000 chunks=1 rows=1000 9293648 9293648 1.00
vortex-file-compressed size/wide table cols=1000 chunks=50 rows=1000 9293648 9293648 1.00
vortex-file-compressed size/wide table cols=10000 chunks=1 rows=1000 92957648 92957648 1.00
vortex-file-compressed size/wide table cols=10000 chunks=50 rows=1000 92957648 92957648 1.00
vortex:parquet-zstd ratio compress time/Arade 0 0 1.06
vortex:parquet-zstd ratio compress time/Bimbo 0 0 1.02
vortex:parquet-zstd ratio compress time/CMSprovider 0 0 0.96
vortex:parquet-zstd ratio compress time/Euro2016 0 0 1.02
vortex:parquet-zstd ratio compress time/Food 0 0 1.01
vortex:parquet-zstd ratio compress time/HashTags 0 0 0.96
vortex:parquet-zstd ratio compress time/TPC-H l_comment canonical 0 0 1.01
vortex:parquet-zstd ratio compress time/TPC-H l_comment chunked 0 0 1.00
vortex:parquet-zstd ratio compress time/taxi 0 0 1.01
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=1 rows=1000 1 1 0.97
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=50 rows=1000 1 1 0.94
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=1 rows=1000 🚀 1 1 0.89
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=50 rows=1000 1 1 0.94
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=1 rows=1000 1 1 1.04
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=50 rows=1000 1 1 1.05
vortex:parquet-zstd ratio decompress time/Arade 0 0 1.06
vortex:parquet-zstd ratio decompress time/Bimbo 0 0 1.01
vortex:parquet-zstd ratio decompress time/CMSprovider 🚨 0 0 1.13
vortex:parquet-zstd ratio decompress time/Euro2016 0 0 1.05
vortex:parquet-zstd ratio decompress time/Food 0 0 1.01
vortex:parquet-zstd ratio decompress time/HashTags 0 0 0.93
vortex:parquet-zstd ratio decompress time/TPC-H l_comment canonical 0 0 1.04
vortex:parquet-zstd ratio decompress time/TPC-H l_comment chunked 0 0 1.05
vortex:parquet-zstd ratio decompress time/taxi 0 0 0.91
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=1 rows=1000 🚨 0 0 1.10
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=50 rows=1000 0 0 1.09
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=1 rows=1000 0 0 0.99
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=50 rows=1000 0 0 1.02
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=1 rows=1000 0 0 1.10
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=50 rows=1000 0 0 1.07
vortex:parquet-zstd size/Arade 0 0 1.00
vortex:parquet-zstd size/Bimbo 1 1 1.00
vortex:parquet-zstd size/CMSprovider 1 1 1.00
vortex:parquet-zstd size/Euro2016 1 1 1.00
vortex:parquet-zstd size/Food 1 1 1.00
vortex:parquet-zstd size/HashTags 1 1 1.00
vortex:parquet-zstd size/TPC-H l_comment canonical 1 1 1.00
vortex:parquet-zstd size/TPC-H l_comment chunked 1 1 1.00
vortex:parquet-zstd size/taxi 0 0 1.00
vortex:parquet-zstd size/wide table cols=100 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=100 chunks=50 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=1000 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=1000 chunks=50 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=10000 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=10000 chunks=50 rows=1000 0 0 1.00

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 6, 2026

Benchmarks: TPC-H SF=10 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +1.7%
Vortex (geomean): 1.032x ➖
Parquet (geomean): 1.014x ➖
Shifts: Parquet (control) +1.4% · Median polish +3.0%


datafusion / vortex-file-compressed (1.099x ➖, 0↑ 3↓)
name PR a1d2e1e (ns) base eda8c2c (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 806901300 710578820 1.14
tpch_q02/datafusion:vortex-file-compressed 1121506245 1005959440 1.11
tpch_q03/datafusion:vortex-file-compressed 1064390500 940542210 1.13
tpch_q04/datafusion:vortex-file-compressed 🚨 866103183 665134733 1.30
tpch_q05/datafusion:vortex-file-compressed 1222788154 1074317600 1.14
tpch_q06/datafusion:vortex-file-compressed 710420281 637932696 1.11
tpch_q07/datafusion:vortex-file-compressed 1048982833 1223297894 0.86
tpch_q08/datafusion:vortex-file-compressed 🚨 2052752071 1270243522 1.62
tpch_q09/datafusion:vortex-file-compressed 1712409763 1363208132 1.26
tpch_q10/datafusion:vortex-file-compressed 1105076731 984671498 1.12
tpch_q11/datafusion:vortex-file-compressed 563140492 589575953 0.96
tpch_q12/datafusion:vortex-file-compressed 1096568652 897197788 1.22
tpch_q13/datafusion:vortex-file-compressed 460104988 456672103 1.01
tpch_q14/datafusion:vortex-file-compressed 679762317 633888938 1.07
tpch_q15/datafusion:vortex-file-compressed 1193760756 1102093783 1.08
tpch_q16/datafusion:vortex-file-compressed 425340511 371485422 1.14
tpch_q17/datafusion:vortex-file-compressed 1208729801 1291664093 0.94
tpch_q18/datafusion:vortex-file-compressed 1334169043 1459751237 0.91
tpch_q19/datafusion:vortex-file-compressed 778211939 900738360 0.86
tpch_q20/datafusion:vortex-file-compressed 1041898292 1083919314 0.96
tpch_q21/datafusion:vortex-file-compressed 1901572473 2052670875 0.93
tpch_q22/datafusion:vortex-file-compressed 🚨 680761704 404076140 1.68
datafusion / vortex-compact (0.968x ➖, 0↑ 0↓)
name PR a1d2e1e (ns) base eda8c2c (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 684195593 738888855 0.93
tpch_q02/datafusion:vortex-compact 632249552 672005175 0.94
tpch_q03/datafusion:vortex-compact 748936329 719828402 1.04
tpch_q04/datafusion:vortex-compact 573401552 676875876 0.85
tpch_q05/datafusion:vortex-compact 862903268 1000663841 0.86
tpch_q06/datafusion:vortex-compact 569639396 676877744 0.84
tpch_q07/datafusion:vortex-compact 964050564 952389302 1.01
tpch_q08/datafusion:vortex-compact 1157942421 1205736733 0.96
tpch_q09/datafusion:vortex-compact 1140231578 1299868876 0.88
tpch_q10/datafusion:vortex-compact 1051329799 856868524 1.23
tpch_q11/datafusion:vortex-compact 479767095 425691668 1.13
tpch_q12/datafusion:vortex-compact 784195030 1080367488 0.73
tpch_q13/datafusion:vortex-compact 424574643 468562009 0.91
tpch_q14/datafusion:vortex-compact 589485149 673351296 0.88
tpch_q15/datafusion:vortex-compact 1286207461 1063259474 1.21
tpch_q16/datafusion:vortex-compact 369456117 349098190 1.06
tpch_q17/datafusion:vortex-compact 1232973914 1201462358 1.03
tpch_q18/datafusion:vortex-compact 1071612789 1086300962 0.99
tpch_q19/datafusion:vortex-compact 822521693 747929996 1.10
tpch_q20/datafusion:vortex-compact 878214958 998586759 0.88
tpch_q21/datafusion:vortex-compact 1405198163 1605052996 0.88
tpch_q22/datafusion:vortex-compact 434221180 368949074 1.18
datafusion / parquet (1.088x ➖, 0↑ 4↓)
name PR a1d2e1e (ns) base eda8c2c (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 832370641 834701096 1.00
tpch_q02/datafusion:parquet 909473046 911777214 1.00
tpch_q03/datafusion:parquet 1056641223 882703025 1.20
tpch_q04/datafusion:parquet 🚨 568972006 412745119 1.38
tpch_q05/datafusion:parquet 1209895851 1174878105 1.03
tpch_q06/datafusion:parquet 533655539 533322306 1.00
tpch_q07/datafusion:parquet 🚨 1857378782 1321446200 1.41
tpch_q08/datafusion:parquet 🚨 2113333904 1554723453 1.36
tpch_q09/datafusion:parquet 1923667247 2109542347 0.91
tpch_q10/datafusion:parquet 2034484435 2002092475 1.02
tpch_q11/datafusion:parquet 617110610 532749638 1.16
tpch_q12/datafusion:parquet 699284158 699445254 1.00
tpch_q13/datafusion:parquet 775982255 700810513 1.11
tpch_q14/datafusion:parquet 845515537 798268669 1.06
tpch_q15/datafusion:parquet 1283887135 1256878174 1.02
tpch_q16/datafusion:parquet 423279449 367591963 1.15
tpch_q17/datafusion:parquet 1385876511 1321300705 1.05
tpch_q18/datafusion:parquet 1730014876 1513006784 1.14
tpch_q19/datafusion:parquet 1164606941 924728675 1.26
tpch_q20/datafusion:parquet 🚨 1769030255 1252239192 1.41
tpch_q21/datafusion:parquet 1856873190 2105498822 0.88
tpch_q22/datafusion:parquet 782400889 1102589224 0.71
duckdb / vortex-file-compressed (1.006x ➖, 0↑ 1↓)
name PR a1d2e1e (ns) base eda8c2c (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 622532355 611815368 1.02
tpch_q02/duckdb:vortex-file-compressed 1308830668 1251056466 1.05
tpch_q03/duckdb:vortex-file-compressed 1041576135 967299787 1.08
tpch_q04/duckdb:vortex-file-compressed 769673728 594355356 1.29
tpch_q05/duckdb:vortex-file-compressed 1249503884 1133745639 1.10
tpch_q06/duckdb:vortex-file-compressed 852451645 805145430 1.06
tpch_q07/duckdb:vortex-file-compressed 1304677642 1236491643 1.06
tpch_q08/duckdb:vortex-file-compressed 1583527120 1406769643 1.13
tpch_q09/duckdb:vortex-file-compressed 1500887039 1549001884 0.97
tpch_q10/duckdb:vortex-file-compressed 1253320399 1207733501 1.04
tpch_q11/duckdb:vortex-file-compressed 634974316 704900083 0.90
tpch_q12/duckdb:vortex-file-compressed 809191195 855396361 0.95
tpch_q13/duckdb:vortex-file-compressed 1254800236 968384239 1.30
tpch_q14/duckdb:vortex-file-compressed 1048189156 1217100576 0.86
tpch_q15/duckdb:vortex-file-compressed 630401693 753437053 0.84
tpch_q16/duckdb:vortex-file-compressed 🚨 820468161 614693423 1.33
tpch_q17/duckdb:vortex-file-compressed 1029592065 1311221723 0.79
tpch_q18/duckdb:vortex-file-compressed 1166794600 1155384942 1.01
tpch_q19/duckdb:vortex-file-compressed 840058175 1092291131 0.77
tpch_q20/duckdb:vortex-file-compressed 1346309664 1528688067 0.88
tpch_q21/duckdb:vortex-file-compressed 2376089300 2598090665 0.91
tpch_q22/duckdb:vortex-file-compressed 807461321 758220576 1.06
duckdb / vortex-compact (1.059x ➖, 0↑ 1↓)
name PR a1d2e1e (ns) base eda8c2c (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 656727089 617245671 1.06
tpch_q02/duckdb:vortex-compact 1175716014 1242955113 0.95
tpch_q03/duckdb:vortex-compact 897890199 923782307 0.97
tpch_q04/duckdb:vortex-compact 582812414 552740511 1.05
tpch_q05/duckdb:vortex-compact 1340058203 1115611381 1.20
tpch_q06/duckdb:vortex-compact 885868297 761481439 1.16
tpch_q07/duckdb:vortex-compact 1195171923 1107913158 1.08
tpch_q08/duckdb:vortex-compact 1544027726 1462401258 1.06
tpch_q09/duckdb:vortex-compact 1404432753 1396542513 1.01
tpch_q10/duckdb:vortex-compact 1329492994 1188643279 1.12
tpch_q11/duckdb:vortex-compact 690452331 713408669 0.97
tpch_q12/duckdb:vortex-compact 700560929 749745445 0.93
tpch_q13/duckdb:vortex-compact 912979125 918538856 0.99
tpch_q14/duckdb:vortex-compact 963811602 859419546 1.12
tpch_q15/duckdb:vortex-compact 551367554 538852789 1.02
tpch_q16/duckdb:vortex-compact 529587033 487683491 1.09
tpch_q17/duckdb:vortex-compact 🚨 1238345481 921974414 1.34
tpch_q18/duckdb:vortex-compact 932272511 816038690 1.14
tpch_q19/duckdb:vortex-compact 767263371 770015439 1.00
tpch_q20/duckdb:vortex-compact 1377016774 1266194783 1.09
tpch_q21/duckdb:vortex-compact 1894070384 1753098067 1.08
tpch_q22/duckdb:vortex-compact 674343360 713556051 0.95
duckdb / parquet (0.945x ➖, 0↑ 0↓)
name PR a1d2e1e (ns) base eda8c2c (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 887697673 941961363 0.94
tpch_q02/duckdb:parquet 1437037113 1373577673 1.05
tpch_q03/duckdb:parquet 1639438060 1984291345 0.83
tpch_q04/duckdb:parquet 1064514274 998351848 1.07
tpch_q05/duckdb:parquet 1823831223 1976965731 0.92
tpch_q06/duckdb:parquet 768302847 851855909 0.90
tpch_q07/duckdb:parquet 1932403003 2008213702 0.96
tpch_q08/duckdb:parquet 2247478828 2536193258 0.89
tpch_q09/duckdb:parquet 2398378160 2770095559 0.87
tpch_q10/duckdb:parquet 2989655098 3070738385 0.97
tpch_q11/duckdb:parquet 1029685554 1020424392 1.01
tpch_q12/duckdb:parquet 1113860351 1285637869 0.87
tpch_q13/duckdb:parquet 1182028023 1477139066 0.80
tpch_q14/duckdb:parquet 1248465392 1272682087 0.98
tpch_q15/duckdb:parquet 878833858 957040699 0.92
tpch_q16/duckdb:parquet 914067160 906773200 1.01
tpch_q17/duckdb:parquet 1207481269 1349637194 0.89
tpch_q18/duckdb:parquet 1485181535 1438901499 1.03
tpch_q19/duckdb:parquet 1452557013 1494651931 0.97
tpch_q20/duckdb:parquet 1981976400 1969927935 1.01
tpch_q21/duckdb:parquet 1754839238 1840905975 0.95
tpch_q22/duckdb:parquet 1156434942 1129717925 1.02
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact -7.4% -3.1% -4.5% +44.8% ➖ noise
1 datafusion:vortex-file-compressed +13.6% -3.1% +17.1% +50.7% ➖ noise
1 duckdb:vortex-compact +6.4% -3.1% +9.8% +35.7% ➖ noise
1 duckdb:vortex-file-compressed +1.8% -3.1% +5.0% +32.2% ➖ noise
2 datafusion:vortex-compact -5.9% +2.2% -7.9% +34.1% ➖ noise
2 datafusion:vortex-file-compressed +11.5% +2.2% +9.1% +39.1% ➖ noise
2 duckdb:vortex-compact -5.4% +2.2% -7.4% +30.5% ➖ noise
2 duckdb:vortex-file-compressed +4.6% +2.2% +2.4% +40.1% ➖ noise
3 datafusion:vortex-compact +4.0% -0.6% +4.6% +46.0% ➖ noise
3 datafusion:vortex-file-compressed +13.2% -0.6% +13.8% +43.4% ➖ noise
3 duckdb:vortex-compact -2.8% -0.6% -2.3% +36.5% ➖ noise
3 duckdb:vortex-file-compressed +7.7% -0.6% +8.3% +38.9% ➖ noise
4 datafusion:vortex-compact -15.3% +21.2% -30.1% +30.0% ✅ faster
4 datafusion:vortex-file-compressed +30.2% +21.2% +7.4% +30.0% ➖ noise
4 duckdb:vortex-compact +5.4% +21.2% -13.0% +30.0% ➖ noise
4 duckdb:vortex-file-compressed +29.5% +21.2% +6.8% +30.0% ➖ noise
5 datafusion:vortex-compact -13.8% -2.5% -11.5% +30.0% ➖ noise
5 datafusion:vortex-file-compressed +13.8% -2.5% +16.8% +30.0% ➖ noise
5 duckdb:vortex-compact +20.1% -2.5% +23.2% +30.0% ➖ noise
5 duckdb:vortex-file-compressed +10.2% -2.5% +13.1% +30.0% ➖ noise
6 datafusion:vortex-compact -15.8% -5.0% -11.4% +30.0% ➖ noise
6 datafusion:vortex-file-compressed +11.4% -5.0% +17.2% +30.0% ➖ noise
6 duckdb:vortex-compact +16.3% -5.0% +22.5% +30.0% ➖ noise
6 duckdb:vortex-file-compressed +5.9% -5.0% +11.4% +30.0% ➖ noise
7 datafusion:vortex-compact +1.2% +16.3% -13.0% +41.1% ➖ noise
7 datafusion:vortex-file-compressed -14.2% +16.3% -26.3% +43.0% ➖ noise
7 duckdb:vortex-compact +7.9% +16.3% -7.2% +43.4% ➖ noise
7 duckdb:vortex-file-compressed +5.5% +16.3% -9.3% +42.1% ➖ noise
8 datafusion:vortex-compact -4.0% +9.8% -12.5% +30.0% ➖ noise
8 datafusion:vortex-file-compressed +61.6% +9.8% +47.2% +30.0% 🚨 regression
8 duckdb:vortex-compact +5.6% +9.8% -3.8% +30.0% ➖ noise
8 duckdb:vortex-file-compressed +12.6% +9.8% +2.6% +30.0% ➖ noise
9 datafusion:vortex-compact -12.3% -11.1% -1.3% +30.0% ➖ noise
9 datafusion:vortex-file-compressed +25.6% -11.1% +41.4% +30.0% 🚨 regression
9 duckdb:vortex-compact +0.6% -11.1% +13.2% +30.0% ➖ noise
9 duckdb:vortex-file-compressed -3.1% -11.1% +9.0% +30.0% ➖ noise
10 datafusion:vortex-compact +22.7% -0.5% +23.4% +30.0% ➖ noise
10 datafusion:vortex-file-compressed +12.2% -0.5% +12.8% +30.0% ➖ noise
10 duckdb:vortex-compact +11.8% -0.5% +12.5% +31.1% ➖ noise
10 duckdb:vortex-file-compressed +3.8% -0.5% +4.3% +30.0% ➖ noise
11 datafusion:vortex-compact +12.7% +8.1% +4.2% +30.0% ➖ noise
11 datafusion:vortex-file-compressed -4.5% +8.1% -11.7% +30.0% ➖ noise
11 duckdb:vortex-compact -3.2% +8.1% -10.5% +30.0% ➖ noise
11 duckdb:vortex-file-compressed -9.9% +8.1% -16.7% +30.0% ➖ noise
12 datafusion:vortex-compact -27.4% -6.9% -22.0% +30.0% ➖ noise
12 datafusion:vortex-file-compressed +22.2% -6.9% +31.3% +30.0% 🚨 regression
12 duckdb:vortex-compact -6.6% -6.9% +0.4% +30.0% ➖ noise
12 duckdb:vortex-file-compressed -5.4% -6.9% +1.6% +30.0% ➖ noise
13 datafusion:vortex-compact -9.4% -5.9% -3.7% +34.0% ➖ noise
13 datafusion:vortex-file-compressed +0.8% -5.9% +7.0% +34.1% ➖ noise
13 duckdb:vortex-compact -0.6% -5.9% +5.6% +48.7% ➖ noise
13 duckdb:vortex-file-compressed +29.6% -5.9% +37.7% +39.9% ➖ noise
14 datafusion:vortex-compact -12.5% +1.9% -14.1% +30.0% ➖ noise
14 datafusion:vortex-file-compressed +7.2% +1.9% +5.2% +30.0% ➖ noise
14 duckdb:vortex-compact +12.1% +1.9% +10.0% +30.0% ➖ noise
14 duckdb:vortex-file-compressed -13.9% +1.9% -15.5% +30.0% ➖ noise
15 datafusion:vortex-compact +21.0% -3.1% +24.9% +30.0% ➖ noise
15 datafusion:vortex-file-compressed +8.3% -3.1% +11.8% +30.0% ➖ noise
15 duckdb:vortex-compact +2.3% -3.1% +5.6% +30.0% ➖ noise
15 duckdb:vortex-file-compressed -16.3% -3.1% -13.6% +30.0% ➖ noise
16 datafusion:vortex-compact +5.8% +7.7% -1.8% +33.2% ➖ noise
16 datafusion:vortex-file-compressed +14.5% +7.7% +6.3% +30.0% ➖ noise
16 duckdb:vortex-compact +8.6% +7.7% +0.8% +30.0% ➖ noise
16 duckdb:vortex-file-compressed +33.5% +7.7% +23.9% +38.0% ➖ noise
17 datafusion:vortex-compact +2.6% -3.1% +5.9% +30.0% ➖ noise
17 datafusion:vortex-file-compressed -6.4% -3.1% -3.4% +30.0% ➖ noise
17 duckdb:vortex-compact +34.3% -3.1% +38.7% +30.0% 🚨 regression
17 duckdb:vortex-file-compressed -21.5% -3.1% -18.9% +30.0% ➖ noise
18 datafusion:vortex-compact -1.4% +8.6% -9.2% +30.0% ➖ noise
18 datafusion:vortex-file-compressed -8.6% +8.6% -15.9% +30.0% ➖ noise
18 duckdb:vortex-compact +14.2% +8.6% +5.2% +30.0% ➖ noise
18 duckdb:vortex-file-compressed +1.0% +8.6% -7.0% +41.7% ➖ noise
19 datafusion:vortex-compact +10.0% +10.6% -0.6% +30.0% ➖ noise
19 datafusion:vortex-file-compressed -13.6% +10.6% -21.9% +30.0% ➖ noise
19 duckdb:vortex-compact -0.4% +10.6% -9.9% +30.0% ➖ noise
19 duckdb:vortex-file-compressed -23.1% +10.6% -30.5% +30.0% ✅ faster
20 datafusion:vortex-compact -12.1% +19.2% -26.2% +30.0% ✅ faster
20 datafusion:vortex-file-compressed -3.9% +19.2% -19.4% +30.0% ➖ noise
20 duckdb:vortex-compact +8.8% +19.2% -8.8% +30.0% ➖ noise
20 duckdb:vortex-file-compressed -11.9% +19.2% -26.1% +30.0% ✅ faster
21 datafusion:vortex-compact -12.5% -8.3% -4.5% +30.0% ➖ noise
21 datafusion:vortex-file-compressed -7.4% -8.3% +1.0% +30.0% ➖ noise
21 duckdb:vortex-compact +8.0% -8.3% +17.8% +30.0% ➖ noise
21 duckdb:vortex-file-compressed -8.5% -8.3% -0.3% +30.0% ➖ noise
22 datafusion:vortex-compact +17.7% -14.8% +38.1% +30.0% 🚨 regression
22 datafusion:vortex-file-compressed +68.5% -14.8% +97.7% +39.5% 🚨 regression
22 duckdb:vortex-compact -5.5% -14.8% +10.9% +30.0% ➖ noise
22 duckdb:vortex-file-compressed +6.5% -14.8% +25.0% +30.0% ➖ noise

@codspeed-hq
Copy link
Copy Markdown

codspeed-hq Bot commented May 7, 2026

Merging this PR will degrade performance by 20.78%

⚠️ Unknown Walltime execution environment detected

Using the Walltime instrument on standard Hosted Runners will lead to inconsistent data.

For the most accurate results, we recommend using CodSpeed Macro Runners: bare-metal machines fine-tuned for performance measurement consistency.

⚠️ Different runtime environments detected

Some benchmarks with significant performance changes were compared across different runtime environments,
which may affect the accuracy of the results.

Open the report in CodSpeed to investigate

⚡ 7 improved benchmarks
❌ 9 regressed benchmarks
✅ 1190 untouched benchmarks

⚠️ Please fix the performance issues or acknowledge them on CodSpeed.

Performance Changes

Mode Benchmark BASE HEAD Efficiency
Simulation filter_all_true[100000] 8.8 µs 7.7 µs +15.02%
Simulation filter_all_true[250000] 8.8 µs 7.7 µs +14.59%
Simulation new_bp_prim_test_between[i32, 32768] 140.2 µs 169.7 µs -17.39%
Simulation patched_take_10k_adversarial 259.1 µs 229 µs +13.14%
Simulation new_bp_prim_test_between[i16, 32768] 120.3 µs 135.3 µs -11.08%
Simulation new_bp_prim_test_between[i32, 16384] 93.8 µs 109.4 µs -14.26%
Simulation new_bp_prim_test_between[i64, 16384] 114.4 µs 144.4 µs -20.78%
Simulation patched_take_10k_dispersed 316 µs 285.9 µs +10.53%
Simulation patched_take_10k_contiguous_patches 258.9 µs 287.8 µs -10.03%
Simulation patched_take_10k_first_chunk_only 302.5 µs 272.5 µs +11.03%
Simulation take_10k_first_chunk_only 271.2 µs 226.7 µs +19.62%
Simulation take_10k_dispersed 284.4 µs 240.4 µs +18.34%
Simulation decompress_rd[f64, (100000, 0.01)] 843.3 µs 1,021.7 µs -17.46%
Simulation decompress_rd[f32, (100000, 0.1)] 495.9 µs 583.8 µs -15.06%
Simulation decompress_rd[f64, (100000, 0.1)] 843.3 µs 1,021.7 µs -17.46%
Simulation decompress_rd[f32, (100000, 0.01)] 495.9 µs 583.8 µs -15.06%

Comparing rk/smallvec (99b4a4a) with develop (eda8c2c)

Open in CodSpeed

@robert3005
Copy link
Copy Markdown
Contributor Author

This is not worth it

@robert3005 robert3005 closed this May 7, 2026
@robert3005 robert3005 deleted the rk/smallvec branch May 7, 2026 12:46
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

changelog/chore A trivial change

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant