Skip to content

Adamg/try planus again#7196

Draft
AdamGS wants to merge 2 commits intodevelopfrom
adamg/try-planus-again
Draft

Adamg/try planus again#7196
AdamGS wants to merge 2 commits intodevelopfrom
adamg/try-planus-again

Conversation

@AdamGS
Copy link
Copy Markdown
Contributor

@AdamGS AdamGS commented Mar 27, 2026

Summary

Closes: #000

Testing

@AdamGS AdamGS added the changelog/performance A performance improvement label Mar 27, 2026
@AdamGS AdamGS force-pushed the adamg/try-planus-again branch from 1c75689 to f04b111 Compare March 27, 2026 18:37
@AdamGS AdamGS added the action/benchmark Trigger full benchmarks to run on this PR label Mar 27, 2026
@github-actions github-actions bot removed the action/benchmark Trigger full benchmarks to run on this PR label Mar 27, 2026
Signed-off-by: Adam Gutglick <adam@spiraldb.com>
@codspeed-hq
Copy link
Copy Markdown

codspeed-hq bot commented Mar 27, 2026

Merging this PR will degrade performance by 24.22%

⚡ 4 improved benchmarks
❌ 9 regressed benchmarks
✅ 1093 untouched benchmarks
⏩ 1522 skipped benchmarks1

⚠️ Please fix the performance issues or acknowledge them on CodSpeed.

Performance Changes

Mode Benchmark BASE HEAD Efficiency
Simulation pack_return_dtype[2000] 1.5 ms 1.3 ms +11.08%
Simulation pack_return_dtype[1000] 742.5 µs 669.3 µs +10.94%
Simulation pack_return_dtype[500] 373.7 µs 335.2 µs +11.47%
Simulation new_bp_prim_test_between[i64, 16384] 118 µs 146.7 µs -19.61%
Simulation new_bp_prim_test_between[i64, 32768] 182 µs 240.2 µs -24.22%
Simulation old_alp_prim_test_between[f32, 32768] 398.3 µs 442.9 µs -10.06%
Simulation new_bp_prim_test_between[i32, 16384] 101.3 µs 115.2 µs -12.03%
Simulation patched_take_10k_contiguous_not_patches 309.8 µs 281.7 µs +10.01%
Simulation new_bp_prim_test_between[i32, 32768] 148.9 µs 177.2 µs -15.98%
Simulation new_alp_prim_test_between[f64, 16384] 130.7 µs 152.5 µs -14.27%
Simulation take_10k_contiguous 270.4 µs 314.4 µs -14%
Simulation take_10k_random 209 µs 254.1 µs -17.73%
Simulation old_bp_prim_test_between[i64, 32768] 473.8 µs 533.3 µs -11.16%

Comparing adamg/try-planus-again (53212e6) with develop (60847b0)

Open in CodSpeed

Footnotes

  1. 1522 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Mar 27, 2026

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done f04b111 2 Explore Profiling Data
Previous Runs (2)
Status Commit Job Attempt Link
🟢 Done 53212e6 1 Explore Profiling Data
🟢 Done f04b111 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Mar 27, 2026

Benchmarks: PolarSignals Profiling

Vortex (geomean): 1.004x ➖


datafusion / vortex-file-compressed (1.004x ➖, 0↑ 0↓)
name PR 53212e6 (ns) base 1f3206f (ns) ratio (PR/base)
polarsignals_q00/datafusion:vortex-file-compressed 127235610 126126813 1.01
polarsignals_q01/datafusion:vortex-file-compressed 373506485 374494349 1.00
polarsignals_q02/datafusion:vortex-file-compressed 21633264 22215344 0.97
polarsignals_q03/datafusion:vortex-file-compressed 381233645 378781139 1.01
polarsignals_q04/datafusion:vortex-file-compressed 11403570 11277410 1.01
polarsignals_q05/datafusion:vortex-file-compressed 16359411 15233907 1.07
polarsignals_q06/datafusion:vortex-file-compressed 19145902 18735061 1.02
polarsignals_q07/datafusion:vortex-file-compressed 13962891 14282086 0.98
polarsignals_q08/datafusion:vortex-file-compressed 459000661 461185933 1.00
polarsignals_q09/datafusion:vortex-file-compressed 10486483 10739424 0.98

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Mar 27, 2026

Benchmarks: TPC-H SF=1 on NVME

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -2.8%
Vortex (geomean): 1.029x ➖
Parquet (geomean): 1.059x ➖
Shifts: Parquet (control) +5.9% · Median polish +2.7%


datafusion / vortex-file-compressed (1.040x ➖, 0↑ 2↓)
name PR 53212e6 (ns) base 1f3206f (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 48174427 47363935 1.02
tpch_q02/datafusion:vortex-file-compressed 33643997 32501371 1.04
tpch_q03/datafusion:vortex-file-compressed 28124445 25649299 1.10
tpch_q04/datafusion:vortex-file-compressed 18697878 18287308 1.02
tpch_q05/datafusion:vortex-file-compressed 54127220 53682440 1.01
tpch_q06/datafusion:vortex-file-compressed 🚨 10914373 9671248 1.13
tpch_q07/datafusion:vortex-file-compressed 64442400 62654637 1.03
tpch_q08/datafusion:vortex-file-compressed 43801411 45037811 0.97
tpch_q09/datafusion:vortex-file-compressed 56996321 54952274 1.04
tpch_q10/datafusion:vortex-file-compressed 45271227 44578735 1.02
tpch_q11/datafusion:vortex-file-compressed 18200445 17591185 1.03
tpch_q12/datafusion:vortex-file-compressed 25608769 23435359 1.09
tpch_q13/datafusion:vortex-file-compressed 27888102 27362602 1.02
tpch_q14/datafusion:vortex-file-compressed 16999969 16494704 1.03
tpch_q15/datafusion:vortex-file-compressed 26567225 26571567 1.00
tpch_q16/datafusion:vortex-file-compressed 25578036 24001957 1.07
tpch_q17/datafusion:vortex-file-compressed 67354547 61408080 1.10
tpch_q18/datafusion:vortex-file-compressed 81012793 77427285 1.05
tpch_q19/datafusion:vortex-file-compressed 26949044 27268487 0.99
tpch_q20/datafusion:vortex-file-compressed 🚨 36066934 31882034 1.13
tpch_q21/datafusion:vortex-file-compressed 76220900 74867177 1.02
tpch_q22/datafusion:vortex-file-compressed 17064082 16812676 1.01
datafusion / vortex-compact (1.027x ➖, 0↑ 0↓)
name PR 53212e6 (ns) base 1f3206f (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 59917162 60680083 0.99
tpch_q02/datafusion:vortex-compact 37415748 37091603 1.01
tpch_q03/datafusion:vortex-compact 31893134 31525385 1.01
tpch_q04/datafusion:vortex-compact 23854399 23081863 1.03
tpch_q05/datafusion:vortex-compact 58166025 54306680 1.07
tpch_q06/datafusion:vortex-compact 14667332 13787095 1.06
tpch_q07/datafusion:vortex-compact 70555749 69085095 1.02
tpch_q08/datafusion:vortex-compact 50841686 50246666 1.01
tpch_q09/datafusion:vortex-compact 63024721 59655721 1.06
tpch_q10/datafusion:vortex-compact 54275807 54585494 0.99
tpch_q11/datafusion:vortex-compact 20820468 19652695 1.06
tpch_q12/datafusion:vortex-compact 34154499 33711827 1.01
tpch_q13/datafusion:vortex-compact 36550196 36643996 1.00
tpch_q14/datafusion:vortex-compact 21543638 20615760 1.05
tpch_q15/datafusion:vortex-compact 36279724 35463289 1.02
tpch_q16/datafusion:vortex-compact 30719755 30037565 1.02
tpch_q17/datafusion:vortex-compact 71640313 70439502 1.02
tpch_q18/datafusion:vortex-compact 87217047 84660475 1.03
tpch_q19/datafusion:vortex-compact 40843540 39537457 1.03
tpch_q20/datafusion:vortex-compact 39371438 37766946 1.04
tpch_q21/datafusion:vortex-compact 88826949 85850619 1.03
tpch_q22/datafusion:vortex-compact 17867147 17351808 1.03
datafusion / parquet (1.077x ➖, 0↑ 5↓)
name PR 53212e6 (ns) base 1f3206f (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 🚨 137063898 92828006 1.48
tpch_q02/datafusion:parquet 71650316 68923718 1.04
tpch_q03/datafusion:parquet 🚨 81840647 72507478 1.13
tpch_q04/datafusion:parquet 49533268 47012131 1.05
tpch_q05/datafusion:parquet 103650920 101175617 1.02
tpch_q06/datafusion:parquet 🚨 46750058 41520653 1.13
tpch_q07/datafusion:parquet 117732665 110094723 1.07
tpch_q08/datafusion:parquet 100933155 96098285 1.05
tpch_q09/datafusion:parquet 140620031 133659604 1.05
tpch_q10/datafusion:parquet 122915692 120370378 1.02
tpch_q11/datafusion:parquet 50277608 47769930 1.05
tpch_q12/datafusion:parquet 🚨 96228598 82712964 1.16
tpch_q13/datafusion:parquet 210253247 202585082 1.04
tpch_q14/datafusion:parquet 49028428 51424279 0.95
tpch_q15/datafusion:parquet 67736199 63885855 1.06
tpch_q16/datafusion:parquet 51508618 49410426 1.04
tpch_q17/datafusion:parquet 142787349 139077852 1.03
tpch_q18/datafusion:parquet 170839178 165330820 1.03
tpch_q19/datafusion:parquet 🚨 90832405 69168988 1.31
tpch_q20/datafusion:parquet 81480958 76982411 1.06
tpch_q21/datafusion:parquet 148420434 145985180 1.02
tpch_q22/datafusion:parquet 34990807 35165269 1.00
datafusion / arrow (1.028x ➖, 0↑ 1↓)
name PR 53212e6 (ns) base 1f3206f (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 54123261 56989044 0.95
tpch_q02/datafusion:arrow 22105404 22057191 1.00
tpch_q03/datafusion:arrow 35131263 33163242 1.06
tpch_q04/datafusion:arrow 28197188 27699743 1.02
tpch_q05/datafusion:arrow 80604432 81398156 0.99
tpch_q06/datafusion:arrow 20534776 20705177 0.99
tpch_q07/datafusion:arrow 114446656 115040132 0.99
tpch_q08/datafusion:arrow 46992343 44925083 1.05
tpch_q09/datafusion:arrow 71886809 68847891 1.04
tpch_q10/datafusion:arrow 54389921 50682088 1.07
tpch_q11/datafusion:arrow 🚨 12426413 11239477 1.11
tpch_q12/datafusion:arrow 58104408 54199152 1.07
tpch_q13/datafusion:arrow 50860863 49724819 1.02
tpch_q14/datafusion:arrow 24418410 22747344 1.07
tpch_q15/datafusion:arrow 47111770 44581546 1.06
tpch_q16/datafusion:arrow 21498153 20510114 1.05
tpch_q17/datafusion:arrow 71458057 71030893 1.01
tpch_q18/datafusion:arrow 145716838 144185200 1.01
tpch_q19/datafusion:arrow 40404880 41742472 0.97
tpch_q20/datafusion:arrow 39640344 39300800 1.01
tpch_q21/datafusion:arrow 157091743 150386536 1.04
tpch_q22/datafusion:arrow 20708249 19798898 1.05
duckdb / vortex-file-compressed (1.029x ➖, 0↑ 1↓)
name PR 53212e6 (ns) base 1f3206f (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 33423778 33269308 1.00
tpch_q02/duckdb:vortex-file-compressed 27365533 27466822 1.00
tpch_q03/duckdb:vortex-file-compressed 29915691 29209694 1.02
tpch_q04/duckdb:vortex-file-compressed 30370326 29538686 1.03
tpch_q05/duckdb:vortex-file-compressed 33242751 32016573 1.04
tpch_q06/duckdb:vortex-file-compressed 10879742 10550738 1.03
tpch_q07/duckdb:vortex-file-compressed 37103025 35906520 1.03
tpch_q08/duckdb:vortex-file-compressed 41361632 39274976 1.05
tpch_q09/duckdb:vortex-file-compressed 79923994 76699604 1.04
tpch_q10/duckdb:vortex-file-compressed 38262106 35724211 1.07
tpch_q11/duckdb:vortex-file-compressed 17340758 16265690 1.07
tpch_q12/duckdb:vortex-file-compressed 24665640 23538117 1.05
tpch_q13/duckdb:vortex-file-compressed 38110142 38153186 1.00
tpch_q14/duckdb:vortex-file-compressed 22080888 21507435 1.03
tpch_q15/duckdb:vortex-file-compressed 15871789 16051281 0.99
tpch_q16/duckdb:vortex-file-compressed 30016791 30573235 0.98
tpch_q17/duckdb:vortex-file-compressed 25431311 24860223 1.02
tpch_q18/duckdb:vortex-file-compressed 47804645 49285086 0.97
tpch_q19/duckdb:vortex-file-compressed 🚨 35357826 31781468 1.11
tpch_q20/duckdb:vortex-file-compressed 34570663 34381064 1.01
tpch_q21/duckdb:vortex-file-compressed 106748302 102033782 1.05
tpch_q22/duckdb:vortex-file-compressed 19435911 18369612 1.06
duckdb / vortex-compact (1.018x ➖, 0↑ 0↓)
name PR 53212e6 (ns) base 1f3206f (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 40021819 38106717 1.05
tpch_q02/duckdb:vortex-compact 38922826 36974944 1.05
tpch_q03/duckdb:vortex-compact 31986655 31642776 1.01
tpch_q04/duckdb:vortex-compact 34245823 33637429 1.02
tpch_q05/duckdb:vortex-compact 37477213 37991862 0.99
tpch_q06/duckdb:vortex-compact 14692364 14878490 0.99
tpch_q07/duckdb:vortex-compact 44049732 43060086 1.02
tpch_q08/duckdb:vortex-compact 46486456 46395765 1.00
tpch_q09/duckdb:vortex-compact 88158844 85320519 1.03
tpch_q10/duckdb:vortex-compact 40806657 40961251 1.00
tpch_q11/duckdb:vortex-compact 20708497 20718360 1.00
tpch_q12/duckdb:vortex-compact 37722605 37125341 1.02
tpch_q13/duckdb:vortex-compact 47834594 45797725 1.04
tpch_q14/duckdb:vortex-compact 29881665 29613458 1.01
tpch_q15/duckdb:vortex-compact 19758126 19297484 1.02
tpch_q16/duckdb:vortex-compact 37469928 36060441 1.04
tpch_q17/duckdb:vortex-compact 31130623 31572306 0.99
tpch_q18/duckdb:vortex-compact 51150648 49895319 1.03
tpch_q19/duckdb:vortex-compact 38994988 38311432 1.02
tpch_q20/duckdb:vortex-compact 45904943 44863050 1.02
tpch_q21/duckdb:vortex-compact 114532579 111333980 1.03
tpch_q22/duckdb:vortex-compact 21015796 20504784 1.02
duckdb / parquet (1.041x ➖, 1↑ 3↓)
name PR 53212e6 (ns) base 1f3206f (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 🚨 108566886 79245046 1.37
tpch_q02/duckdb:parquet 39980424 39563682 1.01
tpch_q03/duckdb:parquet 69794792 70716624 0.99
tpch_q04/duckdb:parquet 🚨 54027659 47452074 1.14
tpch_q05/duckdb:parquet 68403574 69485243 0.98
tpch_q06/duckdb:parquet 20214650 20261053 1.00
tpch_q07/duckdb:parquet 79580194 78868260 1.01
tpch_q08/duckdb:parquet 92472772 95767877 0.97
tpch_q09/duckdb:parquet 153873668 141318905 1.09
tpch_q10/duckdb:parquet 139936443 136361589 1.03
tpch_q11/duckdb:parquet 22746915 22507204 1.01
tpch_q12/duckdb:parquet 🚀 47232841 56131445 0.84
tpch_q13/duckdb:parquet 272959634 260628018 1.05
tpch_q14/duckdb:parquet 50786545 47331378 1.07
tpch_q15/duckdb:parquet 24996273 25041188 1.00
tpch_q16/duckdb:parquet 56162992 54055689 1.04
tpch_q17/duckdb:parquet 55720239 53816730 1.04
tpch_q18/duckdb:parquet 121455835 121524143 1.00
tpch_q19/duckdb:parquet 🚨 87108894 68452251 1.27
tpch_q20/duckdb:parquet 63284925 62487594 1.01
tpch_q21/duckdb:parquet 179231629 171069832 1.05
tpch_q22/duckdb:parquet 54916522 52235626 1.05
duckdb / duckdb (1.030x ➖, 0↑ 1↓)
name PR 53212e6 (ns) base 1f3206f (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 16239753 15938099 1.02
tpch_q02/duckdb:duckdb 12051417 11597330 1.04
tpch_q03/duckdb:duckdb 🚨 20705951 18733160 1.11
tpch_q04/duckdb:duckdb 19933147 19153158 1.04
tpch_q05/duckdb:duckdb 20464991 19647238 1.04
tpch_q06/duckdb:duckdb 5677232 5189391 1.09
tpch_q07/duckdb:duckdb 23439864 22740584 1.03
tpch_q08/duckdb:duckdb 21158071 20928493 1.01
tpch_q09/duckdb:duckdb 54133734 56601755 0.96
tpch_q10/duckdb:duckdb 45489328 44631164 1.02
tpch_q11/duckdb:duckdb 5966996 5460309 1.09
tpch_q12/duckdb:duckdb 14407410 13437153 1.07
tpch_q13/duckdb:duckdb 37631955 38289200 0.98
tpch_q14/duckdb:duckdb 18530277 17999132 1.03
tpch_q15/duckdb:duckdb 11932218 11820378 1.01
tpch_q16/duckdb:duckdb 23423254 22804996 1.03
tpch_q17/duckdb:duckdb 13762841 13419979 1.03
tpch_q18/duckdb:duckdb 39806453 37040120 1.07
tpch_q19/duckdb:duckdb 25572376 27197075 0.94
tpch_q20/duckdb:duckdb 22869710 23398561 0.98
tpch_q21/duckdb:duckdb 58028074 54930007 1.06
tpch_q22/duckdb:duckdb 24928873 23895232 1.04
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:arrow -5.0% +42.2% -33.2% +28.1% ✅ faster
1 datafusion:vortex-compact -1.3% +42.2% -30.6% +27.6% ✅ faster
1 datafusion:vortex-file-compressed +1.7% +42.2% -28.5% +29.1% ✅ faster
1 duckdb:duckdb +1.9% +42.2% -28.4% +27.0% ✅ faster
1 duckdb:vortex-compact +5.0% +42.2% -26.2% +27.0% ✅ faster
1 duckdb:vortex-file-compressed +0.5% +42.2% -29.4% +26.3% ✅ faster
2 datafusion:arrow +0.2% +2.5% -2.2% +24.3% ➖ noise
2 datafusion:vortex-compact +0.9% +2.5% -1.6% +24.3% ➖ noise
2 datafusion:vortex-file-compressed +3.5% +2.5% +1.0% +24.3% ➖ noise
2 duckdb:duckdb +3.9% +2.5% +1.4% +24.3% ➖ noise
2 duckdb:vortex-compact +5.3% +2.5% +2.7% +24.3% ➖ noise
2 duckdb:vortex-file-compressed -0.4% +2.5% -2.8% +24.3% ➖ noise
3 datafusion:arrow +5.9% +5.5% +0.4% +24.3% ➖ noise
3 datafusion:vortex-compact +1.2% +5.5% -4.1% +24.3% ➖ noise
3 datafusion:vortex-file-compressed +9.6% +5.5% +3.9% +24.3% ➖ noise
3 duckdb:duckdb +10.5% +5.5% +4.7% +24.3% ➖ noise
3 duckdb:vortex-compact +1.1% +5.5% -4.2% +24.3% ➖ noise
3 duckdb:vortex-file-compressed +2.4% +5.5% -3.0% +24.3% ➖ noise
4 datafusion:arrow +1.8% +9.5% -7.1% +24.3% ➖ noise
4 datafusion:vortex-compact +3.3% +9.5% -5.6% +24.3% ➖ noise
4 datafusion:vortex-file-compressed +2.2% +9.5% -6.6% +24.3% ➖ noise
4 duckdb:duckdb +4.1% +9.5% -5.0% +24.3% ➖ noise
4 duckdb:vortex-compact +1.8% +9.5% -7.0% +24.3% ➖ noise
4 duckdb:vortex-file-compressed +2.8% +9.5% -6.1% +24.3% ➖ noise
5 datafusion:arrow -1.0% +0.4% -1.4% +24.3% ➖ noise
5 datafusion:vortex-compact +7.1% +0.4% +6.7% +24.3% ➖ noise
5 datafusion:vortex-file-compressed +0.8% +0.4% +0.4% +24.3% ➖ noise
5 duckdb:duckdb +4.2% +0.4% +3.7% +24.3% ➖ noise
5 duckdb:vortex-compact -1.4% +0.4% -1.8% +24.3% ➖ noise
5 duckdb:vortex-file-compressed +3.8% +0.4% +3.4% +24.3% ➖ noise
6 datafusion:arrow -0.8% +6.0% -6.4% +24.3% ➖ noise
6 datafusion:vortex-compact +6.4% +6.0% +0.4% +25.9% ➖ noise
6 datafusion:vortex-file-compressed +12.9% +6.0% +6.5% +24.3% ➖ noise
6 duckdb:duckdb +9.4% +6.0% +3.2% +25.1% ➖ noise
6 duckdb:vortex-compact -1.3% +6.0% -6.8% +28.5% ➖ noise
6 duckdb:vortex-file-compressed +3.1% +6.0% -2.7% +24.3% ➖ noise
7 datafusion:arrow -0.5% +3.9% -4.2% +24.3% ➖ noise
7 datafusion:vortex-compact +2.1% +3.9% -1.7% +24.3% ➖ noise
7 datafusion:vortex-file-compressed +2.9% +3.9% -1.0% +24.3% ➖ noise
7 duckdb:duckdb +3.1% +3.9% -0.8% +24.3% ➖ noise
7 duckdb:vortex-compact +2.3% +3.9% -1.5% +24.3% ➖ noise
7 duckdb:vortex-file-compressed +3.3% +3.9% -0.5% +24.3% ➖ noise
8 datafusion:arrow +4.6% +0.7% +3.9% +24.3% ➖ noise
8 datafusion:vortex-compact +1.2% +0.7% +0.5% +24.3% ➖ noise
8 datafusion:vortex-file-compressed -2.7% +0.7% -3.4% +24.3% ➖ noise
8 duckdb:duckdb +1.1% +0.7% +0.4% +24.3% ➖ noise
8 duckdb:vortex-compact +0.2% +0.7% -0.5% +24.3% ➖ noise
8 duckdb:vortex-file-compressed +5.3% +0.7% +4.6% +24.3% ➖ noise
9 datafusion:arrow +4.4% +7.0% -2.4% +24.3% ➖ noise
9 datafusion:vortex-compact +5.6% +7.0% -1.3% +24.3% ➖ noise
9 datafusion:vortex-file-compressed +3.7% +7.0% -3.1% +24.3% ➖ noise
9 duckdb:duckdb -4.4% +7.0% -10.6% +24.3% ➖ noise
9 duckdb:vortex-compact +3.3% +7.0% -3.5% +24.3% ➖ noise
9 duckdb:vortex-file-compressed +4.2% +7.0% -2.6% +24.3% ➖ noise
10 datafusion:arrow +7.3% +2.4% +4.8% +24.3% ➖ noise
10 datafusion:vortex-compact -0.6% +2.4% -2.9% +24.3% ➖ noise
10 datafusion:vortex-file-compressed +1.6% +2.4% -0.8% +24.3% ➖ noise
10 duckdb:duckdb +1.9% +2.4% -0.4% +24.3% ➖ noise
10 duckdb:vortex-compact -0.4% +2.4% -2.7% +24.3% ➖ noise
10 duckdb:vortex-file-compressed +7.1% +2.4% +4.6% +24.3% ➖ noise
11 datafusion:arrow +10.6% +3.1% +7.2% +24.3% ➖ noise
11 datafusion:vortex-compact +5.9% +3.1% +2.7% +24.3% ➖ noise
11 datafusion:vortex-file-compressed +3.5% +3.1% +0.3% +24.3% ➖ noise
11 duckdb:duckdb +9.3% +3.1% +6.0% +24.3% ➖ noise
11 duckdb:vortex-compact -0.0% +3.1% -3.1% +24.3% ➖ noise
11 duckdb:vortex-file-compressed +6.6% +3.1% +3.4% +24.3% ➖ noise
12 datafusion:arrow +7.2% -1.1% +8.4% +24.3% ➖ noise
12 datafusion:vortex-compact +1.3% -1.1% +2.4% +24.3% ➖ noise
12 datafusion:vortex-file-compressed +9.3% -1.1% +10.4% +24.3% ➖ noise
12 duckdb:duckdb +7.2% -1.1% +8.4% +24.3% ➖ noise
12 duckdb:vortex-compact +1.6% -1.1% +2.7% +24.3% ➖ noise
12 duckdb:vortex-file-compressed +4.8% -1.1% +5.9% +24.3% ➖ noise
13 datafusion:arrow +2.3% +4.3% -1.9% +24.3% ➖ noise
13 datafusion:vortex-compact -0.3% +4.3% -4.3% +24.3% ➖ noise
13 datafusion:vortex-file-compressed +1.9% +4.3% -2.2% +24.3% ➖ noise
13 duckdb:duckdb -1.7% +4.3% -5.7% +24.3% ➖ noise
13 duckdb:vortex-compact +4.4% +4.3% +0.2% +24.3% ➖ noise
13 duckdb:vortex-file-compressed -0.1% +4.3% -4.2% +24.3% ➖ noise
14 datafusion:arrow +7.3% +1.1% +6.1% +24.3% ➖ noise
14 datafusion:vortex-compact +4.5% +1.1% +3.3% +24.3% ➖ noise
14 datafusion:vortex-file-compressed +3.1% +1.1% +1.9% +24.3% ➖ noise
14 duckdb:duckdb +3.0% +1.1% +1.8% +24.3% ➖ noise
14 duckdb:vortex-compact +0.9% +1.1% -0.2% +24.3% ➖ noise
14 duckdb:vortex-file-compressed +2.7% +1.1% +1.5% +24.3% ➖ noise
15 datafusion:arrow +5.7% +2.9% +2.7% +24.3% ➖ noise
15 datafusion:vortex-compact +2.3% +2.9% -0.6% +24.3% ➖ noise
15 datafusion:vortex-file-compressed -0.0% +2.9% -2.8% +24.3% ➖ noise
15 duckdb:duckdb +0.9% +2.9% -1.9% +24.3% ➖ noise
15 duckdb:vortex-compact +2.4% +2.9% -0.5% +24.3% ➖ noise
15 duckdb:vortex-file-compressed -1.1% +2.9% -3.9% +24.3% ➖ noise
16 datafusion:arrow +4.8% +4.1% +0.7% +24.3% ➖ noise
16 datafusion:vortex-compact +2.3% +4.1% -1.7% +24.3% ➖ noise
16 datafusion:vortex-file-compressed +6.6% +4.1% +2.4% +24.3% ➖ noise
16 duckdb:duckdb +2.7% +4.1% -1.3% +24.3% ➖ noise
16 duckdb:vortex-compact +3.9% +4.1% -0.2% +24.3% ➖ noise
16 duckdb:vortex-file-compressed -1.8% +4.1% -5.7% +24.3% ➖ noise
17 datafusion:arrow +0.6% +3.1% -2.4% +24.3% ➖ noise
17 datafusion:vortex-compact +1.7% +3.1% -1.4% +24.3% ➖ noise
17 datafusion:vortex-file-compressed +9.7% +3.1% +6.4% +24.3% ➖ noise
17 duckdb:duckdb +2.6% +3.1% -0.5% +24.3% ➖ noise
17 duckdb:vortex-compact -1.4% +3.1% -4.4% +24.3% ➖ noise
17 duckdb:vortex-file-compressed +2.3% +3.1% -0.8% +24.3% ➖ noise
18 datafusion:arrow +1.1% +1.6% -0.6% +24.3% ➖ noise
18 datafusion:vortex-compact +3.0% +1.6% +1.4% +24.3% ➖ noise
18 datafusion:vortex-file-compressed +4.6% +1.6% +3.0% +24.3% ➖ noise
18 duckdb:duckdb +7.5% +1.6% +5.8% +24.3% ➖ noise
18 duckdb:vortex-compact +2.5% +1.6% +0.9% +24.3% ➖ noise
18 duckdb:vortex-file-compressed -3.0% +1.6% -4.6% +24.3% ➖ noise
19 datafusion:arrow -3.2% +29.3% -25.1% +24.3% ✅ faster
19 datafusion:vortex-compact +3.3% +29.3% -20.1% +24.3% ✅ faster
19 datafusion:vortex-file-compressed -1.2% +29.3% -23.5% +24.7% ✅ faster
19 duckdb:duckdb -6.0% +29.3% -27.3% +25.0% ✅ faster
19 duckdb:vortex-compact +1.8% +29.3% -21.3% +24.3% ✅ faster
19 duckdb:vortex-file-compressed +11.3% +29.3% -13.9% +24.3% ➖ noise
20 datafusion:arrow +0.9% +3.5% -2.6% +24.3% ➖ noise
20 datafusion:vortex-compact +4.2% +3.5% +0.7% +24.3% ➖ noise
20 datafusion:vortex-file-compressed +13.1% +3.5% +9.3% +24.3% ➖ noise
20 duckdb:duckdb -2.3% +3.5% -5.6% +24.3% ➖ noise
20 duckdb:vortex-compact +2.3% +3.5% -1.2% +24.3% ➖ noise
20 duckdb:vortex-file-compressed +0.6% +3.5% -2.9% +24.3% ➖ noise
21 datafusion:arrow +4.5% +3.2% +1.2% +24.3% ➖ noise
21 datafusion:vortex-compact +3.5% +3.2% +0.3% +24.3% ➖ noise
21 datafusion:vortex-file-compressed +1.8% +3.2% -1.4% +24.3% ➖ noise
21 duckdb:duckdb +5.6% +3.2% +2.4% +24.3% ➖ noise
21 duckdb:vortex-compact +2.9% +3.2% -0.3% +24.3% ➖ noise
21 duckdb:vortex-file-compressed +4.6% +3.2% +1.4% +24.3% ➖ noise
22 datafusion:arrow +4.6% +2.3% +2.3% +24.3% ➖ noise
22 datafusion:vortex-compact +3.0% +2.3% +0.7% +24.3% ➖ noise
22 datafusion:vortex-file-compressed +1.5% +2.3% -0.8% +24.3% ➖ noise
22 duckdb:duckdb +4.3% +2.3% +2.0% +24.3% ➖ noise
22 duckdb:vortex-compact +2.5% +2.3% +0.2% +24.3% ➖ noise
22 duckdb:vortex-file-compressed +5.8% +2.3% +3.4% +24.3% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Mar 27, 2026

Benchmarks: FineWeb NVMe

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +1.4%
Vortex (geomean): 0.963x ➖
Parquet (geomean): 0.950x ➖
Shifts: Parquet (control) -5.0% · Median polish -3.4%


datafusion / vortex-file-compressed (0.916x ➖, 3↑ 0↓)
name PR 53212e6 (ns) base 1f3206f (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 5014493 5468883 0.92
fineweb_q01/datafusion:vortex-file-compressed 26783979 29218276 0.92
fineweb_q02/datafusion:vortex-file-compressed 🚀 26654588 29618423 0.90
fineweb_q03/datafusion:vortex-file-compressed 85874426 85460944 1.00
fineweb_q04/datafusion:vortex-file-compressed 252326706 257638369 0.98
fineweb_q05/datafusion:vortex-file-compressed 227124769 232685523 0.98
fineweb_q06/datafusion:vortex-file-compressed 63894327 69988303 0.91
fineweb_q07/datafusion:vortex-file-compressed 🚀 63950133 74198218 0.86
fineweb_q08/datafusion:vortex-file-compressed 🚀 25362115 31883020 0.80
datafusion / vortex-compact (0.998x ➖, 0↑ 1↓)
name PR 53212e6 (ns) base 1f3206f (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 5027996 5305770 0.95
fineweb_q01/datafusion:vortex-compact 160696217 163733743 0.98
fineweb_q02/datafusion:vortex-compact 162671482 165953466 0.98
fineweb_q03/datafusion:vortex-compact 1436395345 1464488217 0.98
fineweb_q04/datafusion:vortex-compact 1582064942 1578124180 1.00
fineweb_q05/datafusion:vortex-compact 1233459319 1231968923 1.00
fineweb_q06/datafusion:vortex-compact 695609218 703951526 0.99
fineweb_q07/datafusion:vortex-compact 728872973 738211582 0.99
fineweb_q08/datafusion:vortex-compact 🚨 23342932 20763906 1.12
datafusion / parquet (0.939x ➖, 1↑ 0↓)
name PR 53212e6 (ns) base 1f3206f (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 6607382 7150984 0.92
fineweb_q01/datafusion:parquet 267887935 284698277 0.94
fineweb_q02/datafusion:parquet 267299649 286233477 0.93
fineweb_q03/datafusion:parquet 263652086 279944650 0.94
fineweb_q04/datafusion:parquet 289538067 295246377 0.98
fineweb_q05/datafusion:parquet 281383135 287526085 0.98
fineweb_q06/datafusion:parquet 🚀 271856335 302189965 0.90
fineweb_q07/datafusion:parquet 267001944 291301668 0.92
fineweb_q08/datafusion:parquet 264139450 281468523 0.94
duckdb / vortex-file-compressed (0.965x ➖, 2↑ 0↓)
name PR 53212e6 (ns) base 1f3206f (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 🚀 3128016 3483380 0.90
fineweb_q01/duckdb:vortex-file-compressed 29857617 29316281 1.02
fineweb_q02/duckdb:vortex-file-compressed 26203592 27366120 0.96
fineweb_q03/duckdb:vortex-file-compressed 🚀 134727635 164845631 0.82
fineweb_q04/duckdb:vortex-file-compressed 228463900 228370867 1.00
fineweb_q05/duckdb:vortex-file-compressed 217519865 221109764 0.98
fineweb_q06/duckdb:vortex-file-compressed 66421686 68922473 0.96
fineweb_q07/duckdb:vortex-file-compressed 71636120 68332465 1.05
fineweb_q08/duckdb:vortex-file-compressed 25146877 24740525 1.02
duckdb / vortex-compact (0.976x ➖, 0↑ 0↓)
name PR 53212e6 (ns) base 1f3206f (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 3906547 4165350 0.94
fineweb_q01/duckdb:vortex-compact 103531828 97023852 1.07
fineweb_q02/duckdb:vortex-compact 117682416 119934690 0.98
fineweb_q03/duckdb:vortex-compact 864392753 888384611 0.97
fineweb_q04/duckdb:vortex-compact 909528471 928108742 0.98
fineweb_q05/duckdb:vortex-compact 804408719 824156992 0.98
fineweb_q06/duckdb:vortex-compact 459174481 476682919 0.96
fineweb_q07/duckdb:vortex-compact 477932171 480526521 0.99
fineweb_q08/duckdb:vortex-compact 22492911 24517158 0.92
duckdb / parquet (0.962x ➖, 0↑ 0↓)
name PR 53212e6 (ns) base 1f3206f (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 35183569 39076860 0.90
fineweb_q01/duckdb:parquet 91782605 96216428 0.95
fineweb_q02/duckdb:parquet 94406769 101764390 0.93
fineweb_q03/duckdb:parquet 305124478 314990878 0.97
fineweb_q04/duckdb:parquet 437823418 444293824 0.99
fineweb_q05/duckdb:parquet 408491133 416292407 0.98
fineweb_q06/duckdb:parquet 197766347 201746704 0.98
fineweb_q07/duckdb:parquet 208721831 213963310 0.98
fineweb_q08/duckdb:parquet 57382739 58151495 0.99
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-compact -5.2% -8.8% +3.9% +36.9% ➖ noise
0 datafusion:vortex-file-compressed -8.3% -8.8% +0.5% +54.1% ➖ noise
0 duckdb:vortex-compact -6.2% -8.8% +2.8% +32.9% ➖ noise
0 duckdb:vortex-file-compressed -10.2% -8.8% -1.5% +50.8% ➖ noise
1 datafusion:vortex-compact -1.9% -5.3% +3.6% +10.0% ➖ noise
1 datafusion:vortex-file-compressed -8.3% -5.3% -3.2% +25.1% ➖ noise
1 duckdb:vortex-compact +6.7% -5.3% +12.6% +20.1% ➖ noise
1 duckdb:vortex-file-compressed +1.8% -5.3% +7.5% +37.1% ➖ noise
2 datafusion:vortex-compact -2.0% -6.9% +5.3% +10.0% ➖ noise
2 datafusion:vortex-file-compressed -10.0% -6.9% -3.3% +16.5% ➖ noise
2 duckdb:vortex-compact -1.9% -6.9% +5.4% +11.8% ➖ noise
2 duckdb:vortex-file-compressed -4.2% -6.9% +2.9% +10.0% ➖ noise
3 datafusion:vortex-compact -1.9% -4.5% +2.7% +10.0% ➖ noise
3 datafusion:vortex-file-compressed +0.5% -4.5% +5.2% +20.6% ➖ noise
3 duckdb:vortex-compact -2.7% -4.5% +1.9% +10.0% ➖ noise
3 duckdb:vortex-file-compressed -18.3% -4.5% -14.4% +19.2% ➖ noise
4 datafusion:vortex-compact +0.2% -1.7% +2.0% +10.0% ➖ noise
4 datafusion:vortex-file-compressed -2.1% -1.7% -0.4% +10.0% ➖ noise
4 duckdb:vortex-compact -2.0% -1.7% -0.3% +10.0% ➖ noise
4 duckdb:vortex-file-compressed +0.0% -1.7% +1.8% +10.0% ➖ noise
5 datafusion:vortex-compact +0.1% -2.0% +2.2% +10.0% ➖ noise
5 datafusion:vortex-file-compressed -2.4% -2.0% -0.4% +10.0% ➖ noise
5 duckdb:vortex-compact -2.4% -2.0% -0.4% +10.0% ➖ noise
5 duckdb:vortex-file-compressed -1.6% -2.0% +0.4% +10.0% ➖ noise
6 datafusion:vortex-compact -1.2% -6.1% +5.2% +10.0% ➖ noise
6 datafusion:vortex-file-compressed -8.7% -6.1% -2.8% +12.9% ➖ noise
6 duckdb:vortex-compact -3.7% -6.1% +2.6% +10.0% ➖ noise
6 duckdb:vortex-file-compressed -3.6% -6.1% +2.6% +27.9% ➖ noise
7 datafusion:vortex-compact -1.3% -5.4% +4.4% +10.0% ➖ noise
7 datafusion:vortex-file-compressed -13.8% -5.4% -8.9% +13.0% ➖ noise
7 duckdb:vortex-compact -0.5% -5.4% +5.2% +10.0% ➖ noise
7 duckdb:vortex-file-compressed +4.8% -5.4% +10.9% +10.0% 🚨 regression
8 datafusion:vortex-compact +12.4% -3.8% +16.8% +19.5% ➖ noise
8 datafusion:vortex-file-compressed -20.5% -3.8% -17.3% +30.9% ➖ noise
8 duckdb:vortex-compact -8.3% -3.8% -4.7% +22.5% ➖ noise
8 duckdb:vortex-file-compressed +1.6% -3.8% +5.6% +15.6% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Mar 27, 2026

Benchmarks: TPC-DS SF=1 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.3%
Vortex (geomean): 1.015x ➖
Parquet (geomean): 1.017x ➖
Shifts: Parquet (control) +1.7% · Median polish +1.5%


datafusion / vortex-file-compressed (1.020x ➖, 1↑ 0↓)
name PR 53212e6 (ns) base 1f3206f (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-file-compressed 28859302 28787738 1.00
tpcds_q02/datafusion:vortex-file-compressed 55631645 54210832 1.03
tpcds_q03/datafusion:vortex-file-compressed 21153540 20306172 1.04
tpcds_q04/datafusion:vortex-file-compressed 302609960 297196524 1.02
tpcds_q05/datafusion:vortex-file-compressed 54593524 54800287 1.00
tpcds_q06/datafusion:vortex-file-compressed 52843360 52569814 1.01
tpcds_q07/datafusion:vortex-file-compressed 54008730 51328881 1.05
tpcds_q08/datafusion:vortex-file-compressed 38574166 37339148 1.03
tpcds_q09/datafusion:vortex-file-compressed 56509892 54988191 1.03
tpcds_q10/datafusion:vortex-file-compressed 46675890 46954898 0.99
tpcds_q11/datafusion:vortex-file-compressed 172935163 167979376 1.03
tpcds_q12/datafusion:vortex-file-compressed 23925163 23519322 1.02
tpcds_q13/datafusion:vortex-file-compressed 64537214 61806347 1.04
tpcds_q14/datafusion:vortex-file-compressed 207621378 201453954 1.03
tpcds_q15/datafusion:vortex-file-compressed 36436948 34683365 1.05
tpcds_q16/datafusion:vortex-file-compressed 29050732 28626852 1.01
tpcds_q17/datafusion:vortex-file-compressed 68716916 68092905 1.01
tpcds_q18/datafusion:vortex-file-compressed 80717655 80750929 1.00
tpcds_q19/datafusion:vortex-file-compressed 31970772 32655489 0.98
tpcds_q20/datafusion:vortex-file-compressed 26304514 26623740 0.99
tpcds_q21/datafusion:vortex-file-compressed 142831150 133273941 1.07
tpcds_q22/datafusion:vortex-file-compressed 60166386 57003620 1.06
tpcds_q23/datafusion:vortex-file-compressed 153669793 152453968 1.01
tpcds_q24/datafusion:vortex-file-compressed 114186046 113066835 1.01
tpcds_q25/datafusion:vortex-file-compressed 68921702 67920496 1.01
tpcds_q26/datafusion:vortex-file-compressed 38102417 36677606 1.04
tpcds_q27/datafusion:vortex-file-compressed 123282775 118951686 1.04
tpcds_q28/datafusion:vortex-file-compressed 50921065 49666700 1.03
tpcds_q29/datafusion:vortex-file-compressed 71072299 68275511 1.04
tpcds_q30/datafusion:vortex-file-compressed 31981524 30938715 1.03
tpcds_q31/datafusion:vortex-file-compressed 100345213 96597567 1.04
tpcds_q32/datafusion:vortex-file-compressed 21052728 21389841 0.98
tpcds_q33/datafusion:vortex-file-compressed 39016410 39588310 0.99
tpcds_q34/datafusion:vortex-file-compressed 33132986 32999455 1.00
tpcds_q35/datafusion:vortex-file-compressed 57659144 58780823 0.98
tpcds_q36/datafusion:vortex-file-compressed 78618590 76273227 1.03
tpcds_q37/datafusion:vortex-file-compressed 35221251 34690762 1.02
tpcds_q38/datafusion:vortex-file-compressed 53904877 51941404 1.04
tpcds_q39/datafusion:vortex-file-compressed 139860994 151754700 0.92
tpcds_q40/datafusion:vortex-file-compressed 53554283 53029872 1.01
tpcds_q41/datafusion:vortex-file-compressed 18943491 17664718 1.07
tpcds_q42/datafusion:vortex-file-compressed 19885579 19391981 1.03
tpcds_q43/datafusion:vortex-file-compressed 32806062 32412199 1.01
tpcds_q44/datafusion:vortex-file-compressed 45058216 43457320 1.04
tpcds_q45/datafusion:vortex-file-compressed 34497303 34404267 1.00
tpcds_q46/datafusion:vortex-file-compressed 51449494 47168037 1.09
tpcds_q47/datafusion:vortex-file-compressed 214304383 202610163 1.06
tpcds_q48/datafusion:vortex-file-compressed 48264747 48728647 0.99
tpcds_q49/datafusion:vortex-file-compressed 70574388 72127390 0.98
tpcds_q50/datafusion:vortex-file-compressed 48056055 45635842 1.05
tpcds_q51/datafusion:vortex-file-compressed 92240122 90318118 1.02
tpcds_q52/datafusion:vortex-file-compressed 18680654 18242769 1.02
tpcds_q53/datafusion:vortex-file-compressed 26193962 26186932 1.00
tpcds_q54/datafusion:vortex-file-compressed 46642282 47285232 0.99
tpcds_q55/datafusion:vortex-file-compressed 18670268 18787341 0.99
tpcds_q56/datafusion:vortex-file-compressed 41047819 40851267 1.00
tpcds_q57/datafusion:vortex-file-compressed 128815487 127245600 1.01
tpcds_q58/datafusion:vortex-file-compressed 71796860 68738103 1.04
tpcds_q59/datafusion:vortex-file-compressed 77223855 73040996 1.06
tpcds_q60/datafusion:vortex-file-compressed 41071153 40824380 1.01
tpcds_q61/datafusion:vortex-file-compressed 52418372 51681217 1.01
tpcds_q62/datafusion:vortex-file-compressed 31671817 31076669 1.02
tpcds_q63/datafusion:vortex-file-compressed 27126051 26018931 1.04
tpcds_q64/datafusion:vortex-file-compressed 484795541 481754874 1.01
tpcds_q65/datafusion:vortex-file-compressed 50008471 48317196 1.04
tpcds_q66/datafusion:vortex-file-compressed 97031049 94811627 1.02
tpcds_q67/datafusion:vortex-file-compressed 121270387 116021528 1.05
tpcds_q68/datafusion:vortex-file-compressed 48557818 45604885 1.06
tpcds_q69/datafusion:vortex-file-compressed 46112069 44351472 1.04
tpcds_q70/datafusion:vortex-file-compressed 115237571 111204814 1.04
tpcds_q71/datafusion:vortex-file-compressed 32648338 31635547 1.03
tpcds_q72/datafusion:vortex-file-compressed 2643495103 2619743685 1.01
tpcds_q73/datafusion:vortex-file-compressed 🚀 33453352 37386171 0.89
tpcds_q74/datafusion:vortex-file-compressed 122569805 117586237 1.04
tpcds_q75/datafusion:vortex-file-compressed 124446607 119143067 1.04
tpcds_q76/datafusion:vortex-file-compressed 36829917 34731447 1.06
tpcds_q77/datafusion:vortex-file-compressed 52849047 53447748 0.99
tpcds_q78/datafusion:vortex-file-compressed 126132652 125900310 1.00
tpcds_q79/datafusion:vortex-file-compressed 40924680 39631205 1.03
tpcds_q80/datafusion:vortex-file-compressed 117919241 114790493 1.03
tpcds_q81/datafusion:vortex-file-compressed 38320418 36707698 1.04
tpcds_q82/datafusion:vortex-file-compressed 34883794 36898760 0.95
tpcds_q83/datafusion:vortex-file-compressed 52057976 52147765 1.00
tpcds_q84/datafusion:vortex-file-compressed 16915424 15702031 1.08
tpcds_q85/datafusion:vortex-file-compressed 103717515 101022683 1.03
tpcds_q86/datafusion:vortex-file-compressed 20030510 18630372 1.08
tpcds_q87/datafusion:vortex-file-compressed 52560721 55073092 0.95
tpcds_q88/datafusion:vortex-file-compressed 79066945 78709967 1.00
tpcds_q89/datafusion:vortex-file-compressed 38019628 37497827 1.01
tpcds_q90/datafusion:vortex-file-compressed 18565210 18958891 0.98
tpcds_q91/datafusion:vortex-file-compressed 26657783 26454776 1.01
tpcds_q92/datafusion:vortex-file-compressed 19663255 18591760 1.06
tpcds_q93/datafusion:vortex-file-compressed 35589227 34231420 1.04
tpcds_q94/datafusion:vortex-file-compressed 26706870 24512449 1.09
tpcds_q95/datafusion:vortex-file-compressed 61286659 60416104 1.01
tpcds_q96/datafusion:vortex-file-compressed 18495698 17249522 1.07
tpcds_q97/datafusion:vortex-file-compressed 32282917 31901231 1.01
tpcds_q98/datafusion:vortex-file-compressed 32992165 33048056 1.00
tpcds_q99/datafusion:vortex-file-compressed 48862620 47990133 1.02
datafusion / vortex-compact (1.016x ➖, 0↑ 1↓)
name PR 53212e6 (ns) base 1f3206f (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-compact 39650809 36717739 1.08
tpcds_q02/datafusion:vortex-compact 58794412 58357088 1.01
tpcds_q03/datafusion:vortex-compact 26467808 25352799 1.04
tpcds_q04/datafusion:vortex-compact 343968916 330959691 1.04
tpcds_q05/datafusion:vortex-compact 67538184 67156622 1.01
tpcds_q06/datafusion:vortex-compact 56462265 56587825 1.00
tpcds_q07/datafusion:vortex-compact 68607160 66319631 1.03
tpcds_q08/datafusion:vortex-compact 47607903 48069392 0.99
tpcds_q09/datafusion:vortex-compact 104587465 106158807 0.99
tpcds_q10/datafusion:vortex-compact 64700216 64781628 1.00
tpcds_q11/datafusion:vortex-compact 190136151 187439561 1.01
tpcds_q12/datafusion:vortex-compact 26782566 26167806 1.02
tpcds_q13/datafusion:vortex-compact 133946777 128310767 1.04
tpcds_q14/datafusion:vortex-compact 259687903 254464724 1.02
tpcds_q15/datafusion:vortex-compact 39371278 39886221 0.99
tpcds_q16/datafusion:vortex-compact 41712281 40583053 1.03
tpcds_q17/datafusion:vortex-compact 95347901 94374593 1.01
tpcds_q18/datafusion:vortex-compact 95677394 97227092 0.98
tpcds_q19/datafusion:vortex-compact 46215305 45035501 1.03
tpcds_q20/datafusion:vortex-compact 31031781 30871223 1.01
tpcds_q21/datafusion:vortex-compact 149579178 140707275 1.06
tpcds_q22/datafusion:vortex-compact 67932489 68014219 1.00
tpcds_q23/datafusion:vortex-compact 187803776 184044436 1.02
tpcds_q24/datafusion:vortex-compact 143257350 142598592 1.00
tpcds_q25/datafusion:vortex-compact 100662214 96339493 1.04
tpcds_q26/datafusion:vortex-compact 49077863 49090183 1.00
tpcds_q27/datafusion:vortex-compact 160771472 162974124 0.99
tpcds_q28/datafusion:vortex-compact 103686028 100280345 1.03
tpcds_q29/datafusion:vortex-compact 96397812 95218014 1.01
tpcds_q30/datafusion:vortex-compact 38189698 36752183 1.04
tpcds_q31/datafusion:vortex-compact 129441905 125029903 1.04
tpcds_q32/datafusion:vortex-compact 28045816 26601318 1.05
tpcds_q33/datafusion:vortex-compact 52225163 53966906 0.97
tpcds_q34/datafusion:vortex-compact 50597901 49059682 1.03
tpcds_q35/datafusion:vortex-compact 70218050 70762954 0.99
tpcds_q36/datafusion:vortex-compact 99757242 103008548 0.97
tpcds_q37/datafusion:vortex-compact 50354429 51268171 0.98
tpcds_q38/datafusion:vortex-compact 69249039 68336829 1.01
tpcds_q39/datafusion:vortex-compact 150334880 154904389 0.97
tpcds_q40/datafusion:vortex-compact 60447266 59015304 1.02
tpcds_q41/datafusion:vortex-compact 22015372 22361753 0.98
tpcds_q42/datafusion:vortex-compact 25714273 25286373 1.02
tpcds_q43/datafusion:vortex-compact 40283848 39317286 1.02
tpcds_q44/datafusion:vortex-compact 74832450 74225622 1.01
tpcds_q45/datafusion:vortex-compact 37961878 38285247 0.99
tpcds_q46/datafusion:vortex-compact 70269419 71171980 0.99
tpcds_q47/datafusion:vortex-compact 236664036 228616070 1.04
tpcds_q48/datafusion:vortex-compact 100848164 100031300 1.01
tpcds_q49/datafusion:vortex-compact 99574910 98389223 1.01
tpcds_q50/datafusion:vortex-compact 63824918 64099087 1.00
tpcds_q51/datafusion:vortex-compact 98062218 96693548 1.01
tpcds_q52/datafusion:vortex-compact 26518934 25894091 1.02
tpcds_q53/datafusion:vortex-compact 36602556 35509848 1.03
tpcds_q54/datafusion:vortex-compact 57467755 58915097 0.98
tpcds_q55/datafusion:vortex-compact 24867678 24376959 1.02
tpcds_q56/datafusion:vortex-compact 55267688 55484346 1.00
tpcds_q57/datafusion:vortex-compact 144864841 141406718 1.02
tpcds_q58/datafusion:vortex-compact 79362844 77627338 1.02
tpcds_q59/datafusion:vortex-compact 87006726 87031010 1.00
tpcds_q60/datafusion:vortex-compact 54984443 56597012 0.97
tpcds_q61/datafusion:vortex-compact 73121345 75358083 0.97
tpcds_q62/datafusion:vortex-compact 34162961 33032285 1.03
tpcds_q63/datafusion:vortex-compact 37294638 35623759 1.05
tpcds_q64/datafusion:vortex-compact 547854018 546841667 1.00
tpcds_q65/datafusion:vortex-compact 70949467 68242053 1.04
tpcds_q66/datafusion:vortex-compact 102282157 101047832 1.01
tpcds_q67/datafusion:vortex-compact 128549212 128656250 1.00
tpcds_q68/datafusion:vortex-compact 69522912 69164920 1.01
tpcds_q69/datafusion:vortex-compact 60505045 60592909 1.00
tpcds_q70/datafusion:vortex-compact 124604292 128543196 0.97
tpcds_q71/datafusion:vortex-compact 46419253 47470988 0.98
tpcds_q72/datafusion:vortex-compact 2685742657 2660260913 1.01
tpcds_q73/datafusion:vortex-compact 50479917 50870120 0.99
tpcds_q74/datafusion:vortex-compact 135670875 132373107 1.02
tpcds_q75/datafusion:vortex-compact 168695830 168220973 1.00
tpcds_q76/datafusion:vortex-compact 54731204 52166001 1.05
tpcds_q77/datafusion:vortex-compact 69051302 66129978 1.04
tpcds_q78/datafusion:vortex-compact 152090286 149629927 1.02
tpcds_q79/datafusion:vortex-compact 60471918 60750737 1.00
tpcds_q80/datafusion:vortex-compact 135592255 134325070 1.01
tpcds_q81/datafusion:vortex-compact 45279694 42712651 1.06
tpcds_q82/datafusion:vortex-compact 49372032 49530836 1.00
tpcds_q83/datafusion:vortex-compact 62256137 59528348 1.05
tpcds_q84/datafusion:vortex-compact 19425062 19055622 1.02
tpcds_q85/datafusion:vortex-compact 131245773 124646597 1.05
tpcds_q86/datafusion:vortex-compact 🚨 21776205 19721539 1.10
tpcds_q87/datafusion:vortex-compact 69213256 66271399 1.04
tpcds_q88/datafusion:vortex-compact 137347063 139440109 0.98
tpcds_q89/datafusion:vortex-compact 46296346 47313279 0.98
tpcds_q90/datafusion:vortex-compact 25243944 24302606 1.04
tpcds_q91/datafusion:vortex-compact 43307829 41824107 1.04
tpcds_q92/datafusion:vortex-compact 22032212 21235617 1.04
tpcds_q93/datafusion:vortex-compact 49688652 47231872 1.05
tpcds_q94/datafusion:vortex-compact 34036118 31840570 1.07
tpcds_q95/datafusion:vortex-compact 74917443 73105836 1.02
tpcds_q96/datafusion:vortex-compact 27697566 27180423 1.02
tpcds_q97/datafusion:vortex-compact 41972949 41528940 1.01
tpcds_q98/datafusion:vortex-compact 40224995 37571114 1.07
tpcds_q99/datafusion:vortex-compact 54687927 50740743 1.08
datafusion / parquet (1.022x ➖, 0↑ 4↓)
name PR 53212e6 (ns) base 1f3206f (ns) ratio (PR/base)
tpcds_q01/datafusion:parquet 39135404 37477171 1.04
tpcds_q02/datafusion:parquet 49494804 46440849 1.07
tpcds_q03/datafusion:parquet 15541127 15832687 0.98
tpcds_q04/datafusion:parquet 333028500 324422149 1.03
tpcds_q05/datafusion:parquet 51779217 52295033 0.99
tpcds_q06/datafusion:parquet 64949416 65695296 0.99
tpcds_q07/datafusion:parquet 92021809 87556191 1.05
tpcds_q08/datafusion:parquet 35640629 34288214 1.04
tpcds_q09/datafusion:parquet 60164826 56567363 1.06
tpcds_q10/datafusion:parquet 86952651 81725942 1.06
tpcds_q11/datafusion:parquet 182708241 179770092 1.02
tpcds_q12/datafusion:parquet 23265414 23265647 1.00
tpcds_q13/datafusion:parquet 90004706 88399062 1.02
tpcds_q14/datafusion:parquet 196526335 199589751 0.98
tpcds_q15/datafusion:parquet 25051259 26645845 0.94
tpcds_q16/datafusion:parquet 29207787 29103254 1.00
tpcds_q17/datafusion:parquet 71351092 72086455 0.99
tpcds_q18/datafusion:parquet 135522933 130207602 1.04
tpcds_q19/datafusion:parquet 28967544 27982521 1.04
tpcds_q20/datafusion:parquet 22300523 20689328 1.08
tpcds_q21/datafusion:parquet 22981987 22625342 1.02
tpcds_q22/datafusion:parquet 147542782 147168999 1.00
tpcds_q23/datafusion:parquet 171854982 164863716 1.04
tpcds_q24/datafusion:parquet 109150007 106388231 1.03
tpcds_q25/datafusion:parquet 71474629 73403150 0.97
tpcds_q26/datafusion:parquet 77336279 75410302 1.03
tpcds_q27/datafusion:parquet 166185033 162185508 1.02
tpcds_q28/datafusion:parquet 51067252 48377230 1.06
tpcds_q29/datafusion:parquet 74415193 72421349 1.03
tpcds_q30/datafusion:parquet 47121366 46299280 1.02
tpcds_q31/datafusion:parquet 79204478 77452826 1.02
tpcds_q32/datafusion:parquet 23354663 22536880 1.04
tpcds_q33/datafusion:parquet 37536542 35867821 1.05
tpcds_q34/datafusion:parquet 27430496 27613320 0.99
tpcds_q35/datafusion:parquet 89512155 85770544 1.04
tpcds_q36/datafusion:parquet 65876789 65128730 1.01
tpcds_q37/datafusion:parquet 23970418 23482590 1.02
tpcds_q38/datafusion:parquet 51843132 52021203 1.00
tpcds_q39/datafusion:parquet 88566458 84489976 1.05
tpcds_q40/datafusion:parquet 🚨 31775222 27732923 1.15
tpcds_q41/datafusion:parquet 🚨 18123754 16443695 1.10
tpcds_q42/datafusion:parquet 14610212 14310611 1.02
tpcds_q43/datafusion:parquet 🚨 20849588 18437454 1.13
tpcds_q44/datafusion:parquet 43461261 42537569 1.02
tpcds_q45/datafusion:parquet 33340296 32770259 1.02
tpcds_q46/datafusion:parquet 39595162 39610765 1.00
tpcds_q47/datafusion:parquet 141261927 138291358 1.02
tpcds_q48/datafusion:parquet 82237785 81544395 1.01
tpcds_q49/datafusion:parquet 66053590 64402931 1.03
tpcds_q50/datafusion:parquet 49512845 48613544 1.02
tpcds_q51/datafusion:parquet 91492025 90605415 1.01
tpcds_q52/datafusion:parquet 15216140 14639104 1.04
tpcds_q53/datafusion:parquet 22582098 22278947 1.01
tpcds_q54/datafusion:parquet 43409645 42479645 1.02
tpcds_q55/datafusion:parquet 14099402 13906932 1.01
tpcds_q56/datafusion:parquet 36899756 36377268 1.01
tpcds_q57/datafusion:parquet 116402278 111991609 1.04
tpcds_q58/datafusion:parquet 58392336 58956482 0.99
tpcds_q59/datafusion:parquet 62755826 62999510 1.00
tpcds_q60/datafusion:parquet 37183070 36442208 1.02
tpcds_q61/datafusion:parquet 50740227 51058662 0.99
tpcds_q62/datafusion:parquet 29932316 29044220 1.03
tpcds_q63/datafusion:parquet 23491234 22652587 1.04
tpcds_q64/datafusion:parquet 566401290 557613576 1.02
tpcds_q65/datafusion:parquet 46028663 45243751 1.02
tpcds_q66/datafusion:parquet 76026206 76990681 0.99
tpcds_q67/datafusion:parquet 153229187 151547642 1.01
tpcds_q68/datafusion:parquet 41563505 38991284 1.07
tpcds_q69/datafusion:parquet 80712451 79866868 1.01
tpcds_q70/datafusion:parquet 98479225 99888503 0.99
tpcds_q71/datafusion:parquet 27960914 27353792 1.02
tpcds_q72/datafusion:parquet 642355226 634250505 1.01
tpcds_q73/datafusion:parquet 27679406 27422166 1.01
tpcds_q74/datafusion:parquet 108127191 103896277 1.04
tpcds_q75/datafusion:parquet 121063406 119550756 1.01
tpcds_q76/datafusion:parquet 36504458 35000908 1.04
tpcds_q77/datafusion:parquet 51365038 49840291 1.03
tpcds_q78/datafusion:parquet 125775356 123840078 1.02
tpcds_q79/datafusion:parquet 32983041 31716401 1.04
tpcds_q80/datafusion:parquet 95336955 93267308 1.02
tpcds_q81/datafusion:parquet 42740642 41899744 1.02
tpcds_q82/datafusion:parquet 24585775 23485900 1.05
tpcds_q83/datafusion:parquet 49701431 49437875 1.01
tpcds_q84/datafusion:parquet 48441464 49057706 0.99
tpcds_q85/datafusion:parquet 175265490 171231589 1.02
tpcds_q86/datafusion:parquet 18436896 17183408 1.07
tpcds_q87/datafusion:parquet 51956527 50283179 1.03
tpcds_q88/datafusion:parquet 71505175 70569385 1.01
tpcds_q89/datafusion:parquet 25433072 24861189 1.02
tpcds_q90/datafusion:parquet 19516880 18766694 1.04
tpcds_q91/datafusion:parquet 70020126 72875967 0.96
tpcds_q92/datafusion:parquet 22960707 22471768 1.02
tpcds_q93/datafusion:parquet 35554751 36637239 0.97
tpcds_q94/datafusion:parquet 25951267 25479081 1.02
tpcds_q95/datafusion:parquet 69105508 68544529 1.01
tpcds_q96/datafusion:parquet 15264671 14840581 1.03
tpcds_q97/datafusion:parquet 🚨 35523485 32148275 1.10
tpcds_q98/datafusion:parquet 25055642 26447527 0.95
tpcds_q99/datafusion:parquet 28725285 29024513 0.99
duckdb / vortex-file-compressed (1.006x ➖, 1↑ 1↓)
name PR 53212e6 (ns) base 1f3206f (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-file-compressed 27679212 25797346 1.07
tpcds_q02/duckdb:vortex-file-compressed 83126850 85358519 0.97
tpcds_q03/duckdb:vortex-file-compressed 24976812 24210081 1.03
tpcds_q04/duckdb:vortex-file-compressed 106827841 109295549 0.98
tpcds_q05/duckdb:vortex-file-compressed 104011098 97992603 1.06
tpcds_q06/duckdb:vortex-file-compressed 36514838 37043992 0.99
tpcds_q07/duckdb:vortex-file-compressed 25289494 25732971 0.98
tpcds_q08/duckdb:vortex-file-compressed 24356211 24806634 0.98
tpcds_q09/duckdb:vortex-file-compressed 41093051 40416111 1.02
tpcds_q10/duckdb:vortex-file-compressed 38918974 37088748 1.05
tpcds_q11/duckdb:vortex-file-compressed 64169357 65338788 0.98
tpcds_q12/duckdb:vortex-file-compressed 14682658 15280685 0.96
tpcds_q13/duckdb:vortex-file-compressed 35458679 33630927 1.05
tpcds_q14/duckdb:vortex-file-compressed 199636840 190493219 1.05
tpcds_q15/duckdb:vortex-file-compressed 42387872 42763293 0.99
tpcds_q16/duckdb:vortex-file-compressed 30588927 31881105 0.96
tpcds_q17/duckdb:vortex-file-compressed 40005590 39968327 1.00
tpcds_q18/duckdb:vortex-file-compressed 48131389 48266938 1.00
tpcds_q19/duckdb:vortex-file-compressed 34986309 33391355 1.05
tpcds_q20/duckdb:vortex-file-compressed 16470970 17047435 0.97
tpcds_q21/duckdb:vortex-file-compressed 20128654 19162085 1.05
tpcds_q22/duckdb:vortex-file-compressed 119509446 111197924 1.07
tpcds_q23/duckdb:vortex-file-compressed 121441138 127704887 0.95
tpcds_q24/duckdb:vortex-file-compressed 58692570 57189512 1.03
tpcds_q25/duckdb:vortex-file-compressed 38846531 38697165 1.00
tpcds_q26/duckdb:vortex-file-compressed 40781809 41197710 0.99
tpcds_q27/duckdb:vortex-file-compressed 90681770 90018141 1.01
tpcds_q28/duckdb:vortex-file-compressed 38089975 38867589 0.98
tpcds_q29/duckdb:vortex-file-compressed 39136282 39843399 0.98
tpcds_q30/duckdb:vortex-file-compressed 28694613 29896827 0.96
tpcds_q31/duckdb:vortex-file-compressed 27375523 26858663 1.02
tpcds_q32/duckdb:vortex-file-compressed 16891449 17385266 0.97
tpcds_q33/duckdb:vortex-file-compressed 67237843 66033044 1.02
tpcds_q34/duckdb:vortex-file-compressed 20694651 20455446 1.01
tpcds_q35/duckdb:vortex-file-compressed 63893314 62057946 1.03
tpcds_q36/duckdb:vortex-file-compressed 29022341 28071588 1.03
tpcds_q37/duckdb:vortex-file-compressed 22411284 22420206 1.00
tpcds_q38/duckdb:vortex-file-compressed 38613941 37262399 1.04
tpcds_q39/duckdb:vortex-file-compressed 47892433 48895853 0.98
tpcds_q40/duckdb:vortex-file-compressed 24174233 25078088 0.96
tpcds_q41/duckdb:vortex-file-compressed 14300388 14397055 0.99
tpcds_q42/duckdb:vortex-file-compressed 11636346 11995043 0.97
tpcds_q43/duckdb:vortex-file-compressed 20546126 20558077 1.00
tpcds_q44/duckdb:vortex-file-compressed 24845177 23607344 1.05
tpcds_q45/duckdb:vortex-file-compressed 26785484 28486095 0.94
tpcds_q46/duckdb:vortex-file-compressed 50156128 49038107 1.02
tpcds_q47/duckdb:vortex-file-compressed 52281335 49628751 1.05
tpcds_q48/duckdb:vortex-file-compressed 32993498 30904966 1.07
tpcds_q49/duckdb:vortex-file-compressed 31417144 31947283 0.98
tpcds_q50/duckdb:vortex-file-compressed 37867868 37774804 1.00
tpcds_q51/duckdb:vortex-file-compressed 100238507 99399337 1.01
tpcds_q52/duckdb:vortex-file-compressed 11919278 12806602 0.93
tpcds_q53/duckdb:vortex-file-compressed 18232852 17182873 1.06
tpcds_q54/duckdb:vortex-file-compressed 50154251 48517487 1.03
tpcds_q55/duckdb:vortex-file-compressed 12183665 12720039 0.96
tpcds_q56/duckdb:vortex-file-compressed 67636536 68787248 0.98
tpcds_q57/duckdb:vortex-file-compressed 46657214 45668149 1.02
tpcds_q58/duckdb:vortex-file-compressed 34989281 34458965 1.02
tpcds_q59/duckdb:vortex-file-compressed 57930574 58206570 1.00
tpcds_q60/duckdb:vortex-file-compressed 70639925 70567607 1.00
tpcds_q61/duckdb:vortex-file-compressed 39781457 40090588 0.99
tpcds_q62/duckdb:vortex-file-compressed 19901478 20567536 0.97
tpcds_q63/duckdb:vortex-file-compressed 18112432 17938647 1.01
tpcds_q64/duckdb:vortex-file-compressed 85969118 81478265 1.06
tpcds_q65/duckdb:vortex-file-compressed 23360097 24377346 0.96
tpcds_q66/duckdb:vortex-file-compressed 🚨 64275239 54523414 1.18
tpcds_q67/duckdb:vortex-file-compressed 149984921 145424587 1.03
tpcds_q68/duckdb:vortex-file-compressed 41885940 41857149 1.00
tpcds_q69/duckdb:vortex-file-compressed 39776312 39120309 1.02
tpcds_q70/duckdb:vortex-file-compressed 25360108 25312173 1.00
tpcds_q71/duckdb:vortex-file-compressed 21458745 22000826 0.98
tpcds_q72/duckdb:vortex-file-compressed 179438955 179683597 1.00
tpcds_q73/duckdb:vortex-file-compressed 19862705 20187574 0.98
tpcds_q74/duckdb:vortex-file-compressed 51861611 50428855 1.03
tpcds_q75/duckdb:vortex-file-compressed 58297151 62449008 0.93
tpcds_q76/duckdb:vortex-file-compressed 70360518 68737374 1.02
tpcds_q77/duckdb:vortex-file-compressed 68433134 64679354 1.06
tpcds_q78/duckdb:vortex-file-compressed 77298875 80770362 0.96
tpcds_q79/duckdb:vortex-file-compressed 37959642 37986656 1.00
tpcds_q80/duckdb:vortex-file-compressed 93968769 89630117 1.05
tpcds_q81/duckdb:vortex-file-compressed 34493591 34985049 0.99
tpcds_q82/duckdb:vortex-file-compressed 23122161 23056340 1.00
tpcds_q83/duckdb:vortex-file-compressed 30094342 27753769 1.08
tpcds_q84/duckdb:vortex-file-compressed 18247715 18167108 1.00
tpcds_q85/duckdb:vortex-file-compressed 45997857 46228074 1.00
tpcds_q86/duckdb:vortex-file-compressed 17402249 17773875 0.98
tpcds_q87/duckdb:vortex-file-compressed 🚀 39841728 44698184 0.89
tpcds_q88/duckdb:vortex-file-compressed 37895480 36331355 1.04
tpcds_q89/duckdb:vortex-file-compressed 19105295 18676999 1.02
tpcds_q90/duckdb:vortex-file-compressed 15927098 15733257 1.01
tpcds_q91/duckdb:vortex-file-compressed 27403758 27492304 1.00
tpcds_q92/duckdb:vortex-file-compressed 14810217 14213193 1.04
tpcds_q93/duckdb:vortex-file-compressed 31135853 30036090 1.04
tpcds_q94/duckdb:vortex-file-compressed 23615620 22858367 1.03
tpcds_q95/duckdb:vortex-file-compressed 156474206 159417398 0.98
tpcds_q96/duckdb:vortex-file-compressed 12773010 13077464 0.98
tpcds_q97/duckdb:vortex-file-compressed 39240373 39971530 0.98
tpcds_q98/duckdb:vortex-file-compressed 18754990 18608984 1.01
tpcds_q99/duckdb:vortex-file-compressed 32792571 32569735 1.01
duckdb / vortex-compact (1.020x ➖, 0↑ 3↓)
name PR 53212e6 (ns) base 1f3206f (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-compact 35167242 34415932 1.02
tpcds_q02/duckdb:vortex-compact 128038165 125114210 1.02
tpcds_q03/duckdb:vortex-compact 52565239 52013218 1.01
tpcds_q04/duckdb:vortex-compact 123941730 123477885 1.00
tpcds_q05/duckdb:vortex-compact 170591472 164431694 1.04
tpcds_q06/duckdb:vortex-compact 38202683 37482721 1.02
tpcds_q07/duckdb:vortex-compact 37197946 36970584 1.01
tpcds_q08/duckdb:vortex-compact 29981492 29279003 1.02
tpcds_q09/duckdb:vortex-compact 114180727 110967874 1.03
tpcds_q10/duckdb:vortex-compact 46825961 47014615 1.00
tpcds_q11/duckdb:vortex-compact 74391765 75206653 0.99
tpcds_q12/duckdb:vortex-compact 19156428 20382189 0.94
tpcds_q13/duckdb:vortex-compact 49359310 48567553 1.02
tpcds_q14/duckdb:vortex-compact 278336190 270648570 1.03
tpcds_q15/duckdb:vortex-compact 46268703 45489860 1.02
tpcds_q16/duckdb:vortex-compact 39496372 37462592 1.05
tpcds_q17/duckdb:vortex-compact 52267059 50122717 1.04
tpcds_q18/duckdb:vortex-compact 67604223 67658400 1.00
tpcds_q19/duckdb:vortex-compact 40583067 38485442 1.05
tpcds_q20/duckdb:vortex-compact 22826858 21446625 1.06
tpcds_q21/duckdb:vortex-compact 27425847 30089689 0.91
tpcds_q22/duckdb:vortex-compact 119372670 117100072 1.02
tpcds_q23/duckdb:vortex-compact 164946503 171773224 0.96
tpcds_q24/duckdb:vortex-compact 70584607 69539938 1.02
tpcds_q25/duckdb:vortex-compact 51622278 49206513 1.05
tpcds_q26/duckdb:vortex-compact 55748781 52564134 1.06
tpcds_q27/duckdb:vortex-compact 134611036 132140678 1.02
tpcds_q28/duckdb:vortex-compact 108676972 106806488 1.02
tpcds_q29/duckdb:vortex-compact 50639903 51768119 0.98
tpcds_q30/duckdb:vortex-compact 36809348 35191742 1.05
tpcds_q31/duckdb:vortex-compact 32276819 30237510 1.07
tpcds_q32/duckdb:vortex-compact 23734345 23605313 1.01
tpcds_q33/duckdb:vortex-compact 136818596 136767997 1.00
tpcds_q34/duckdb:vortex-compact 25294573 24526821 1.03
tpcds_q35/duckdb:vortex-compact 69574390 67401469 1.03
tpcds_q36/duckdb:vortex-compact 36218376 35509659 1.02
tpcds_q37/duckdb:vortex-compact 33512501 32014516 1.05
tpcds_q38/duckdb:vortex-compact 40905718 40104591 1.02
tpcds_q39/duckdb:vortex-compact 54405677 53757328 1.01
tpcds_q40/duckdb:vortex-compact 31834729 30846280 1.03
tpcds_q41/duckdb:vortex-compact 17787462 17681682 1.01
tpcds_q42/duckdb:vortex-compact 15800044 15574120 1.01
tpcds_q43/duckdb:vortex-compact 24881045 25221339 0.99
tpcds_q44/duckdb:vortex-compact 31889985 30963641 1.03
tpcds_q45/duckdb:vortex-compact 🚨 35835987 31220217 1.15
tpcds_q46/duckdb:vortex-compact 58337065 56368647 1.03
tpcds_q47/duckdb:vortex-compact 56416528 55921982 1.01
tpcds_q48/duckdb:vortex-compact 42437711 42444916 1.00
tpcds_q49/duckdb:vortex-compact 48423865 47086397 1.03
tpcds_q50/duckdb:vortex-compact 44542455 43652114 1.02
tpcds_q51/duckdb:vortex-compact 106360485 103782494 1.02
tpcds_q52/duckdb:vortex-compact 15313662 16400298 0.93
tpcds_q53/duckdb:vortex-compact 23023447 23073361 1.00
tpcds_q54/duckdb:vortex-compact 88041248 85269772 1.03
tpcds_q55/duckdb:vortex-compact 15247505 15424080 0.99
tpcds_q56/duckdb:vortex-compact 134607354 128562692 1.05
tpcds_q57/duckdb:vortex-compact 49839799 50409863 0.99
tpcds_q58/duckdb:vortex-compact 41807057 41776585 1.00
tpcds_q59/duckdb:vortex-compact 68114952 68683831 0.99
tpcds_q60/duckdb:vortex-compact 131486508 134369552 0.98
tpcds_q61/duckdb:vortex-compact 49822595 51505364 0.97
tpcds_q62/duckdb:vortex-compact 22883259 22306901 1.03
tpcds_q63/duckdb:vortex-compact 23593961 23205518 1.02
tpcds_q64/duckdb:vortex-compact 102775212 99256503 1.04
tpcds_q65/duckdb:vortex-compact 28700525 28433579 1.01
tpcds_q66/duckdb:vortex-compact 102084790 94978229 1.07
tpcds_q67/duckdb:vortex-compact 151904681 155737136 0.98
tpcds_q68/duckdb:vortex-compact 52833916 51731652 1.02
tpcds_q69/duckdb:vortex-compact 46750388 47233912 0.99
tpcds_q70/duckdb:vortex-compact 29637524 30086909 0.99
tpcds_q71/duckdb:vortex-compact 25213193 25734581 0.98
tpcds_q72/duckdb:vortex-compact 197156286 197847998 1.00
tpcds_q73/duckdb:vortex-compact 25211153 23859858 1.06
tpcds_q74/duckdb:vortex-compact 56809728 56294536 1.01
tpcds_q75/duckdb:vortex-compact 75307486 72984798 1.03
tpcds_q76/duckdb:vortex-compact 129831505 119965769 1.08
tpcds_q77/duckdb:vortex-compact 128496925 120925326 1.06
tpcds_q78/duckdb:vortex-compact 85012230 84535764 1.01
tpcds_q79/duckdb:vortex-compact 🚨 58790934 51377586 1.14
tpcds_q80/duckdb:vortex-compact 160987926 154881368 1.04
tpcds_q81/duckdb:vortex-compact 40544581 41475889 0.98
tpcds_q82/duckdb:vortex-compact 32291871 32402731 1.00
tpcds_q83/duckdb:vortex-compact 47742760 45467594 1.05
tpcds_q84/duckdb:vortex-compact 23412661 21607188 1.08
tpcds_q85/duckdb:vortex-compact 65694612 60353120 1.09
tpcds_q86/duckdb:vortex-compact 20038428 20111934 1.00
tpcds_q87/duckdb:vortex-compact 41865431 40625846 1.03
tpcds_q88/duckdb:vortex-compact 38763041 38532300 1.01
tpcds_q89/duckdb:vortex-compact 24303387 23351450 1.04
tpcds_q90/duckdb:vortex-compact 17484845 16447791 1.06
tpcds_q91/duckdb:vortex-compact 47469763 43663840 1.09
tpcds_q92/duckdb:vortex-compact 19902157 20379675 0.98
tpcds_q93/duckdb:vortex-compact 36447649 35498864 1.03
tpcds_q94/duckdb:vortex-compact 28901521 28755668 1.01
tpcds_q95/duckdb:vortex-compact 146518601 160147098 0.91
tpcds_q96/duckdb:vortex-compact 14029137 13654384 1.03
tpcds_q97/duckdb:vortex-compact 41626922 41243836 1.01
tpcds_q98/duckdb:vortex-compact 23771082 23499777 1.01
tpcds_q99/duckdb:vortex-compact 🚨 39540353 34953090 1.13
duckdb / parquet (1.012x ➖, 0↑ 1↓)
name PR 53212e6 (ns) base 1f3206f (ns) ratio (PR/base)
tpcds_q01/duckdb:parquet 48830850 44748803 1.09
tpcds_q02/duckdb:parquet 59230261 60574274 0.98
tpcds_q03/duckdb:parquet 12215444 11936075 1.02
tpcds_q04/duckdb:parquet 124990842 127979281 0.98
tpcds_q05/duckdb:parquet 🚨 73606538 66813429 1.10
tpcds_q06/duckdb:parquet 29483920 28530066 1.03
tpcds_q07/duckdb:parquet 23115785 23746587 0.97
tpcds_q08/duckdb:parquet 28846789 28108294 1.03
tpcds_q09/duckdb:parquet 39593797 39512161 1.00
tpcds_q10/duckdb:parquet 36571355 34623686 1.06
tpcds_q11/duckdb:parquet 92230730 87516524 1.05
tpcds_q12/duckdb:parquet 14959941 14689234 1.02
tpcds_q13/duckdb:parquet 34951235 34271364 1.02
tpcds_q14/duckdb:parquet 163630446 170561039 0.96
tpcds_q15/duckdb:parquet 30730514 29977643 1.03
tpcds_q16/duckdb:parquet 21776205 22191850 0.98
tpcds_q17/duckdb:parquet 38855968 39284998 0.99
tpcds_q18/duckdb:parquet 47020362 46550960 1.01
tpcds_q19/duckdb:parquet 29149226 29053617 1.00
tpcds_q20/duckdb:parquet 15318696 15668576 0.98
tpcds_q21/duckdb:parquet 11591828 12616007 0.92
tpcds_q22/duckdb:parquet 71158005 69979847 1.02
tpcds_q23/duckdb:parquet 116216714 110363434 1.05
tpcds_q24/duckdb:parquet 46743937 46392317 1.01
tpcds_q25/duckdb:parquet 32723802 32900358 0.99
tpcds_q26/duckdb:parquet 38629340 37277267 1.04
tpcds_q27/duckdb:parquet 90214297 90436565 1.00
tpcds_q28/duckdb:parquet 37284557 37293021 1.00
tpcds_q29/duckdb:parquet 36781234 35714599 1.03
tpcds_q30/duckdb:parquet 41572778 39180155 1.06
tpcds_q31/duckdb:parquet 23567540 23281881 1.01
tpcds_q32/duckdb:parquet 11089931 11419495 0.97
tpcds_q33/duckdb:parquet 71269386 71774995 0.99
tpcds_q34/duckdb:parquet 21415949 20987544 1.02
tpcds_q35/duckdb:parquet 59922329 59571875 1.01
tpcds_q36/duckdb:parquet 20446011 20360926 1.00
tpcds_q37/duckdb:parquet 13734721 13511545 1.02
tpcds_q38/duckdb:parquet 34876750 32273583 1.08
tpcds_q39/duckdb:parquet 33477200 33230183 1.01
tpcds_q40/duckdb:parquet 18202614 17982246 1.01
tpcds_q41/duckdb:parquet 7415733 7565263 0.98
tpcds_q42/duckdb:parquet 10380661 10016457 1.04
tpcds_q43/duckdb:parquet 15831415 15581871 1.02
tpcds_q44/duckdb:parquet 21418473 20630965 1.04
tpcds_q45/duckdb:parquet 27622603 27267998 1.01
tpcds_q46/duckdb:parquet 46279501 47065420 0.98
tpcds_q47/duckdb:parquet 46776551 45853005 1.02
tpcds_q48/duckdb:parquet 30744418 30614829 1.00
tpcds_q49/duckdb:parquet 25291714 24525255 1.03
tpcds_q50/duckdb:parquet 24735272 24720293 1.00
tpcds_q51/duckdb:parquet 95038952 97444897 0.98
tpcds_q52/duckdb:parquet 11092082 11166427 0.99
tpcds_q53/duckdb:parquet 16839522 16113710 1.05
tpcds_q54/duckdb:parquet 42075689 40780264 1.03
tpcds_q55/duckdb:parquet 10609333 10501059 1.01
tpcds_q56/duckdb:parquet 68320389 67983708 1.00
tpcds_q57/duckdb:parquet 35881241 35371883 1.01
tpcds_q58/duckdb:parquet 21449685 21521724 1.00
tpcds_q59/duckdb:parquet 37467751 36267779 1.03
tpcds_q60/duckdb:parquet 73868256 72827570 1.01
tpcds_q61/duckdb:parquet 31774584 31116562 1.02
tpcds_q62/duckdb:parquet 11498073 11424040 1.01
tpcds_q63/duckdb:parquet 15341133 15108687 1.02
tpcds_q64/duckdb:parquet 75135384 74832221 1.00
tpcds_q65/duckdb:parquet 22087390 20278113 1.09
tpcds_q66/duckdb:parquet 56336479 56847500 0.99
tpcds_q67/duckdb:parquet 134955311 138203917 0.98
tpcds_q68/duckdb:parquet 38535716 38396794 1.00
tpcds_q69/duckdb:parquet 36521667 38217010 0.96
tpcds_q70/duckdb:parquet 20238937 19441584 1.04
tpcds_q71/duckdb:parquet 19466202 19546189 1.00
tpcds_q72/duckdb:parquet 164897981 166377608 0.99
tpcds_q73/duckdb:parquet 18343365 18731867 0.98
tpcds_q74/duckdb:parquet 50270328 50671078 0.99
tpcds_q75/duckdb:parquet 53838068 53156952 1.01
tpcds_q76/duckdb:parquet 71114924 66511303 1.07
tpcds_q77/duckdb:parquet 63722663 62572216 1.02
tpcds_q78/duckdb:parquet 76302482 72220055 1.06
tpcds_q79/duckdb:parquet 29919329 28555730 1.05
tpcds_q80/duckdb:parquet 84327640 82944727 1.02
tpcds_q81/duckdb:parquet 46355365 47818951 0.97
tpcds_q82/duckdb:parquet 15832714 15799600 1.00
tpcds_q83/duckdb:parquet 16643053 16102588 1.03
tpcds_q84/duckdb:parquet 20387075 19798951 1.03
tpcds_q85/duckdb:parquet 40216731 38912122 1.03
tpcds_q86/duckdb:parquet 12885096 12386259 1.04
tpcds_q87/duckdb:parquet 37686573 37914112 0.99
tpcds_q88/duckdb:parquet 29170464 29136940 1.00
tpcds_q89/duckdb:parquet 17861420 17347515 1.03
tpcds_q90/duckdb:parquet 8070657 7482131 1.08
tpcds_q91/duckdb:parquet 23601900 23697001 1.00
tpcds_q92/duckdb:parquet 11647981 11510701 1.01
tpcds_q93/duckdb:parquet 30326151 30588204 0.99
tpcds_q94/duckdb:parquet 16643869 16079302 1.04
tpcds_q95/duckdb:parquet 122957343 131557583 0.93
tpcds_q96/duckdb:parquet 9364944 9308474 1.01
tpcds_q97/duckdb:parquet 34333033 36201008 0.95
tpcds_q98/duckdb:parquet 18805844 18190018 1.03
tpcds_q99/duckdb:parquet 19563157 20299605 0.96
duckdb / duckdb (1.010x ➖, 1↑ 4↓)
name PR 53212e6 (ns) base 1f3206f (ns) ratio (PR/base)
tpcds_q01/duckdb:duckdb 20424182 20902796 0.98
tpcds_q02/duckdb:duckdb 18639555 18594710 1.00
tpcds_q03/duckdb:duckdb 8355239 8592120 0.97
tpcds_q04/duckdb:duckdb 164017401 164536249 1.00
tpcds_q05/duckdb:duckdb 17437289 18275492 0.95
tpcds_q06/duckdb:duckdb 🚨 24899667 22493513 1.11
tpcds_q07/duckdb:duckdb 38265299 38850621 0.98
tpcds_q08/duckdb:duckdb 122182186 119110205 1.03
tpcds_q09/duckdb:duckdb 20130663 19555894 1.03
tpcds_q10/duckdb:duckdb 24347703 23244802 1.05
tpcds_q11/duckdb:duckdb 140869248 139936731 1.01
tpcds_q12/duckdb:duckdb 10837760 10755652 1.01
tpcds_q13/duckdb:duckdb 23356041 23928361 0.98
tpcds_q14/duckdb:duckdb 94395093 94103566 1.00
tpcds_q15/duckdb:duckdb 24431727 23972450 1.02
tpcds_q16/duckdb:duckdb 🚨 18209136 16452786 1.11
tpcds_q17/duckdb:duckdb 21763986 21143919 1.03
tpcds_q18/duckdb:duckdb 43146206 44565574 0.97
tpcds_q19/duckdb:duckdb 16214568 16536782 0.98
tpcds_q20/duckdb:duckdb 11805715 11513913 1.03
tpcds_q21/duckdb:duckdb 6384954 6926720 0.92
tpcds_q22/duckdb:duckdb 61542304 61191524 1.01
tpcds_q23/duckdb:duckdb 81568868 76381706 1.07
tpcds_q24/duckdb:duckdb 24435849 23914689 1.02
tpcds_q25/duckdb:duckdb 16873678 16691543 1.01
tpcds_q26/duckdb:duckdb 25885840 24263759 1.07
tpcds_q27/duckdb:duckdb 40620920 40837149 0.99
tpcds_q28/duckdb:duckdb 21191417 21369318 0.99
tpcds_q29/duckdb:duckdb 19488266 20007600 0.97
tpcds_q30/duckdb:duckdb 29385438 28885824 1.02
tpcds_q31/duckdb:duckdb 20292634 20054030 1.01
tpcds_q32/duckdb:duckdb 7084603 7055416 1.00
tpcds_q33/duckdb:duckdb 13807222 12766165 1.08
tpcds_q34/duckdb:duckdb 14694230 14487014 1.01
tpcds_q35/duckdb:duckdb 30787387 33284058 0.92
tpcds_q36/duckdb:duckdb 68916239 69616285 0.99
tpcds_q37/duckdb:duckdb 8028909 7502166 1.07
tpcds_q38/duckdb:duckdb 30356653 30366628 1.00
tpcds_q39/duckdb:duckdb 🚀 26391791 30468744 0.87
tpcds_q40/duckdb:duckdb 13989833 13072133 1.07
tpcds_q41/duckdb:duckdb 8084411 7999768 1.01
tpcds_q42/duckdb:duckdb 6206399 6084125 1.02
tpcds_q43/duckdb:duckdb 11291623 11132958 1.01
tpcds_q44/duckdb:duckdb 13332531 13930070 0.96
tpcds_q45/duckdb:duckdb 🚨 18953013 16844325 1.13
tpcds_q46/duckdb:duckdb 38353898 35603181 1.08
tpcds_q47/duckdb:duckdb 41277657 40614206 1.02
tpcds_q48/duckdb:duckdb 21682616 21251730 1.02
tpcds_q49/duckdb:duckdb 15804211 15216308 1.04
tpcds_q50/duckdb:duckdb 14219007 13839653 1.03
tpcds_q51/duckdb:duckdb 93150186 92716369 1.00
tpcds_q52/duckdb:duckdb 7539978 7453659 1.01
tpcds_q53/duckdb:duckdb 11777344 11851725 0.99
tpcds_q54/duckdb:duckdb 16696156 17391802 0.96
tpcds_q55/duckdb:duckdb 7035648 7001915 1.00
tpcds_q56/duckdb:duckdb 13669905 13408625 1.02
tpcds_q57/duckdb:duckdb 30906657 30952960 1.00
tpcds_q58/duckdb:duckdb 11821861 11766876 1.00
tpcds_q59/duckdb:duckdb 34333360 34723433 0.99
tpcds_q60/duckdb:duckdb 15370871 15075243 1.02
tpcds_q61/duckdb:duckdb 14304575 14364427 1.00
tpcds_q62/duckdb:duckdb 9142076 9266949 0.99
tpcds_q63/duckdb:duckdb 11232121 11440823 0.98
tpcds_q64/duckdb:duckdb 54426726 52194848 1.04
tpcds_q65/duckdb:duckdb 33159088 33292546 1.00
tpcds_q66/duckdb:duckdb 25243980 25088674 1.01
tpcds_q67/duckdb:duckdb 130684756 127636456 1.02
tpcds_q68/duckdb:duckdb 26291128 24704381 1.06
tpcds_q69/duckdb:duckdb 25089004 24000564 1.05
tpcds_q70/duckdb:duckdb 14100965 15378050 0.92
tpcds_q71/duckdb:duckdb 12905797 12707962 1.02
tpcds_q72/duckdb:duckdb 43649059 42488777 1.03
tpcds_q73/duckdb:duckdb 10653300 10482786 1.02
tpcds_q74/duckdb:duckdb 96606854 98327997 0.98
tpcds_q75/duckdb:duckdb 42588188 43170881 0.99
tpcds_q76/duckdb:duckdb 12416090 12045317 1.03
tpcds_q77/duckdb:duckdb 11689425 11513444 1.02
tpcds_q78/duckdb:duckdb 63375426 61353890 1.03
tpcds_q79/duckdb:duckdb 17589122 17675633 1.00
tpcds_q80/duckdb:duckdb 28710812 27118227 1.06
tpcds_q81/duckdb:duckdb 37133098 38039193 0.98
tpcds_q82/duckdb:duckdb 8474498 8305613 1.02
tpcds_q83/duckdb:duckdb 9363376 9270516 1.01
tpcds_q84/duckdb:duckdb 🚨 15075375 13619196 1.11
tpcds_q85/duckdb:duckdb 22402239 24319320 0.92
tpcds_q86/duckdb:duckdb 10820829 10781360 1.00
tpcds_q87/duckdb:duckdb 32400199 34035518 0.95
tpcds_q88/duckdb:duckdb 24191337 24174865 1.00
tpcds_q89/duckdb:duckdb 13321782 13148862 1.01
tpcds_q90/duckdb:duckdb 5485385 5641256 0.97
tpcds_q91/duckdb:duckdb 13065873 12538949 1.04
tpcds_q92/duckdb:duckdb 8924047 8551983 1.04
tpcds_q93/duckdb:duckdb 22614773 21361268 1.06
tpcds_q94/duckdb:duckdb 13164925 12656790 1.04
tpcds_q95/duckdb:duckdb 111921643 109861575 1.02
tpcds_q96/duckdb:duckdb 4464220 4416662 1.01
tpcds_q97/duckdb:duckdb 30752794 30326094 1.01
tpcds_q98/duckdb:duckdb 13655049 13340999 1.02
tpcds_q99/duckdb:duckdb 16405679 16898605 0.97
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact +8.0% +6.7% +1.2% +11.1% ➖ noise
1 datafusion:vortex-file-compressed +0.2% +6.7% -6.1% +11.6% ➖ noise
1 duckdb:duckdb -2.3% +6.7% -8.5% +10.6% ➖ noise
1 duckdb:vortex-compact +2.2% +6.7% -4.3% +14.6% ➖ noise
1 duckdb:vortex-file-compressed +7.3% +6.7% +0.5% +12.4% ➖ noise
2 datafusion:vortex-compact +0.7% +2.1% -1.3% +10.0% ➖ noise
2 datafusion:vortex-file-compressed +2.6% +2.1% +0.5% +10.0% ➖ noise
2 duckdb:duckdb +0.2% +2.1% -1.8% +10.9% ➖ noise
2 duckdb:vortex-compact +2.3% +2.1% +0.2% +10.0% ➖ noise
2 duckdb:vortex-file-compressed -2.6% +2.1% -4.6% +11.2% ➖ noise
3 datafusion:vortex-compact +4.4% +0.2% +4.2% +10.6% ➖ noise
3 datafusion:vortex-file-compressed +4.2% +0.2% +3.9% +10.5% ➖ noise
3 duckdb:duckdb -2.8% +0.2% -3.0% +15.3% ➖ noise
3 duckdb:vortex-compact +1.1% +0.2% +0.8% +12.3% ➖ noise
3 duckdb:vortex-file-compressed +3.2% +0.2% +2.9% +10.1% ➖ noise
4 datafusion:vortex-compact +3.9% +0.1% +3.8% +10.0% ➖ noise
4 datafusion:vortex-file-compressed +1.8% +0.1% +1.7% +10.0% ➖ noise
4 duckdb:duckdb -0.3% +0.1% -0.4% +10.0% ➖ noise
4 duckdb:vortex-compact +0.4% +0.1% +0.2% +10.0% ➖ noise
4 duckdb:vortex-file-compressed -2.3% +0.1% -2.4% +10.0% ➖ noise
5 datafusion:vortex-compact +0.6% +4.4% -3.7% +12.2% ➖ noise
5 datafusion:vortex-file-compressed -0.4% +4.4% -4.6% +10.3% ➖ noise
5 duckdb:duckdb -4.6% +4.4% -8.6% +20.4% ➖ noise
5 duckdb:vortex-compact +3.7% +4.4% -0.7% +14.3% ➖ noise
5 duckdb:vortex-file-compressed +6.1% +4.4% +1.6% +10.7% ➖ noise
6 datafusion:vortex-compact -0.2% +1.1% -1.3% +10.0% ➖ noise
6 datafusion:vortex-file-compressed +0.5% +1.1% -0.6% +10.0% ➖ noise
6 duckdb:duckdb +10.7% +1.1% +9.5% +13.8% ➖ noise
6 duckdb:vortex-compact +1.9% +1.1% +0.8% +10.0% ➖ noise
6 duckdb:vortex-file-compressed -1.4% +1.1% -2.5% +19.4% ➖ noise
7 datafusion:vortex-compact +3.4% +1.1% +2.3% +11.1% ➖ noise
7 datafusion:vortex-file-compressed +5.2% +1.1% +4.0% +10.0% ➖ noise
7 duckdb:duckdb -1.5% +1.1% -2.6% +18.3% ➖ noise
7 duckdb:vortex-compact +0.6% +1.1% -0.5% +10.0% ➖ noise
7 duckdb:vortex-file-compressed -1.7% +1.1% -2.8% +10.0% ➖ noise
8 datafusion:vortex-compact -1.0% +3.3% -4.1% +10.0% ➖ noise
8 datafusion:vortex-file-compressed +3.3% +3.3% +0.0% +11.2% ➖ noise
8 duckdb:duckdb +2.6% +3.3% -0.7% +10.0% ➖ noise
8 duckdb:vortex-compact +2.4% +3.3% -0.9% +10.0% ➖ noise
8 duckdb:vortex-file-compressed -1.8% +3.3% -4.9% +10.4% ➖ noise
9 datafusion:vortex-compact -1.5% +3.2% -4.6% +10.0% ➖ noise
9 datafusion:vortex-file-compressed +2.8% +3.2% -0.5% +10.0% ➖ noise
9 duckdb:duckdb +2.9% +3.2% -0.3% +10.0% ➖ noise
9 duckdb:vortex-compact +2.9% +3.2% -0.3% +10.0% ➖ noise
9 duckdb:vortex-file-compressed +1.7% +3.2% -1.5% +10.0% ➖ noise
10 datafusion:vortex-compact -0.1% +6.0% -5.8% +10.0% ➖ noise
10 datafusion:vortex-file-compressed -0.6% +6.0% -6.2% +10.0% ➖ noise
10 duckdb:duckdb +4.7% +6.0% -1.2% +14.2% ➖ noise
10 duckdb:vortex-compact -0.4% +6.0% -6.0% +10.0% ➖ noise
10 duckdb:vortex-file-compressed +4.9% +6.0% -1.0% +10.0% ➖ noise
11 datafusion:vortex-compact +1.4% +3.5% -2.0% +10.0% ➖ noise
11 datafusion:vortex-file-compressed +3.0% +3.5% -0.5% +10.0% ➖ noise
11 duckdb:duckdb +0.7% +3.5% -2.7% +10.0% ➖ noise
11 duckdb:vortex-compact -1.1% +3.5% -4.4% +10.0% ➖ noise
11 duckdb:vortex-file-compressed -1.8% +3.5% -5.1% +10.0% ➖ noise
12 datafusion:vortex-compact +2.3% +0.9% +1.4% +10.0% ➖ noise
12 datafusion:vortex-file-compressed +1.7% +0.9% +0.8% +13.3% ➖ noise
12 duckdb:duckdb +0.8% +0.9% -0.2% +11.9% ➖ noise
12 duckdb:vortex-compact -6.0% +0.9% -6.9% +17.8% ➖ noise
12 duckdb:vortex-file-compressed -3.9% +0.9% -4.8% +11.3% ➖ noise
13 datafusion:vortex-compact +4.4% +1.9% +2.4% +10.0% ➖ noise
13 datafusion:vortex-file-compressed +4.4% +1.9% +2.5% +10.0% ➖ noise
13 duckdb:duckdb -2.4% +1.9% -4.2% +10.0% ➖ noise
13 duckdb:vortex-compact +1.6% +1.9% -0.3% +10.0% ➖ noise
13 duckdb:vortex-file-compressed +5.4% +1.9% +3.5% +10.4% ➖ noise
14 datafusion:vortex-compact +2.1% -2.8% +5.0% +10.0% ➖ noise
14 datafusion:vortex-file-compressed +3.1% -2.8% +6.0% +10.0% ➖ noise
14 duckdb:duckdb +0.3% -2.8% +3.2% +10.0% ➖ noise
14 duckdb:vortex-compact +2.8% -2.8% +5.8% +10.0% ➖ noise
14 duckdb:vortex-file-compressed +4.8% -2.8% +7.8% +12.1% ➖ noise
15 datafusion:vortex-compact -1.3% -1.8% +0.5% +10.4% ➖ noise
15 datafusion:vortex-file-compressed +5.1% -1.8% +7.0% +10.0% ➖ noise
15 duckdb:duckdb +1.9% -1.8% +3.8% +12.9% ➖ noise
15 duckdb:vortex-compact +1.7% -1.8% +3.6% +10.0% ➖ noise
15 duckdb:vortex-file-compressed -0.9% -1.8% +1.0% +10.0% ➖ noise
16 datafusion:vortex-compact +2.8% -0.8% +3.6% +10.0% ➖ noise
16 datafusion:vortex-file-compressed +1.5% -0.8% +2.3% +10.0% ➖ noise
16 duckdb:duckdb +10.7% -0.8% +11.5% +14.9% ➖ noise
16 duckdb:vortex-compact +5.4% -0.8% +6.2% +11.1% ➖ noise
16 duckdb:vortex-file-compressed -4.1% -0.8% -3.3% +10.0% ➖ noise
17 datafusion:vortex-compact +1.0% -1.1% +2.1% +10.0% ➖ noise
17 datafusion:vortex-file-compressed +0.9% -1.1% +2.0% +10.0% ➖ noise
17 duckdb:duckdb +2.9% -1.1% +4.0% +11.4% ➖ noise
17 duckdb:vortex-compact +4.3% -1.1% +5.4% +10.0% ➖ noise
17 duckdb:vortex-file-compressed +0.1% -1.1% +1.2% +10.3% ➖ noise
18 datafusion:vortex-compact -1.6% +2.5% -4.0% +10.0% ➖ noise
18 datafusion:vortex-file-compressed -0.0% +2.5% -2.5% +10.0% ➖ noise
18 duckdb:duckdb -3.2% +2.5% -5.6% +10.0% ➖ noise
18 duckdb:vortex-compact -0.1% +2.5% -2.5% +10.0% ➖ noise
18 duckdb:vortex-file-compressed -0.3% +2.5% -2.7% +10.0% ➖ noise
19 datafusion:vortex-compact +2.6% +1.9% +0.7% +10.0% ➖ noise
19 datafusion:vortex-file-compressed -2.1% +1.9% -3.9% +10.0% ➖ noise
19 duckdb:duckdb -1.9% +1.9% -3.8% +11.8% ➖ noise
19 duckdb:vortex-compact +5.5% +1.9% +3.5% +10.0% ➖ noise
19 duckdb:vortex-file-compressed +4.8% +1.9% +2.8% +13.0% ➖ noise
20 datafusion:vortex-compact +0.5% +2.7% -2.1% +10.0% ➖ noise
20 datafusion:vortex-file-compressed -1.2% +2.7% -3.8% +10.0% ➖ noise
20 duckdb:duckdb +2.5% +2.7% -0.1% +10.5% ➖ noise
20 duckdb:vortex-compact +6.4% +2.7% +3.7% +16.1% ➖ noise
20 duckdb:vortex-file-compressed -3.4% +2.7% -5.9% +11.1% ➖ noise
21 datafusion:vortex-compact +6.3% -3.4% +10.0% +10.0% 🚨 regression
21 datafusion:vortex-file-compressed +7.2% -3.4% +10.9% +10.0% 🚨 regression
21 duckdb:duckdb -7.8% -3.4% -4.6% +10.0% ➖ noise
21 duckdb:vortex-compact -8.9% -3.4% -5.7% +13.4% ➖ noise
21 duckdb:vortex-file-compressed +5.0% -3.4% +8.7% +13.2% ➖ noise
22 datafusion:vortex-compact -0.1% +1.0% -1.1% +14.5% ➖ noise
22 datafusion:vortex-file-compressed +5.5% +1.0% +4.5% +15.2% ➖ noise
22 duckdb:duckdb +0.6% +1.0% -0.4% +14.0% ➖ noise
22 duckdb:vortex-compact +1.9% +1.0% +1.0% +13.3% ➖ noise
22 duckdb:vortex-file-compressed +7.5% +1.0% +6.4% +14.2% ➖ noise
23 datafusion:vortex-compact +2.0% +4.8% -2.6% +10.0% ➖ noise
23 datafusion:vortex-file-compressed +0.8% +4.8% -3.8% +10.0% ➖ noise
23 duckdb:duckdb +6.8% +4.8% +1.9% +17.9% ➖ noise
23 duckdb:vortex-compact -4.0% +4.8% -8.3% +12.6% ➖ noise
23 duckdb:vortex-file-compressed -4.9% +4.8% -9.2% +10.0% ✅ faster
24 datafusion:vortex-compact +0.5% +1.7% -1.2% +10.0% ➖ noise
24 datafusion:vortex-file-compressed +1.0% +1.7% -0.7% +10.0% ➖ noise
24 duckdb:duckdb +2.2% +1.7% +0.5% +10.0% ➖ noise
24 duckdb:vortex-compact +1.5% +1.7% -0.2% +10.0% ➖ noise
24 duckdb:vortex-file-compressed +2.6% +1.7% +0.9% +12.6% ➖ noise
25 datafusion:vortex-compact +4.5% -1.6% +6.2% +10.0% ➖ noise
25 datafusion:vortex-file-compressed +1.5% -1.6% +3.1% +10.0% ➖ noise
25 duckdb:duckdb +1.1% -1.6% +2.7% +15.2% ➖ noise
25 duckdb:vortex-compact +4.9% -1.6% +6.6% +10.0% ➖ noise
25 duckdb:vortex-file-compressed +0.4% -1.6% +2.0% +10.0% ➖ noise
26 datafusion:vortex-compact -0.0% +3.1% -3.0% +10.7% ➖ noise
26 datafusion:vortex-file-compressed +3.9% +3.1% +0.8% +10.0% ➖ noise
26 duckdb:duckdb +6.7% +3.1% +3.5% +15.5% ➖ noise
26 duckdb:vortex-compact +6.1% +3.1% +2.9% +15.2% ➖ noise
26 duckdb:vortex-file-compressed -1.0% +3.1% -4.0% +10.0% ➖ noise
27 datafusion:vortex-compact -1.4% +1.1% -2.4% +10.0% ➖ noise
27 datafusion:vortex-file-compressed +3.6% +1.1% +2.5% +10.0% ➖ noise
27 duckdb:duckdb -0.5% +1.1% -1.6% +18.5% ➖ noise
27 duckdb:vortex-compact +1.9% +1.1% +0.8% +10.0% ➖ noise
27 duckdb:vortex-file-compressed +0.7% +1.1% -0.4% +10.0% ➖ noise
28 datafusion:vortex-compact +3.4% +2.7% +0.6% +10.0% ➖ noise
28 datafusion:vortex-file-compressed +2.5% +2.7% -0.2% +10.0% ➖ noise
28 duckdb:duckdb -0.8% +2.7% -3.5% +10.0% ➖ noise
28 duckdb:vortex-compact +1.8% +2.7% -1.0% +10.0% ➖ noise
28 duckdb:vortex-file-compressed -2.0% +2.7% -4.6% +10.0% ➖ noise
29 datafusion:vortex-compact +1.2% +2.9% -1.6% +10.0% ➖ noise
29 datafusion:vortex-file-compressed +4.1% +2.9% +1.2% +10.0% ➖ noise
29 duckdb:duckdb -2.6% +2.9% -5.3% +11.5% ➖ noise
29 duckdb:vortex-compact -2.2% +2.9% -4.9% +12.9% ➖ noise
29 duckdb:vortex-file-compressed -1.8% +2.9% -4.5% +11.9% ➖ noise
30 datafusion:vortex-compact +3.9% +3.9% -0.0% +13.0% ➖ noise
30 datafusion:vortex-file-compressed +3.4% +3.9% -0.5% +10.0% ➖ noise
30 duckdb:duckdb +1.7% +3.9% -2.1% +10.0% ➖ noise
30 duckdb:vortex-compact +4.6% +3.9% +0.7% +11.1% ➖ noise
30 duckdb:vortex-file-compressed -4.0% +3.9% -7.6% +13.0% ➖ noise
31 datafusion:vortex-compact +3.5% +1.7% +1.8% +10.0% ➖ noise
31 datafusion:vortex-file-compressed +3.9% +1.7% +2.1% +10.0% ➖ noise
31 duckdb:duckdb +1.2% +1.7% -0.5% +11.3% ➖ noise
31 duckdb:vortex-compact +6.7% +1.7% +4.9% +11.1% ➖ noise
31 duckdb:vortex-file-compressed +1.9% +1.7% +0.2% +10.9% ➖ noise
32 datafusion:vortex-compact +5.4% +0.3% +5.1% +10.0% ➖ noise
32 datafusion:vortex-file-compressed -1.6% +0.3% -1.9% +10.0% ➖ noise
32 duckdb:duckdb +0.4% +0.3% +0.1% +11.7% ➖ noise
32 duckdb:vortex-compact +0.5% +0.3% +0.2% +10.8% ➖ noise
32 duckdb:vortex-file-compressed -2.8% +0.3% -3.1% +10.5% ➖ noise
33 datafusion:vortex-compact -3.2% +1.9% -5.1% +10.0% ➖ noise
33 datafusion:vortex-file-compressed -1.4% +1.9% -3.3% +10.2% ➖ noise
33 duckdb:duckdb +8.2% +1.9% +6.1% +11.3% ➖ noise
33 duckdb:vortex-compact +0.0% +1.9% -1.9% +10.0% ➖ noise
33 duckdb:vortex-file-compressed +1.8% +1.9% -0.1% +16.2% ➖ noise
34 datafusion:vortex-compact +3.1% +0.7% +2.4% +10.0% ➖ noise
34 datafusion:vortex-file-compressed +0.4% +0.7% -0.3% +10.0% ➖ noise
34 duckdb:duckdb +1.4% +0.7% +0.7% +10.0% ➖ noise
34 duckdb:vortex-compact +3.1% +0.7% +2.4% +10.0% ➖ noise
34 duckdb:vortex-file-compressed +1.2% +0.7% +0.5% +11.2% ➖ noise
35 datafusion:vortex-compact -0.8% +2.5% -3.2% +10.0% ➖ noise
35 datafusion:vortex-file-compressed -1.9% +2.5% -4.3% +10.0% ➖ noise
35 duckdb:duckdb -7.5% +2.5% -9.7% +17.3% ➖ noise
35 duckdb:vortex-compact +3.2% +2.5% +0.7% +10.0% ➖ noise
35 duckdb:vortex-file-compressed +3.0% +2.5% +0.5% +10.3% ➖ noise
36 datafusion:vortex-compact -3.2% +0.8% -3.9% +10.0% ➖ noise
36 datafusion:vortex-file-compressed +3.1% +0.8% +2.3% +10.0% ➖ noise
36 duckdb:duckdb -1.0% +0.8% -1.8% +11.8% ➖ noise
36 duckdb:vortex-compact +2.0% +0.8% +1.2% +10.0% ➖ noise
36 duckdb:vortex-file-compressed +3.4% +0.8% +2.6% +10.0% ➖ noise
37 datafusion:vortex-compact -1.8% +1.9% -3.6% +10.0% ➖ noise
37 datafusion:vortex-file-compressed +1.5% +1.9% -0.3% +10.8% ➖ noise
37 duckdb:duckdb +7.0% +1.9% +5.1% +20.1% ➖ noise
37 duckdb:vortex-compact +4.7% +1.9% +2.8% +10.9% ➖ noise
37 duckdb:vortex-file-compressed -0.0% +1.9% -1.9% +14.4% ➖ noise
38 datafusion:vortex-compact +1.3% +3.8% -2.4% +10.0% ➖ noise
38 datafusion:vortex-file-compressed +3.8% +3.8% +0.0% +10.0% ➖ noise
38 duckdb:duckdb -0.0% +3.8% -3.7% +24.6% ➖ noise
38 duckdb:vortex-compact +2.0% +3.8% -1.7% +13.3% ➖ noise
38 duckdb:vortex-file-compressed +3.6% +3.8% -0.1% +12.4% ➖ noise
39 datafusion:vortex-compact -2.9% +2.8% -5.6% +11.4% ➖ noise
39 datafusion:vortex-file-compressed -7.8% +2.8% -10.3% +15.8% ➖ noise
39 duckdb:duckdb -13.4% +2.8% -15.7% +30.7% ➖ noise
39 duckdb:vortex-compact +1.2% +2.8% -1.5% +10.7% ➖ noise
39 duckdb:vortex-file-compressed -2.1% +2.8% -4.7% +19.8% ➖ noise
40 datafusion:vortex-compact +2.4% +7.7% -4.9% +10.0% ➖ noise
40 datafusion:vortex-file-compressed +1.0% +7.7% -6.2% +10.0% ➖ noise
40 duckdb:duckdb +7.0% +7.7% -0.6% +12.7% ➖ noise
40 duckdb:vortex-compact +3.2% +7.7% -4.2% +10.0% ➖ noise
40 duckdb:vortex-file-compressed -3.6% +7.7% -10.5% +10.0% ✅ faster
41 datafusion:vortex-compact -1.5% +3.9% -5.3% +11.4% ➖ noise
41 datafusion:vortex-file-compressed +7.2% +3.9% +3.2% +10.0% ➖ noise
41 duckdb:duckdb +1.1% +3.9% -2.8% +10.0% ➖ noise
41 duckdb:vortex-compact +0.6% +3.9% -3.2% +10.0% ➖ noise
41 duckdb:vortex-file-compressed -0.7% +3.9% -4.4% +10.0% ➖ noise
42 datafusion:vortex-compact +1.7% +2.9% -1.1% +11.9% ➖ noise
42 datafusion:vortex-file-compressed +2.5% +2.9% -0.3% +12.2% ➖ noise
42 duckdb:duckdb +2.0% +2.9% -0.8% +17.5% ➖ noise
42 duckdb:vortex-compact +1.5% +2.9% -1.4% +16.2% ➖ noise
42 duckdb:vortex-file-compressed -3.0% +2.9% -5.7% +16.1% ➖ noise
43 datafusion:vortex-compact +2.5% +7.2% -4.4% +10.0% ➖ noise
43 datafusion:vortex-file-compressed +1.2% +7.2% -5.6% +10.0% ➖ noise
43 duckdb:duckdb +1.4% +7.2% -5.4% +10.0% ➖ noise
43 duckdb:vortex-compact -1.3% +7.2% -8.0% +13.7% ➖ noise
43 duckdb:vortex-file-compressed -0.1% +7.2% -6.8% +10.0% ➖ noise
44 datafusion:vortex-compact +0.8% +3.0% -2.1% +10.0% ➖ noise
44 datafusion:vortex-file-compressed +3.7% +3.0% +0.7% +10.0% ➖ noise
44 duckdb:duckdb -4.3% +3.0% -7.1% +12.4% ➖ noise
44 duckdb:vortex-compact +3.0% +3.0% +0.0% +10.0% ➖ noise
44 duckdb:vortex-file-compressed +5.2% +3.0% +2.2% +11.7% ➖ noise
45 datafusion:vortex-compact -0.8% +1.5% -2.3% +10.0% ➖ noise
45 datafusion:vortex-file-compressed +0.3% +1.5% -1.2% +10.0% ➖ noise
45 duckdb:duckdb +12.5% +1.5% +10.8% +10.0% 🚨 regression
45 duckdb:vortex-compact +14.8% +1.5% +13.1% +13.8% ➖ noise
45 duckdb:vortex-file-compressed -6.0% +1.5% -7.4% +11.9% ➖ noise
46 datafusion:vortex-compact -1.3% -0.9% -0.4% +10.0% ➖ noise
46 datafusion:vortex-file-compressed +9.1% -0.9% +10.0% +10.0% 🚨 regression
46 duckdb:duckdb +7.7% -0.9% +8.7% +10.0% ➖ noise
46 duckdb:vortex-compact +3.5% -0.9% +4.4% +10.0% ➖ noise
46 duckdb:vortex-file-compressed +2.3% -0.9% +3.2% +10.0% ➖ noise
47 datafusion:vortex-compact +3.5% +2.1% +1.4% +10.0% ➖ noise
47 datafusion:vortex-file-compressed +5.8% +2.1% +3.6% +10.0% ➖ noise
47 duckdb:duckdb +1.6% +2.1% -0.4% +10.0% ➖ noise
47 duckdb:vortex-compact +0.9% +2.1% -1.2% +10.0% ➖ noise
47 duckdb:vortex-file-compressed +5.3% +2.1% +3.2% +10.0% ➖ noise
48 datafusion:vortex-compact +0.8% +0.6% +0.2% +10.0% ➖ noise
48 datafusion:vortex-file-compressed -1.0% +0.6% -1.6% +10.0% ➖ noise
48 duckdb:duckdb +2.0% +0.6% +1.4% +12.8% ➖ noise
48 duckdb:vortex-compact -0.0% +0.6% -0.6% +10.0% ➖ noise
48 duckdb:vortex-file-compressed +6.8% +0.6% +6.1% +13.6% ➖ noise
49 datafusion:vortex-compact +1.2% +2.8% -1.6% +10.0% ➖ noise
49 datafusion:vortex-file-compressed -2.2% +2.8% -4.9% +10.0% ➖ noise
49 duckdb:duckdb +3.9% +2.8% +1.0% +13.9% ➖ noise
49 duckdb:vortex-compact +2.8% +2.8% -0.0% +10.3% ➖ noise
49 duckdb:vortex-file-compressed -1.7% +2.8% -4.4% +10.6% ➖ noise
50 datafusion:vortex-compact -0.4% +1.0% -1.4% +10.0% ➖ noise
50 datafusion:vortex-file-compressed +5.3% +1.0% +4.3% +10.0% ➖ noise
50 duckdb:duckdb +2.7% +1.0% +1.8% +10.0% ➖ noise
50 duckdb:vortex-compact +2.0% +1.0% +1.1% +10.0% ➖ noise
50 duckdb:vortex-file-compressed +0.2% +1.0% -0.7% +10.0% ➖ noise
51 datafusion:vortex-compact +1.4% -0.8% +2.2% +10.9% ➖ noise
51 datafusion:vortex-file-compressed +2.1% -0.8% +2.9% +10.0% ➖ noise
51 duckdb:duckdb +0.5% -0.8% +1.2% +22.6% ➖ noise
51 duckdb:vortex-compact +2.5% -0.8% +3.3% +10.0% ➖ noise
51 duckdb:vortex-file-compressed +0.8% -0.8% +1.6% +18.5% ➖ noise
52 datafusion:vortex-compact +2.4% +1.6% +0.8% +19.7% ➖ noise
52 datafusion:vortex-file-compressed +2.4% +1.6% +0.8% +14.2% ➖ noise
52 duckdb:duckdb +1.2% +1.6% -0.4% +21.3% ➖ noise
52 duckdb:vortex-compact -6.6% +1.6% -8.1% +18.5% ➖ noise
52 duckdb:vortex-file-compressed -6.9% +1.6% -8.4% +19.7% ➖ noise
53 datafusion:vortex-compact +3.1% +2.9% +0.2% +10.9% ➖ noise
53 datafusion:vortex-file-compressed +0.0% +2.9% -2.8% +12.6% ➖ noise
53 duckdb:duckdb -0.6% +2.9% -3.4% +14.2% ➖ noise
53 duckdb:vortex-compact -0.2% +2.9% -3.0% +11.8% ➖ noise
53 duckdb:vortex-file-compressed +6.1% +2.9% +3.1% +15.1% ➖ noise
54 datafusion:vortex-compact -2.5% +2.7% -5.0% +10.0% ➖ noise
54 datafusion:vortex-file-compressed -1.4% +2.7% -3.9% +10.0% ➖ noise
54 duckdb:duckdb -4.0% +2.7% -6.5% +14.5% ➖ noise
54 duckdb:vortex-compact +3.3% +2.7% +0.6% +10.0% ➖ noise
54 duckdb:vortex-file-compressed +3.4% +2.7% +0.7% +10.4% ➖ noise
55 datafusion:vortex-compact +2.0% +1.2% +0.8% +11.3% ➖ noise
55 datafusion:vortex-file-compressed -0.6% +1.2% -1.8% +10.7% ➖ noise
55 duckdb:duckdb +0.5% +1.2% -0.7% +16.0% ➖ noise
55 duckdb:vortex-compact -1.1% +1.2% -2.3% +11.9% ➖ noise
55 duckdb:vortex-file-compressed -4.2% +1.2% -5.4% +18.1% ➖ noise
56 datafusion:vortex-compact -0.4% +1.0% -1.3% +10.0% ➖ noise
56 datafusion:vortex-file-compressed +0.5% +1.0% -0.5% +10.0% ➖ noise
56 duckdb:duckdb +1.9% +1.0% +1.0% +12.5% ➖ noise
56 duckdb:vortex-compact +4.7% +1.0% +3.7% +10.4% ➖ noise
56 duckdb:vortex-file-compressed -1.7% +1.0% -2.6% +10.3% ➖ noise
57 datafusion:vortex-compact +2.4% +2.7% -0.2% +10.0% ➖ noise
57 datafusion:vortex-file-compressed +1.2% +2.7% -1.4% +10.0% ➖ noise
57 duckdb:duckdb -0.1% +2.7% -2.8% +10.0% ➖ noise
57 duckdb:vortex-compact -1.1% +2.7% -3.7% +20.7% ➖ noise
57 duckdb:vortex-file-compressed +2.2% +2.7% -0.5% +16.5% ➖ noise
58 datafusion:vortex-compact +2.2% -0.6% +2.9% +10.0% ➖ noise
58 datafusion:vortex-file-compressed +4.4% -0.6% +5.1% +10.0% ➖ noise
58 duckdb:duckdb +0.5% -0.6% +1.1% +14.7% ➖ noise
58 duckdb:vortex-compact +0.1% -0.6% +0.7% +15.9% ➖ noise
58 duckdb:vortex-file-compressed +1.5% -0.6% +2.2% +21.7% ➖ noise
59 datafusion:vortex-compact -0.0% +1.4% -1.5% +10.0% ➖ noise
59 datafusion:vortex-file-compressed +5.7% +1.4% +4.2% +10.0% ➖ noise
59 duckdb:duckdb -1.1% +1.4% -2.5% +10.0% ➖ noise
59 duckdb:vortex-compact -0.8% +1.4% -2.2% +10.0% ➖ noise
59 duckdb:vortex-file-compressed -0.5% +1.4% -1.9% +10.0% ➖ noise
60 datafusion:vortex-compact -2.8% +1.7% -4.5% +10.0% ➖ noise
60 datafusion:vortex-file-compressed +0.6% +1.7% -1.1% +10.0% ➖ noise
60 duckdb:duckdb +2.0% +1.7% +0.2% +13.5% ➖ noise
60 duckdb:vortex-compact -2.1% +1.7% -3.8% +10.0% ➖ noise
60 duckdb:vortex-file-compressed +0.1% +1.7% -1.6% +13.9% ➖ noise
61 datafusion:vortex-compact -3.0% +0.7% -3.7% +10.0% ➖ noise
61 datafusion:vortex-file-compressed +1.4% +0.7% +0.7% +10.0% ➖ noise
61 duckdb:duckdb -0.4% +0.7% -1.1% +10.0% ➖ noise
61 duckdb:vortex-compact -3.3% +0.7% -4.0% +11.8% ➖ noise
61 duckdb:vortex-file-compressed -0.8% +0.7% -1.5% +10.0% ➖ noise
62 datafusion:vortex-compact +3.4% +1.8% +1.5% +12.7% ➖ noise
62 datafusion:vortex-file-compressed +1.9% +1.8% +0.1% +11.8% ➖ noise
62 duckdb:duckdb -1.3% +1.8% -3.1% +15.8% ➖ noise
62 duckdb:vortex-compact +2.6% +1.8% +0.7% +28.2% ➖ noise
62 duckdb:vortex-file-compressed -3.2% +1.8% -5.0% +25.6% ➖ noise
63 datafusion:vortex-compact +4.7% +2.6% +2.0% +10.0% ➖ noise
63 datafusion:vortex-file-compressed +4.3% +2.6% +1.6% +10.0% ➖ noise
63 duckdb:duckdb -1.8% +2.6% -4.3% +10.9% ➖ noise
63 duckdb:vortex-compact +1.7% +2.6% -0.9% +10.0% ➖ noise
63 duckdb:vortex-file-compressed +1.0% +2.6% -1.6% +11.6% ➖ noise
64 datafusion:vortex-compact +0.2% +1.0% -0.8% +10.0% ➖ noise
64 datafusion:vortex-file-compressed +0.6% +1.0% -0.4% +10.0% ➖ noise
64 duckdb:duckdb +4.3% +1.0% +3.3% +10.0% ➖ noise
64 duckdb:vortex-compact +3.5% +1.0% +2.5% +10.0% ➖ noise
64 duckdb:vortex-file-compressed +5.5% +1.0% +4.5% +10.0% ➖ noise
65 datafusion:vortex-compact +4.0% +5.3% -1.2% +10.0% ➖ noise
65 datafusion:vortex-file-compressed +3.5% +5.3% -1.7% +10.3% ➖ noise
65 duckdb:duckdb -0.4% +5.3% -5.4% +12.3% ➖ noise
65 duckdb:vortex-compact +0.9% +5.3% -4.1% +10.0% ➖ noise
65 duckdb:vortex-file-compressed -4.2% +5.3% -9.0% +10.0% ➖ noise
66 datafusion:vortex-compact +1.2% -1.1% +2.3% +12.5% ➖ noise
66 datafusion:vortex-file-compressed +2.3% -1.1% +3.5% +10.9% ➖ noise
66 duckdb:duckdb +0.6% -1.1% +1.7% +12.7% ➖ noise
66 duckdb:vortex-compact +7.5% -1.1% +8.7% +10.6% ➖ noise
66 duckdb:vortex-file-compressed +17.9% -1.1% +19.2% +15.9% 🚨 regression
67 datafusion:vortex-compact -0.1% -0.6% +0.6% +10.0% ➖ noise
67 datafusion:vortex-file-compressed +4.5% -0.6% +5.2% +10.0% ➖ noise
67 duckdb:duckdb +2.4% -0.6% +3.0% +10.0% ➖ noise
67 duckdb:vortex-compact -2.5% -0.6% -1.8% +10.0% ➖ noise
67 duckdb:vortex-file-compressed +3.1% -0.6% +3.8% +10.0% ➖ noise
68 datafusion:vortex-compact +0.5% +3.4% -2.8% +10.0% ➖ noise
68 datafusion:vortex-file-compressed +6.5% +3.4% +2.9% +10.0% ➖ noise
68 duckdb:duckdb +6.4% +3.4% +2.9% +10.0% ➖ noise
68 duckdb:vortex-compact +2.1% +3.4% -1.3% +10.0% ➖ noise
68 duckdb:vortex-file-compressed +0.1% +3.4% -3.3% +10.0% ➖ noise
69 datafusion:vortex-compact -0.1% -1.7% +1.6% +10.0% ➖ noise
69 datafusion:vortex-file-compressed +4.0% -1.7% +5.8% +10.0% ➖ noise
69 duckdb:duckdb +4.5% -1.7% +6.4% +10.0% ➖ noise
69 duckdb:vortex-compact -1.0% -1.7% +0.7% +10.0% ➖ noise
69 duckdb:vortex-file-compressed +1.7% -1.7% +3.5% +10.0% ➖ noise
70 datafusion:vortex-compact -3.1% +1.3% -4.3% +10.0% ➖ noise
70 datafusion:vortex-file-compressed +3.6% +1.3% +2.3% +10.0% ➖ noise
70 duckdb:duckdb -8.3% +1.3% -9.5% +14.1% ➖ noise
70 duckdb:vortex-compact -1.5% +1.3% -2.8% +10.7% ➖ noise
70 duckdb:vortex-file-compressed +0.2% +1.3% -1.1% +10.0% ➖ noise
71 datafusion:vortex-compact -2.2% +0.9% -3.1% +10.0% ➖ noise
71 datafusion:vortex-file-compressed +3.2% +0.9% +2.3% +10.0% ➖ noise
71 duckdb:duckdb +1.6% +0.9% +0.7% +11.3% ➖ noise
71 duckdb:vortex-compact -2.0% +0.9% -2.9% +12.2% ➖ noise
71 duckdb:vortex-file-compressed -2.5% +0.9% -3.3% +14.2% ➖ noise
72 datafusion:vortex-compact +1.0% +0.2% +0.8% +10.0% ➖ noise
72 datafusion:vortex-file-compressed +0.9% +0.2% +0.7% +10.0% ➖ noise
72 duckdb:duckdb +2.7% +0.2% +2.5% +10.8% ➖ noise
72 duckdb:vortex-compact -0.3% +0.2% -0.5% +10.0% ➖ noise
72 duckdb:vortex-file-compressed -0.1% +0.2% -0.3% +10.0% ➖ noise
73 datafusion:vortex-compact -0.8% -0.6% -0.2% +16.3% ➖ noise
73 datafusion:vortex-file-compressed -10.5% -0.6% -10.0% +17.3% ➖ noise
73 duckdb:duckdb +1.6% -0.6% +2.2% +10.5% ➖ noise
73 duckdb:vortex-compact +5.7% -0.6% +6.3% +10.0% ➖ noise
73 duckdb:vortex-file-compressed -1.6% -0.6% -1.0% +10.0% ➖ noise
74 datafusion:vortex-compact +2.5% +1.6% +0.9% +10.0% ➖ noise
74 datafusion:vortex-file-compressed +4.2% +1.6% +2.6% +10.0% ➖ noise
74 duckdb:duckdb -1.8% +1.6% -3.3% +10.0% ➖ noise
74 duckdb:vortex-compact +0.9% +1.6% -0.7% +10.0% ➖ noise
74 duckdb:vortex-file-compressed +2.8% +1.6% +1.2% +10.0% ➖ noise
75 datafusion:vortex-compact +0.3% +1.3% -1.0% +10.0% ➖ noise
75 datafusion:vortex-file-compressed +4.5% +1.3% +3.1% +10.0% ➖ noise
75 duckdb:duckdb -1.3% +1.3% -2.6% +10.8% ➖ noise
75 duckdb:vortex-compact +3.2% +1.3% +1.9% +10.0% ➖ noise
75 duckdb:vortex-file-compressed -6.6% +1.3% -7.8% +10.0% ➖ noise
76 datafusion:vortex-compact +4.9% +5.6% -0.6% +10.0% ➖ noise
76 datafusion:vortex-file-compressed +6.0% +5.6% +0.4% +10.0% ➖ noise
76 duckdb:duckdb +3.1% +5.6% -2.4% +11.6% ➖ noise
76 duckdb:vortex-compact +8.2% +5.6% +2.5% +10.0% ➖ noise
76 duckdb:vortex-file-compressed +2.4% +5.6% -3.1% +23.6% ➖ noise
77 datafusion:vortex-compact +4.4% +2.4% +1.9% +10.0% ➖ noise
77 datafusion:vortex-file-compressed -1.1% +2.4% -3.5% +10.0% ➖ noise
77 duckdb:duckdb +1.5% +2.4% -0.9% +13.0% ➖ noise
77 duckdb:vortex-compact +6.3% +2.4% +3.7% +10.0% ➖ noise
77 duckdb:vortex-file-compressed +5.8% +2.4% +3.3% +10.5% ➖ noise
78 datafusion:vortex-compact +1.6% +3.6% -1.9% +10.0% ➖ noise
78 datafusion:vortex-file-compressed +0.2% +3.6% -3.3% +10.0% ➖ noise
78 duckdb:duckdb +3.3% +3.6% -0.3% +12.8% ➖ noise
78 duckdb:vortex-compact +0.6% +3.6% -2.9% +11.6% ➖ noise
78 duckdb:vortex-file-compressed -4.3% +3.6% -7.6% +12.9% ➖ noise
79 datafusion:vortex-compact -0.5% +4.4% -4.6% +10.0% ➖ noise
79 datafusion:vortex-file-compressed +3.3% +4.4% -1.1% +11.2% ➖ noise
79 duckdb:duckdb -0.5% +4.4% -4.7% +11.5% ➖ noise
79 duckdb:vortex-compact +14.4% +4.4% +9.6% +10.0% ➖ noise
79 duckdb:vortex-file-compressed -0.1% +4.4% -4.3% +15.6% ➖ noise
80 datafusion:vortex-compact +0.9% +1.9% -1.0% +10.0% ➖ noise
80 datafusion:vortex-file-compressed +2.7% +1.9% +0.8% +10.0% ➖ noise
80 duckdb:duckdb +5.9% +1.9% +3.9% +17.7% ➖ noise
80 duckdb:vortex-compact +3.9% +1.9% +2.0% +10.0% ➖ noise
80 duckdb:vortex-file-compressed +4.8% +1.9% +2.8% +10.0% ➖ noise
81 datafusion:vortex-compact +6.0% -0.6% +6.6% +10.0% ➖ noise
81 datafusion:vortex-file-compressed +4.4% -0.6% +5.0% +13.9% ➖ noise
81 duckdb:duckdb -2.4% -0.6% -1.8% +10.0% ➖ noise
81 duckdb:vortex-compact -2.2% -0.6% -1.7% +10.0% ➖ noise
81 duckdb:vortex-file-compressed -1.4% -0.6% -0.9% +10.0% ➖ noise
82 datafusion:vortex-compact -0.3% +2.4% -2.7% +10.0% ➖ noise
82 datafusion:vortex-file-compressed -5.5% +2.4% -7.7% +10.0% ➖ noise
82 duckdb:duckdb +2.0% +2.4% -0.4% +12.5% ➖ noise
82 duckdb:vortex-compact -0.3% +2.4% -2.7% +10.6% ➖ noise
82 duckdb:vortex-file-compressed +0.3% +2.4% -2.1% +10.0% ➖ noise
83 datafusion:vortex-compact +4.6% +1.9% +2.6% +10.0% ➖ noise
83 datafusion:vortex-file-compressed -0.2% +1.9% -2.1% +10.0% ➖ noise
83 duckdb:duckdb +1.0% +1.9% -0.9% +10.1% ➖ noise
83 duckdb:vortex-compact +5.0% +1.9% +3.0% +10.0% ➖ noise
83 duckdb:vortex-file-compressed +8.4% +1.9% +6.4% +10.0% ➖ noise
84 datafusion:vortex-compact +1.9% +0.8% +1.1% +12.7% ➖ noise
84 datafusion:vortex-file-compressed +7.7% +0.8% +6.8% +10.4% ➖ noise
84 duckdb:duckdb +10.7% +0.8% +9.8% +22.7% ➖ noise
84 duckdb:vortex-compact +8.4% +0.8% +7.5% +10.2% ➖ noise
84 duckdb:vortex-file-compressed +0.4% +0.8% -0.4% +10.0% ➖ noise
85 datafusion:vortex-compact +5.3% +2.9% +2.4% +10.0% ➖ noise
85 datafusion:vortex-file-compressed +2.7% +2.9% -0.2% +10.0% ➖ noise
85 duckdb:duckdb -7.9% +2.9% -10.4% +15.1% ➖ noise
85 duckdb:vortex-compact +8.9% +2.9% +5.8% +10.0% ➖ noise
85 duckdb:vortex-file-compressed -0.5% +2.9% -3.3% +10.0% ➖ noise
86 datafusion:vortex-compact +10.4% +5.6% +4.5% +11.9% ➖ noise
86 datafusion:vortex-file-compressed +7.5% +5.6% +1.8% +16.1% ➖ noise
86 duckdb:duckdb +0.4% +5.6% -5.0% +14.8% ➖ noise
86 duckdb:vortex-compact -0.4% +5.6% -5.7% +20.2% ➖ noise
86 duckdb:vortex-file-compressed -2.1% +5.6% -7.3% +19.8% ➖ noise
87 datafusion:vortex-compact +4.4% +1.3% +3.1% +10.0% ➖ noise
87 datafusion:vortex-file-compressed -4.6% +1.3% -5.8% +10.0% ➖ noise
87 duckdb:duckdb -4.8% +1.3% -6.1% +10.0% ➖ noise
87 duckdb:vortex-compact +3.1% +1.3% +1.7% +10.0% ➖ noise
87 duckdb:vortex-file-compressed -10.9% +1.3% -12.0% +13.7% ✅ faster
88 datafusion:vortex-compact -1.5% +0.7% -2.2% +10.0% ➖ noise
88 datafusion:vortex-file-compressed +0.5% +0.7% -0.3% +10.0% ➖ noise
88 duckdb:duckdb +0.1% +0.7% -0.6% +10.0% ➖ noise
88 duckdb:vortex-compact +0.6% +0.7% -0.1% +10.0% ➖ noise
88 duckdb:vortex-file-compressed +4.3% +0.7% +3.6% +10.2% ➖ noise
89 datafusion:vortex-compact -2.1% +2.6% -4.7% +10.0% ➖ noise
89 datafusion:vortex-file-compressed +1.4% +2.6% -1.2% +10.0% ➖ noise
89 duckdb:duckdb +1.3% +2.6% -1.3% +12.9% ➖ noise
89 duckdb:vortex-compact +4.1% +2.6% +1.4% +10.0% ➖ noise
89 duckdb:vortex-file-compressed +2.3% +2.6% -0.3% +11.7% ➖ noise
90 datafusion:vortex-compact +3.9% +5.9% -1.9% +10.0% ➖ noise
90 datafusion:vortex-file-compressed -2.1% +5.9% -7.5% +10.0% ➖ noise
90 duckdb:duckdb -2.8% +5.9% -8.2% +10.0% ➖ noise
90 duckdb:vortex-compact +6.3% +5.9% +0.4% +10.0% ➖ noise
90 duckdb:vortex-file-compressed +1.2% +5.9% -4.4% +10.0% ➖ noise
91 datafusion:vortex-compact +3.5% -2.2% +5.9% +10.0% ➖ noise
91 datafusion:vortex-file-compressed +0.8% -2.2% +3.0% +10.0% ➖ noise
91 duckdb:duckdb +4.2% -2.2% +6.5% +11.0% ➖ noise
91 duckdb:vortex-compact +8.7% -2.2% +11.1% +10.0% 🚨 regression
91 duckdb:vortex-file-compressed -0.3% -2.2% +1.9% +10.0% ➖ noise
92 datafusion:vortex-compact +3.8% +1.7% +2.0% +10.0% ➖ noise
92 datafusion:vortex-file-compressed +5.8% +1.7% +4.0% +10.0% ➖ noise
92 duckdb:duckdb +4.4% +1.7% +2.6% +13.8% ➖ noise
92 duckdb:vortex-compact -2.3% +1.7% -4.0% +18.5% ➖ noise
92 duckdb:vortex-file-compressed +4.2% +1.7% +2.5% +10.0% ➖ noise
93 datafusion:vortex-compact +5.2% -1.9% +7.3% +10.0% ➖ noise
93 datafusion:vortex-file-compressed +4.0% -1.9% +6.0% +10.0% ➖ noise
93 duckdb:duckdb +5.9% -1.9% +7.9% +12.7% ➖ noise
93 duckdb:vortex-compact +2.7% -1.9% +4.7% +11.3% ➖ noise
93 duckdb:vortex-file-compressed +3.7% -1.9% +5.7% +14.8% ➖ noise
94 datafusion:vortex-compact +6.9% +2.7% +4.1% +10.0% ➖ noise
94 datafusion:vortex-file-compressed +9.0% +2.7% +6.1% +11.1% ➖ noise
94 duckdb:duckdb +4.0% +2.7% +1.3% +10.7% ➖ noise
94 duckdb:vortex-compact +0.5% +2.7% -2.1% +11.6% ➖ noise
94 duckdb:vortex-file-compressed +3.3% +2.7% +0.6% +10.2% ➖ noise
95 datafusion:vortex-compact +2.5% -2.9% +5.6% +10.0% ➖ noise
95 datafusion:vortex-file-compressed +1.4% -2.9% +4.5% +10.0% ➖ noise
95 duckdb:duckdb +1.9% -2.9% +4.9% +18.1% ➖ noise
95 duckdb:vortex-compact -8.5% -2.9% -5.7% +11.6% ➖ noise
95 duckdb:vortex-file-compressed -1.8% -2.9% +1.1% +16.6% ➖ noise
96 datafusion:vortex-compact +1.9% +1.7% +0.2% +10.0% ➖ noise
96 datafusion:vortex-file-compressed +7.2% +1.7% +5.4% +10.0% ➖ noise
96 duckdb:duckdb +1.1% +1.7% -0.6% +14.9% ➖ noise
96 duckdb:vortex-compact +2.7% +1.7% +1.0% +10.9% ➖ noise
96 duckdb:vortex-file-compressed -2.3% +1.7% -4.0% +11.9% ➖ noise
97 datafusion:vortex-compact +1.1% +2.4% -1.3% +10.0% ➖ noise
97 datafusion:vortex-file-compressed +1.2% +2.4% -1.1% +10.0% ➖ noise
97 duckdb:duckdb +1.4% +2.4% -0.9% +10.0% ➖ noise
97 duckdb:vortex-compact +0.9% +2.4% -1.4% +13.4% ➖ noise
97 duckdb:vortex-file-compressed -1.8% +2.4% -4.1% +10.9% ➖ noise
98 datafusion:vortex-compact +7.1% -1.0% +8.2% +11.4% ➖ noise
98 datafusion:vortex-file-compressed -0.2% -1.0% +0.9% +10.0% ➖ noise
98 duckdb:duckdb +2.4% -1.0% +3.4% +12.7% ➖ noise
98 duckdb:vortex-compact +1.2% -1.0% +2.2% +10.0% ➖ noise
98 duckdb:vortex-file-compressed +0.8% -1.0% +1.8% +10.6% ➖ noise
99 datafusion:vortex-compact +7.8% -2.3% +10.4% +18.9% ➖ noise
99 datafusion:vortex-file-compressed +1.8% -2.3% +4.3% +16.6% ➖ noise
99 duckdb:duckdb -2.9% -2.3% -0.6% +34.9% ➖ noise
99 duckdb:vortex-compact +13.1% -2.3% +15.8% +30.2% ➖ noise
99 duckdb:vortex-file-compressed +0.7% -2.3% +3.1% +17.1% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Mar 27, 2026

Benchmarks: TPC-H SF=10 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.3%
Vortex (geomean): 1.007x ➖
Parquet (geomean): 1.006x ➖
Shifts: Parquet (control) +0.6% · Median polish +0.4%


datafusion / vortex-file-compressed (1.008x ➖, 0↑ 0↓)
name PR 53212e6 (ns) base 1f3206f (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 402627284 390309259 1.03
tpch_q02/datafusion:vortex-file-compressed 116558137 114666397 1.02
tpch_q03/datafusion:vortex-file-compressed 205427349 204408955 1.00
tpch_q04/datafusion:vortex-file-compressed 102761617 98638967 1.04
tpch_q05/datafusion:vortex-file-compressed 384271830 382087646 1.01
tpch_q06/datafusion:vortex-file-compressed 40560736 41013480 0.99
tpch_q07/datafusion:vortex-file-compressed 559506319 563156317 0.99
tpch_q08/datafusion:vortex-file-compressed 372509585 377622775 0.99
tpch_q09/datafusion:vortex-file-compressed 661348517 667417018 0.99
tpch_q10/datafusion:vortex-file-compressed 244209701 241364198 1.01
tpch_q11/datafusion:vortex-file-compressed 88144306 84527052 1.04
tpch_q12/datafusion:vortex-file-compressed 112828017 110861511 1.02
tpch_q13/datafusion:vortex-file-compressed 224473936 223584152 1.00
tpch_q14/datafusion:vortex-file-compressed 57816713 59411432 0.97
tpch_q15/datafusion:vortex-file-compressed 109474509 108970067 1.00
tpch_q16/datafusion:vortex-file-compressed 78108041 75683440 1.03
tpch_q17/datafusion:vortex-file-compressed 644355028 644830080 1.00
tpch_q18/datafusion:vortex-file-compressed 875656040 876472174 1.00
tpch_q19/datafusion:vortex-file-compressed 119814575 117137318 1.02
tpch_q20/datafusion:vortex-file-compressed 170957372 168583975 1.01
tpch_q21/datafusion:vortex-file-compressed 657239790 659665914 1.00
tpch_q22/datafusion:vortex-file-compressed 63138022 62401307 1.01
datafusion / vortex-compact (1.008x ➖, 0↑ 0↓)
name PR 53212e6 (ns) base 1f3206f (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 444075443 439810456 1.01
tpch_q02/datafusion:vortex-compact 124243550 122867821 1.01
tpch_q03/datafusion:vortex-compact 223147301 217713272 1.02
tpch_q04/datafusion:vortex-compact 124186919 122396655 1.01
tpch_q05/datafusion:vortex-compact 410860208 393343698 1.04
tpch_q06/datafusion:vortex-compact 64951049 64464663 1.01
tpch_q07/datafusion:vortex-compact 607069726 592757783 1.02
tpch_q08/datafusion:vortex-compact 386274709 388220048 0.99
tpch_q09/datafusion:vortex-compact 675334335 680405770 0.99
tpch_q10/datafusion:vortex-compact 269625839 277434270 0.97
tpch_q11/datafusion:vortex-compact 93457046 92429736 1.01
tpch_q12/datafusion:vortex-compact 172990667 171911142 1.01
tpch_q13/datafusion:vortex-compact 273839162 272103122 1.01
tpch_q14/datafusion:vortex-compact 75836781 76139889 1.00
tpch_q15/datafusion:vortex-compact 165461284 166347596 0.99
tpch_q16/datafusion:vortex-compact 84939397 80939928 1.05
tpch_q17/datafusion:vortex-compact 648618565 648305900 1.00
tpch_q18/datafusion:vortex-compact 884374299 895354576 0.99
tpch_q19/datafusion:vortex-compact 217439047 207098797 1.05
tpch_q20/datafusion:vortex-compact 199601239 199185995 1.00
tpch_q21/datafusion:vortex-compact 697467235 699841177 1.00
tpch_q22/datafusion:vortex-compact 71786302 73318132 0.98
datafusion / parquet (1.012x ➖, 0↑ 0↓)
name PR 53212e6 (ns) base 1f3206f (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 441456370 417571751 1.06
tpch_q02/datafusion:parquet 184591957 185942128 0.99
tpch_q03/datafusion:parquet 298073403 292542264 1.02
tpch_q04/datafusion:parquet 133523376 132184714 1.01
tpch_q05/datafusion:parquet 451901187 440276201 1.03
tpch_q06/datafusion:parquet 129339827 120310883 1.08
tpch_q07/datafusion:parquet 624316947 628607885 0.99
tpch_q08/datafusion:parquet 489770125 483599664 1.01
tpch_q09/datafusion:parquet 754753204 765347619 0.99
tpch_q10/datafusion:parquet 502842202 509763540 0.99
tpch_q11/datafusion:parquet 130311972 132587644 0.98
tpch_q12/datafusion:parquet 208616510 213875038 0.98
tpch_q13/datafusion:parquet 336945105 336262117 1.00
tpch_q14/datafusion:parquet 167722927 153343147 1.09
tpch_q15/datafusion:parquet 243731722 250342019 0.97
tpch_q16/datafusion:parquet 137111667 133782326 1.02
tpch_q17/datafusion:parquet 701599001 683474690 1.03
tpch_q18/datafusion:parquet 909396252 879965001 1.03
tpch_q19/datafusion:parquet 271066063 269183534 1.01
tpch_q20/datafusion:parquet 309451101 307102940 1.01
tpch_q21/datafusion:parquet 734321302 733051647 1.00
tpch_q22/datafusion:parquet 216967224 218868002 0.99
datafusion / arrow (1.033x ➖, 0↑ 1↓)
name PR 53212e6 (ns) base 1f3206f (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 616776920 597689104 1.03
tpch_q02/datafusion:arrow 169072330 170298558 0.99
tpch_q03/datafusion:arrow 483020833 457265920 1.06
tpch_q04/datafusion:arrow 359471956 341874759 1.05
tpch_q05/datafusion:arrow 941126154 917298793 1.03
tpch_q06/datafusion:arrow 279316584 272649307 1.02
tpch_q07/datafusion:arrow 1143288040 1136649764 1.01
tpch_q08/datafusion:arrow 1119041174 1134770122 0.99
tpch_q09/datafusion:arrow 1328756219 1335932833 0.99
tpch_q10/datafusion:arrow 636034707 609133812 1.04
tpch_q11/datafusion:arrow 156629286 149524781 1.05
tpch_q12/datafusion:arrow 701834299 683606364 1.03
tpch_q13/datafusion:arrow 549014815 526956394 1.04
tpch_q14/datafusion:arrow 🚨 348900456 312829922 1.12
tpch_q15/datafusion:arrow 712873396 667999302 1.07
tpch_q16/datafusion:arrow 108967458 109271755 1.00
tpch_q17/datafusion:arrow 1333185274 1330248246 1.00
tpch_q18/datafusion:arrow 1950635804 1783238645 1.09
tpch_q19/datafusion:arrow 522888630 507893448 1.03
tpch_q20/datafusion:arrow 514771018 482825624 1.07
tpch_q21/datafusion:arrow 2965798438 2858908743 1.04
tpch_q22/datafusion:arrow 144553314 144248599 1.00
duckdb / vortex-file-compressed (1.001x ➖, 0↑ 0↓)
name PR 53212e6 (ns) base 1f3206f (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 176397807 177623088 0.99
tpch_q02/duckdb:vortex-file-compressed 54251054 52381075 1.04
tpch_q03/duckdb:vortex-file-compressed 132014542 129449914 1.02
tpch_q04/duckdb:vortex-file-compressed 148880472 150487433 0.99
tpch_q05/duckdb:vortex-file-compressed 132164207 131049934 1.01
tpch_q06/duckdb:vortex-file-compressed 49532829 50335447 0.98
tpch_q07/duckdb:vortex-file-compressed 147439163 148632529 0.99
tpch_q08/duckdb:vortex-file-compressed 172894805 176515225 0.98
tpch_q09/duckdb:vortex-file-compressed 337520155 335885904 1.00
tpch_q10/duckdb:vortex-file-compressed 154797015 156512168 0.99
tpch_q11/duckdb:vortex-file-compressed 36165260 36623408 0.99
tpch_q12/duckdb:vortex-file-compressed 99700156 97068810 1.03
tpch_q13/duckdb:vortex-file-compressed 253933376 250907214 1.01
tpch_q14/duckdb:vortex-file-compressed 72615043 73441545 0.99
tpch_q15/duckdb:vortex-file-compressed 97237885 96948553 1.00
tpch_q16/duckdb:vortex-file-compressed 79854758 79984343 1.00
tpch_q17/duckdb:vortex-file-compressed 104343118 103113602 1.01
tpch_q18/duckdb:vortex-file-compressed 276402157 280752632 0.98
tpch_q19/duckdb:vortex-file-compressed 92994695 93220034 1.00
tpch_q20/duckdb:vortex-file-compressed 168941057 168254853 1.00
tpch_q21/duckdb:vortex-file-compressed 572001469 559435594 1.02
tpch_q22/duckdb:vortex-file-compressed 78825907 79701166 0.99
duckdb / vortex-compact (1.010x ➖, 0↑ 0↓)
name PR 53212e6 (ns) base 1f3206f (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 231502610 231251981 1.00
tpch_q02/duckdb:vortex-compact 60039755 60016087 1.00
tpch_q03/duckdb:vortex-compact 147999037 140103757 1.06
tpch_q04/duckdb:vortex-compact 181002547 173891689 1.04
tpch_q05/duckdb:vortex-compact 152088167 148344550 1.03
tpch_q06/duckdb:vortex-compact 87569244 86884915 1.01
tpch_q07/duckdb:vortex-compact 212129457 205897267 1.03
tpch_q08/duckdb:vortex-compact 197564481 198538503 1.00
tpch_q09/duckdb:vortex-compact 371741021 366355336 1.01
tpch_q10/duckdb:vortex-compact 190252798 191563405 0.99
tpch_q11/duckdb:vortex-compact 42787639 42402823 1.01
tpch_q12/duckdb:vortex-compact 213036568 210864483 1.01
tpch_q13/duckdb:vortex-compact 297106013 300752115 0.99
tpch_q14/duckdb:vortex-compact 105863578 104859353 1.01
tpch_q15/duckdb:vortex-compact 121329114 119301038 1.02
tpch_q16/duckdb:vortex-compact 87205651 88767483 0.98
tpch_q17/duckdb:vortex-compact 122521604 119893550 1.02
tpch_q18/duckdb:vortex-compact 295694941 296588436 1.00
tpch_q19/duckdb:vortex-compact 118528713 119211034 0.99
tpch_q20/duckdb:vortex-compact 212437053 208484120 1.02
tpch_q21/duckdb:vortex-compact 652718816 640665896 1.02
tpch_q22/duckdb:vortex-compact 92134083 92167053 1.00
duckdb / parquet (1.000x ➖, 1↑ 1↓)
name PR 53212e6 (ns) base 1f3206f (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 258532446 260051524 0.99
tpch_q02/duckdb:parquet 104142339 97385046 1.07
tpch_q03/duckdb:parquet 211010695 213934760 0.99
tpch_q04/duckdb:parquet 134411146 134992658 1.00
tpch_q05/duckdb:parquet 219428034 221703579 0.99
tpch_q06/duckdb:parquet 67544072 66126340 1.02
tpch_q07/duckdb:parquet 179917716 180583138 1.00
tpch_q08/duckdb:parquet 255785928 257367283 0.99
tpch_q09/duckdb:parquet 461276630 465611368 0.99
tpch_q10/duckdb:parquet 603002288 608878444 0.99
tpch_q11/duckdb:parquet 🚨 44904428 40728541 1.10
tpch_q12/duckdb:parquet 126091938 128436964 0.98
tpch_q13/duckdb:parquet 🚀 401043656 457903108 0.88
tpch_q14/duckdb:parquet 173411032 178158207 0.97
tpch_q15/duckdb:parquet 99398700 99708065 1.00
tpch_q16/duckdb:parquet 163472642 164995916 0.99
tpch_q17/duckdb:parquet 182619803 174715284 1.05
tpch_q18/duckdb:parquet 354457440 350245353 1.01
tpch_q19/duckdb:parquet 283644517 280543231 1.01
tpch_q20/duckdb:parquet 231394689 229119198 1.01
tpch_q21/duckdb:parquet 572359334 567433869 1.01
tpch_q22/duckdb:parquet 290006151 292896928 0.99
duckdb / duckdb (0.998x ➖, 0↑ 0↓)
name PR 53212e6 (ns) base 1f3206f (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 117377641 117557723 1.00
tpch_q02/duckdb:duckdb 46614502 48756871 0.96
tpch_q03/duckdb:duckdb 98494064 97138762 1.01
tpch_q04/duckdb:duckdb 136574868 133832999 1.02
tpch_q05/duckdb:duckdb 111514534 110647875 1.01
tpch_q06/duckdb:duckdb 39481049 39475493 1.00
tpch_q07/duckdb:duckdb 86837922 86731616 1.00
tpch_q08/duckdb:duckdb 109532018 110899075 0.99
tpch_q09/duckdb:duckdb 276266860 279965138 0.99
tpch_q10/duckdb:duckdb 209968373 206794981 1.02
tpch_q11/duckdb:duckdb 15687309 15699284 1.00
tpch_q12/duckdb:duckdb 85239869 83567429 1.02
tpch_q13/duckdb:duckdb 252371137 250799514 1.01
tpch_q14/duckdb:duckdb 70249852 72400963 0.97
tpch_q15/duckdb:duckdb 78910688 79752083 0.99
tpch_q16/duckdb:duckdb 75224056 72733367 1.03
tpch_q17/duckdb:duckdb 85228954 85546777 1.00
tpch_q18/duckdb:duckdb 217018492 214105023 1.01
tpch_q19/duckdb:duckdb 117158836 116380885 1.01
tpch_q20/duckdb:duckdb 112605871 111723165 1.01
tpch_q21/duckdb:duckdb 303656280 305890116 0.99
tpch_q22/duckdb:duckdb 64213715 67851549 0.95
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:arrow +3.2% +2.5% +0.7% +11.4% ➖ noise
1 datafusion:vortex-compact +1.0% +2.5% -1.5% +12.5% ➖ noise
1 datafusion:vortex-file-compressed +3.2% +2.5% +0.6% +12.9% ➖ noise
1 duckdb:duckdb -0.2% +2.5% -2.6% +11.2% ➖ noise
1 duckdb:vortex-compact +0.1% +2.5% -2.4% +11.2% ➖ noise
1 duckdb:vortex-file-compressed -0.7% +2.5% -3.1% +11.4% ➖ noise
2 datafusion:arrow -0.7% +3.0% -3.6% +10.0% ➖ noise
2 datafusion:vortex-compact +1.1% +3.0% -1.9% +10.0% ➖ noise
2 datafusion:vortex-file-compressed +1.6% +3.0% -1.3% +10.0% ➖ noise
2 duckdb:duckdb -4.4% +3.0% -7.2% +10.0% ➖ noise
2 duckdb:vortex-compact +0.0% +3.0% -2.9% +10.0% ➖ noise
2 duckdb:vortex-file-compressed +3.6% +3.0% +0.5% +10.1% ➖ noise
3 datafusion:arrow +5.6% +0.2% +5.4% +10.0% ➖ noise
3 datafusion:vortex-compact +2.5% +0.2% +2.2% +10.0% ➖ noise
3 datafusion:vortex-file-compressed +0.5% +0.2% +0.2% +10.0% ➖ noise
3 duckdb:duckdb +1.4% +0.2% +1.1% +10.0% ➖ noise
3 duckdb:vortex-compact +5.6% +0.2% +5.4% +10.0% ➖ noise
3 duckdb:vortex-file-compressed +2.0% +0.2% +1.7% +10.0% ➖ noise
4 datafusion:arrow +5.1% +0.3% +4.8% +10.0% ➖ noise
4 datafusion:vortex-compact +1.5% +0.3% +1.2% +10.0% ➖ noise
4 datafusion:vortex-file-compressed +4.2% +0.3% +3.9% +10.0% ➖ noise
4 duckdb:duckdb +2.0% +0.3% +1.8% +10.0% ➖ noise
4 duckdb:vortex-compact +4.1% +0.3% +3.8% +10.0% ➖ noise
4 duckdb:vortex-file-compressed -1.1% +0.3% -1.4% +10.0% ➖ noise
5 datafusion:arrow +2.6% +0.8% +1.8% +10.0% ➖ noise
5 datafusion:vortex-compact +4.5% +0.8% +3.6% +10.0% ➖ noise
5 datafusion:vortex-file-compressed +0.6% +0.8% -0.2% +10.0% ➖ noise
5 duckdb:duckdb +0.8% +0.8% -0.0% +10.0% ➖ noise
5 duckdb:vortex-compact +2.5% +0.8% +1.7% +10.0% ➖ noise
5 duckdb:vortex-file-compressed +0.9% +0.8% +0.1% +10.0% ➖ noise
6 datafusion:arrow +2.4% +4.8% -2.2% +10.0% ➖ noise
6 datafusion:vortex-compact +0.8% +4.8% -3.9% +10.0% ➖ noise
6 datafusion:vortex-file-compressed -1.1% +4.8% -5.6% +10.0% ➖ noise
6 duckdb:duckdb +0.0% +4.8% -4.6% +15.0% ➖ noise
6 duckdb:vortex-compact +0.8% +4.8% -3.8% +10.0% ➖ noise
6 duckdb:vortex-file-compressed -1.6% +4.8% -6.1% +10.2% ➖ noise
7 datafusion:arrow +0.6% -0.5% +1.1% +10.0% ➖ noise
7 datafusion:vortex-compact +2.4% -0.5% +3.0% +10.0% ➖ noise
7 datafusion:vortex-file-compressed -0.6% -0.5% -0.1% +10.0% ➖ noise
7 duckdb:duckdb +0.1% -0.5% +0.7% +10.0% ➖ noise
7 duckdb:vortex-compact +3.0% -0.5% +3.6% +10.0% ➖ noise
7 duckdb:vortex-file-compressed -0.8% -0.5% -0.3% +10.0% ➖ noise
8 datafusion:arrow -1.4% +0.3% -1.7% +10.0% ➖ noise
8 datafusion:vortex-compact -0.5% +0.3% -0.8% +10.0% ➖ noise
8 datafusion:vortex-file-compressed -1.4% +0.3% -1.7% +10.0% ➖ noise
8 duckdb:duckdb -1.2% +0.3% -1.6% +10.0% ➖ noise
8 duckdb:vortex-compact -0.5% +0.3% -0.8% +10.0% ➖ noise
8 duckdb:vortex-file-compressed -2.1% +0.3% -2.4% +10.0% ➖ noise
9 datafusion:arrow -0.5% -1.2% +0.6% +10.0% ➖ noise
9 datafusion:vortex-compact -0.7% -1.2% +0.4% +10.0% ➖ noise
9 datafusion:vortex-file-compressed -0.9% -1.2% +0.3% +10.0% ➖ noise
9 duckdb:duckdb -1.3% -1.2% -0.2% +10.0% ➖ noise
9 duckdb:vortex-compact +1.5% -1.2% +2.7% +10.0% ➖ noise
9 duckdb:vortex-file-compressed +0.5% -1.2% +1.7% +10.0% ➖ noise
10 datafusion:arrow +4.4% -1.2% +5.6% +10.0% ➖ noise
10 datafusion:vortex-compact -2.8% -1.2% -1.7% +10.0% ➖ noise
10 datafusion:vortex-file-compressed +1.2% -1.2% +2.4% +10.0% ➖ noise
10 duckdb:duckdb +1.5% -1.2% +2.7% +10.0% ➖ noise
10 duckdb:vortex-compact -0.7% -1.2% +0.5% +10.0% ➖ noise
10 duckdb:vortex-file-compressed -1.1% -1.2% +0.1% +10.0% ➖ noise
11 datafusion:arrow +4.8% +4.1% +0.6% +10.0% ➖ noise
11 datafusion:vortex-compact +1.1% +4.1% -2.9% +10.7% ➖ noise
11 datafusion:vortex-file-compressed +4.3% +4.1% +0.2% +11.5% ➖ noise
11 duckdb:duckdb -0.1% +4.1% -4.0% +17.9% ➖ noise
11 duckdb:vortex-compact +0.9% +4.1% -3.1% +13.3% ➖ noise
11 duckdb:vortex-file-compressed -1.3% +4.1% -5.1% +14.1% ➖ noise
12 datafusion:arrow +2.7% -2.1% +4.9% +43.0% ➖ noise
12 datafusion:vortex-compact +0.6% -2.1% +2.8% +10.0% ➖ noise
12 datafusion:vortex-file-compressed +1.8% -2.1% +4.0% +10.0% ➖ noise
12 duckdb:duckdb +2.0% -2.1% +4.2% +10.0% ➖ noise
12 duckdb:vortex-compact +1.0% -2.1% +3.2% +10.0% ➖ noise
12 duckdb:vortex-file-compressed +2.7% -2.1% +5.0% +10.0% ➖ noise
13 datafusion:arrow +4.2% -6.3% +11.2% +10.0% 🚨 regression
13 datafusion:vortex-compact +0.6% -6.3% +7.4% +10.0% ➖ noise
13 datafusion:vortex-file-compressed +0.4% -6.3% +7.2% +10.0% ➖ noise
13 duckdb:duckdb +0.6% -6.3% +7.4% +10.0% ➖ noise
13 duckdb:vortex-compact -1.2% -6.3% +5.5% +10.0% ➖ noise
13 duckdb:vortex-file-compressed +1.2% -6.3% +8.0% +10.0% ➖ noise
14 datafusion:arrow +11.5% +3.2% +8.1% +10.4% ➖ noise
14 datafusion:vortex-compact -0.4% +3.2% -3.5% +10.0% ➖ noise
14 datafusion:vortex-file-compressed -2.7% +3.2% -5.7% +11.0% ➖ noise
14 duckdb:duckdb -3.0% +3.2% -6.0% +10.0% ➖ noise
14 duckdb:vortex-compact +1.0% +3.2% -2.2% +10.0% ➖ noise
14 duckdb:vortex-file-compressed -1.1% +3.2% -4.2% +10.0% ➖ noise
15 datafusion:arrow +6.7% -1.5% +8.3% +10.0% ➖ noise
15 datafusion:vortex-compact -0.5% -1.5% +1.0% +10.0% ➖ noise
15 datafusion:vortex-file-compressed +0.5% -1.5% +2.0% +10.0% ➖ noise
15 duckdb:duckdb -1.1% -1.5% +0.4% +10.0% ➖ noise
15 duckdb:vortex-compact +1.7% -1.5% +3.2% +10.0% ➖ noise
15 duckdb:vortex-file-compressed +0.3% -1.5% +1.8% +10.0% ➖ noise
16 datafusion:arrow -0.3% +0.8% -1.0% +10.0% ➖ noise
16 datafusion:vortex-compact +4.9% +0.8% +4.1% +10.0% ➖ noise
16 datafusion:vortex-file-compressed +3.2% +0.8% +2.4% +10.0% ➖ noise
16 duckdb:duckdb +3.4% +0.8% +2.6% +10.0% ➖ noise
16 duckdb:vortex-compact -1.8% +0.8% -2.5% +10.0% ➖ noise
16 duckdb:vortex-file-compressed -0.2% +0.8% -0.9% +10.0% ➖ noise
17 datafusion:arrow +0.2% +3.6% -3.2% +10.0% ➖ noise
17 datafusion:vortex-compact +0.0% +3.6% -3.4% +10.0% ➖ noise
17 datafusion:vortex-file-compressed -0.1% +3.6% -3.5% +10.0% ➖ noise
17 duckdb:duckdb -0.4% +3.6% -3.8% +10.0% ➖ noise
17 duckdb:vortex-compact +2.2% +3.6% -1.3% +10.0% ➖ noise
17 duckdb:vortex-file-compressed +1.2% +3.6% -2.3% +10.0% ➖ noise
18 datafusion:arrow +9.4% +2.3% +7.0% +10.0% ➖ noise
18 datafusion:vortex-compact -1.2% +2.3% -3.4% +10.0% ➖ noise
18 datafusion:vortex-file-compressed -0.1% +2.3% -2.3% +10.0% ➖ noise
18 duckdb:duckdb +1.4% +2.3% -0.9% +10.0% ➖ noise
18 duckdb:vortex-compact -0.3% +2.3% -2.5% +10.0% ➖ noise
18 duckdb:vortex-file-compressed -1.5% +2.3% -3.7% +10.0% ➖ noise
19 datafusion:arrow +3.0% +0.9% +2.0% +10.0% ➖ noise
19 datafusion:vortex-compact +5.0% +0.9% +4.1% +11.1% ➖ noise
19 datafusion:vortex-file-compressed +2.3% +0.9% +1.4% +10.1% ➖ noise
19 duckdb:duckdb +0.7% +0.9% -0.2% +10.0% ➖ noise
19 duckdb:vortex-compact -0.6% +0.9% -1.5% +10.0% ➖ noise
19 duckdb:vortex-file-compressed -0.2% +0.9% -1.1% +10.0% ➖ noise
20 datafusion:arrow +6.6% +0.9% +5.7% +10.0% ➖ noise
20 datafusion:vortex-compact +0.2% +0.9% -0.7% +10.0% ➖ noise
20 datafusion:vortex-file-compressed +1.4% +0.9% +0.5% +10.0% ➖ noise
20 duckdb:duckdb +0.8% +0.9% -0.1% +10.0% ➖ noise
20 duckdb:vortex-compact +1.9% +0.9% +1.0% +10.0% ➖ noise
20 duckdb:vortex-file-compressed +0.4% +0.9% -0.5% +10.0% ➖ noise
21 datafusion:arrow +3.7% +0.5% +3.2% +10.0% ➖ noise
21 datafusion:vortex-compact -0.3% +0.5% -0.9% +10.0% ➖ noise
21 datafusion:vortex-file-compressed -0.4% +0.5% -0.9% +10.0% ➖ noise
21 duckdb:duckdb -0.7% +0.5% -1.2% +10.0% ➖ noise
21 duckdb:vortex-compact +1.9% +0.5% +1.4% +10.0% ➖ noise
21 duckdb:vortex-file-compressed +2.2% +0.5% +1.7% +10.0% ➖ noise
22 datafusion:arrow +0.2% -0.9% +1.1% +10.0% ➖ noise
22 datafusion:vortex-compact -2.1% -0.9% -1.2% +10.0% ➖ noise
22 datafusion:vortex-file-compressed +1.2% -0.9% +2.1% +10.0% ➖ noise
22 duckdb:duckdb -5.4% -0.9% -4.5% +10.5% ➖ noise
22 duckdb:vortex-compact -0.0% -0.9% +0.9% +10.0% ➖ noise
22 duckdb:vortex-file-compressed -1.1% -0.9% -0.2% +10.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Mar 27, 2026

Benchmarks: TPC-H SF=1 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +9.7%
Vortex (geomean): 0.982x ➖
Parquet (geomean): 0.895x ➖
Shifts: Parquet (control) -10.5% · Median polish -7.3%


datafusion / vortex-file-compressed (1.051x ➖, 3↑ 5↓)
name PR 53212e6 (ns) base 1f3206f (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 187887272 185659825 1.01
tpch_q02/datafusion:vortex-file-compressed 470864270 506460503 0.93
tpch_q03/datafusion:vortex-file-compressed 415724142 355802978 1.17
tpch_q04/datafusion:vortex-file-compressed 331381535 296753595 1.12
tpch_q05/datafusion:vortex-file-compressed 602938712 503845414 1.20
tpch_q06/datafusion:vortex-file-compressed 407865564 352963238 1.16
tpch_q07/datafusion:vortex-file-compressed 🚨 582023528 403628575 1.44
tpch_q08/datafusion:vortex-file-compressed 800114172 660409530 1.21
tpch_q09/datafusion:vortex-file-compressed 🚨 908692337 448778937 2.02
tpch_q10/datafusion:vortex-file-compressed 637871069 635392747 1.00
tpch_q11/datafusion:vortex-file-compressed 534560261 424845235 1.26
tpch_q12/datafusion:vortex-file-compressed 🚨 692977295 530611951 1.31
tpch_q13/datafusion:vortex-file-compressed 🚨 475388219 220479013 2.16
tpch_q14/datafusion:vortex-file-compressed 283132964 252149558 1.12
tpch_q15/datafusion:vortex-file-compressed 🚨 725114912 467244378 1.55
tpch_q16/datafusion:vortex-file-compressed 163105674 223184787 0.73
tpch_q17/datafusion:vortex-file-compressed 397888766 558199939 0.71
tpch_q18/datafusion:vortex-file-compressed 🚀 410672709 587680474 0.70
tpch_q19/datafusion:vortex-file-compressed 🚀 452631785 800793712 0.57
tpch_q20/datafusion:vortex-file-compressed 🚀 447482270 650643435 0.69
tpch_q21/datafusion:vortex-file-compressed 659498462 894008754 0.74
tpch_q22/datafusion:vortex-file-compressed 230230146 300045988 0.77
datafusion / vortex-compact (1.003x ➖, 2↑ 2↓)
name PR 53212e6 (ns) base 1f3206f (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 🚀 239371866 349349583 0.69
tpch_q02/datafusion:vortex-compact 🚀 379556074 637968631 0.59
tpch_q03/datafusion:vortex-compact 348679698 369723964 0.94
tpch_q04/datafusion:vortex-compact 223275551 256263954 0.87
tpch_q05/datafusion:vortex-compact 395681990 345835597 1.14
tpch_q06/datafusion:vortex-compact 309081375 306446010 1.01
tpch_q07/datafusion:vortex-compact 480480394 430230548 1.12
tpch_q08/datafusion:vortex-compact 531585828 536113474 0.99
tpch_q09/datafusion:vortex-compact 418381996 419298420 1.00
tpch_q10/datafusion:vortex-compact 541917564 466938254 1.16
tpch_q11/datafusion:vortex-compact 308471510 248821427 1.24
tpch_q12/datafusion:vortex-compact 493273662 562573059 0.88
tpch_q13/datafusion:vortex-compact 215217108 228642329 0.94
tpch_q14/datafusion:vortex-compact 251340551 287900905 0.87
tpch_q15/datafusion:vortex-compact 422088508 464336471 0.91
tpch_q16/datafusion:vortex-compact 175430827 169417827 1.04
tpch_q17/datafusion:vortex-compact 398562459 354304038 1.12
tpch_q18/datafusion:vortex-compact 313258378 307995724 1.02
tpch_q19/datafusion:vortex-compact 401795366 428231615 0.94
tpch_q20/datafusion:vortex-compact 474624181 464774900 1.02
tpch_q21/datafusion:vortex-compact 🚨 724401906 494604253 1.46
tpch_q22/datafusion:vortex-compact 🚨 310013674 196338914 1.58
datafusion / parquet (0.869x ➖, 5↑ 2↓)
name PR 53212e6 (ns) base 1f3206f (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 549999591 486339357 1.13
tpch_q02/datafusion:parquet 449505670 501682884 0.90
tpch_q03/datafusion:parquet 🚀 477171893 975981611 0.49
tpch_q04/datafusion:parquet 155995147 201482903 0.77
tpch_q05/datafusion:parquet 🚀 512255788 748610614 0.68
tpch_q06/datafusion:parquet 🚀 149031370 460580384 0.32
tpch_q07/datafusion:parquet 🚀 551702650 1079061969 0.51
tpch_q08/datafusion:parquet 657030293 847897550 0.77
tpch_q09/datafusion:parquet 496701427 624454372 0.80
tpch_q10/datafusion:parquet 543402399 701848008 0.77
tpch_q11/datafusion:parquet 🚀 336983292 484580071 0.70
tpch_q12/datafusion:parquet 245654178 305462555 0.80
tpch_q13/datafusion:parquet 439794244 468333443 0.94
tpch_q14/datafusion:parquet 🚨 328138765 170198752 1.93
tpch_q15/datafusion:parquet 🚨 415426718 317481776 1.31
tpch_q16/datafusion:parquet 186328501 179922148 1.04
tpch_q17/datafusion:parquet 451689817 379344154 1.19
tpch_q18/datafusion:parquet 446743364 454768284 0.98
tpch_q19/datafusion:parquet 459743919 370374870 1.24
tpch_q20/datafusion:parquet 515330976 420930760 1.22
tpch_q21/datafusion:parquet 808498529 750926121 1.08
tpch_q22/datafusion:parquet 160916406 193348787 0.83
duckdb / vortex-file-compressed (0.936x ➖, 1↑ 0↓)
name PR 53212e6 (ns) base 1f3206f (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 351093728 279645161 1.26
tpch_q02/duckdb:vortex-file-compressed 942646011 990522897 0.95
tpch_q03/duckdb:vortex-file-compressed 550362430 706970865 0.78
tpch_q04/duckdb:vortex-file-compressed 🚀 352456495 511285448 0.69
tpch_q05/duckdb:vortex-file-compressed 914268857 986741598 0.93
tpch_q06/duckdb:vortex-file-compressed 416682077 566480568 0.74
tpch_q07/duckdb:vortex-file-compressed 688362298 829597833 0.83
tpch_q08/duckdb:vortex-file-compressed 906291989 957632066 0.95
tpch_q09/duckdb:vortex-file-compressed 857377973 920529607 0.93
tpch_q10/duckdb:vortex-file-compressed 742471345 799711364 0.93
tpch_q11/duckdb:vortex-file-compressed 513962858 501532315 1.02
tpch_q12/duckdb:vortex-file-compressed 537035537 568775063 0.94
tpch_q13/duckdb:vortex-file-compressed 534607153 458064765 1.17
tpch_q14/duckdb:vortex-file-compressed 526188813 519179882 1.01
tpch_q15/duckdb:vortex-file-compressed 288403573 260714314 1.11
tpch_q16/duckdb:vortex-file-compressed 337733082 350688890 0.96
tpch_q17/duckdb:vortex-file-compressed 687797248 689539985 1.00
tpch_q18/duckdb:vortex-file-compressed 517689876 722548026 0.72
tpch_q19/duckdb:vortex-file-compressed 445463881 488261973 0.91
tpch_q20/duckdb:vortex-file-compressed 941559488 878803372 1.07
tpch_q21/duckdb:vortex-file-compressed 1112384096 1030647851 1.08
tpch_q22/duckdb:vortex-file-compressed 326673079 382669244 0.85
duckdb / vortex-compact (0.943x ➖, 1↑ 0↓)
name PR 53212e6 (ns) base 1f3206f (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 316064905 412324708 0.77
tpch_q02/duckdb:vortex-compact 851406105 1049213032 0.81
tpch_q03/duckdb:vortex-compact 565070425 571551777 0.99
tpch_q04/duckdb:vortex-compact 333557363 325844922 1.02
tpch_q05/duckdb:vortex-compact 797344181 835983275 0.95
tpch_q06/duckdb:vortex-compact 437396279 471504328 0.93
tpch_q07/duckdb:vortex-compact 694659232 740161372 0.94
tpch_q08/duckdb:vortex-compact 816213886 990106059 0.82
tpch_q09/duckdb:vortex-compact 893779257 1023570840 0.87
tpch_q10/duckdb:vortex-compact 820278570 695279838 1.18
tpch_q11/duckdb:vortex-compact 492742894 542216458 0.91
tpch_q12/duckdb:vortex-compact 🚀 402231644 594612081 0.68
tpch_q13/duckdb:vortex-compact 443406311 445672070 0.99
tpch_q14/duckdb:vortex-compact 425610042 483361692 0.88
tpch_q15/duckdb:vortex-compact 389832613 326741608 1.19
tpch_q16/duckdb:vortex-compact 372728490 366444845 1.02
tpch_q17/duckdb:vortex-compact 625439619 589589144 1.06
tpch_q18/duckdb:vortex-compact 541007478 472253009 1.15
tpch_q19/duckdb:vortex-compact 503701228 464154456 1.09
tpch_q20/duckdb:vortex-compact 797103657 960752199 0.83
tpch_q21/duckdb:vortex-compact 1015247446 1225298162 0.83
tpch_q22/duckdb:vortex-compact 350158886 332868561 1.05
duckdb / parquet (0.922x ➖, 2↑ 1↓)
name PR 53212e6 (ns) base 1f3206f (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 475167997 597001846 0.80
tpch_q02/duckdb:parquet 1305094083 1322150109 0.99
tpch_q03/duckdb:parquet 1173791863 998770374 1.18
tpch_q04/duckdb:parquet 592545023 819854797 0.72
tpch_q05/duckdb:parquet 1690639718 1578968921 1.07
tpch_q06/duckdb:parquet 🚨 518329377 392570135 1.32
tpch_q07/duckdb:parquet 1382708343 1437420615 0.96
tpch_q08/duckdb:parquet 1644612947 1853821873 0.89
tpch_q09/duckdb:parquet 1403002576 1483049307 0.95
tpch_q10/duckdb:parquet 1510889749 1616763127 0.93
tpch_q11/duckdb:parquet 915399795 907146155 1.01
tpch_q12/duckdb:parquet 616593999 593663838 1.04
tpch_q13/duckdb:parquet 900606816 964070317 0.93
tpch_q14/duckdb:parquet 🚀 657688511 1001581269 0.66
tpch_q15/duckdb:parquet 572407622 653327885 0.88
tpch_q16/duckdb:parquet 649061500 590177883 1.10
tpch_q17/duckdb:parquet 802945067 963610735 0.83
tpch_q18/duckdb:parquet 842363928 1087685622 0.77
tpch_q19/duckdb:parquet 🚀 725623262 1064962431 0.68
tpch_q20/duckdb:parquet 1241627231 1157914020 1.07
tpch_q21/duckdb:parquet 1252193651 1219856319 1.03
tpch_q22/duckdb:parquet 464516039 591757116 0.78
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact -31.5% -5.1% -27.8% +186.5% ➖ noise
1 datafusion:vortex-file-compressed +1.2% -5.1% +6.7% +183.2% ➖ noise
1 duckdb:vortex-compact -23.3% -5.1% -19.2% +100.0% ➖ noise
1 duckdb:vortex-file-compressed +25.5% -5.1% +32.3% +85.4% ➖ noise
2 datafusion:vortex-compact -40.5% -6.0% -36.7% +56.1% ✅ faster
2 datafusion:vortex-file-compressed -7.0% -6.0% -1.1% +46.9% ➖ noise
2 duckdb:vortex-compact -18.9% -6.0% -13.7% +46.9% ➖ noise
2 duckdb:vortex-file-compressed -4.8% -6.0% +1.2% +46.9% ➖ noise
3 datafusion:vortex-compact -5.7% -24.2% +24.4% +105.9% ➖ noise
3 datafusion:vortex-file-compressed +16.8% -24.2% +54.1% +104.3% ➖ noise
3 duckdb:vortex-compact -1.1% -24.2% +30.4% +53.3% ➖ noise
3 duckdb:vortex-file-compressed -22.2% -24.2% +2.7% +52.3% ➖ noise
4 datafusion:vortex-compact -12.9% -25.2% +16.5% +72.3% ➖ noise
4 datafusion:vortex-file-compressed +11.7% -25.2% +49.3% +83.4% ➖ noise
4 duckdb:vortex-compact +2.4% -25.2% +36.8% +63.5% ➖ noise
4 duckdb:vortex-file-compressed -31.1% -25.2% -7.8% +50.3% ➖ noise
5 datafusion:vortex-compact +14.4% -14.4% +33.7% +46.9% ➖ noise
5 datafusion:vortex-file-compressed +19.7% -14.4% +39.8% +52.1% ➖ noise
5 duckdb:vortex-compact -4.6% -14.4% +11.4% +46.9% ➖ noise
5 duckdb:vortex-file-compressed -7.3% -14.4% +8.2% +46.9% ➖ noise
6 datafusion:vortex-compact +0.9% -34.6% +54.3% +55.2% ➖ noise
6 datafusion:vortex-file-compressed +15.6% -34.6% +76.8% +95.6% ➖ noise
6 duckdb:vortex-compact -7.2% -34.6% +41.9% +66.4% ➖ noise
6 duckdb:vortex-file-compressed -26.4% -34.6% +12.5% +52.9% ➖ noise
7 datafusion:vortex-compact +11.7% -29.9% +59.2% +51.3% 🚨 regression
7 datafusion:vortex-file-compressed +44.2% -29.9% +105.6% +46.9% 🚨 regression
7 duckdb:vortex-compact -6.1% -29.9% +33.8% +47.4% ➖ noise
7 duckdb:vortex-file-compressed -17.0% -29.9% +18.3% +46.9% ➖ noise
8 datafusion:vortex-compact -0.8% -17.1% +19.6% +47.3% ➖ noise
8 datafusion:vortex-file-compressed +21.2% -17.1% +46.1% +57.7% ➖ noise
8 duckdb:vortex-compact -17.6% -17.1% -0.6% +46.9% ➖ noise
8 duckdb:vortex-file-compressed -5.4% -17.1% +14.1% +46.9% ➖ noise
9 datafusion:vortex-compact -0.2% -13.3% +15.0% +46.9% ➖ noise
9 datafusion:vortex-file-compressed +102.5% -13.3% +133.4% +77.8% 🚨 regression
9 duckdb:vortex-compact -12.7% -13.3% +0.7% +46.9% ➖ noise
9 duckdb:vortex-file-compressed -6.9% -13.3% +7.4% +46.9% ➖ noise
10 datafusion:vortex-compact +16.1% -14.9% +36.4% +46.9% ➖ noise
10 datafusion:vortex-file-compressed +0.4% -14.9% +18.0% +46.9% ➖ noise
10 duckdb:vortex-compact +18.0% -14.9% +38.7% +46.9% ➖ noise
10 duckdb:vortex-file-compressed -7.2% -14.9% +9.1% +46.9% ➖ noise
11 datafusion:vortex-compact +24.0% -16.2% +48.0% +46.9% 🚨 regression
11 datafusion:vortex-file-compressed +25.8% -16.2% +50.2% +46.9% 🚨 regression
11 duckdb:vortex-compact -9.1% -16.2% +8.5% +46.9% ➖ noise
11 duckdb:vortex-file-compressed +2.5% -16.2% +22.3% +46.9% ➖ noise
12 datafusion:vortex-compact -12.3% -8.6% -4.1% +62.3% ➖ noise
12 datafusion:vortex-file-compressed +30.6% -8.6% +42.9% +67.8% ➖ noise
12 duckdb:vortex-compact -32.4% -8.6% -26.0% +50.5% ➖ noise
12 duckdb:vortex-file-compressed -5.6% -8.6% +3.3% +55.2% ➖ noise
13 datafusion:vortex-compact -5.9% -6.3% +0.5% +88.8% ➖ noise
13 datafusion:vortex-file-compressed +115.6% -6.3% +130.2% +103.2% 🚨 regression
13 duckdb:vortex-compact -0.5% -6.3% +6.2% +46.9% ➖ noise
13 duckdb:vortex-file-compressed +16.7% -6.3% +24.6% +46.9% ➖ noise
14 datafusion:vortex-compact -12.7% +12.5% -22.4% +46.9% ➖ noise
14 datafusion:vortex-file-compressed +12.3% +12.5% -0.2% +59.7% ➖ noise
14 duckdb:vortex-compact -11.9% +12.5% -21.7% +46.9% ➖ noise
14 duckdb:vortex-file-compressed +1.4% +12.5% -9.9% +46.9% ➖ noise
15 datafusion:vortex-compact -9.1% +7.1% -15.1% +46.9% ➖ noise
15 datafusion:vortex-file-compressed +55.2% +7.1% +44.9% +46.9% ➖ noise
15 duckdb:vortex-compact +19.3% +7.1% +11.4% +57.4% ➖ noise
15 duckdb:vortex-file-compressed +10.6% +7.1% +3.3% +46.9% ➖ noise
16 datafusion:vortex-compact +3.5% +6.7% -3.0% +46.9% ➖ noise
16 datafusion:vortex-file-compressed -26.9% +6.7% -31.5% +46.9% ➖ noise
16 duckdb:vortex-compact +1.7% +6.7% -4.7% +46.9% ➖ noise
16 duckdb:vortex-file-compressed -3.7% +6.7% -9.8% +56.5% ➖ noise
17 datafusion:vortex-compact +12.5% -0.4% +12.9% +46.9% ➖ noise
17 datafusion:vortex-file-compressed -28.7% -0.4% -28.4% +68.7% ➖ noise
17 duckdb:vortex-compact +6.1% -0.4% +6.5% +46.9% ➖ noise
17 duckdb:vortex-file-compressed -0.3% -0.4% +0.1% +46.9% ➖ noise
18 datafusion:vortex-compact +1.7% -12.8% +16.6% +48.1% ➖ noise
18 datafusion:vortex-file-compressed -30.1% -12.8% -19.9% +103.8% ➖ noise
18 duckdb:vortex-compact +14.6% -12.8% +31.3% +46.9% ➖ noise
18 duckdb:vortex-file-compressed -28.4% -12.8% -17.9% +46.9% ➖ noise
19 datafusion:vortex-compact -6.2% -8.0% +2.0% +46.9% ➖ noise
19 datafusion:vortex-file-compressed -43.5% -8.0% -38.5% +54.6% ✅ faster
19 duckdb:vortex-compact +8.5% -8.0% +18.0% +46.9% ➖ noise
19 duckdb:vortex-file-compressed -8.8% -8.0% -0.8% +57.4% ➖ noise
20 datafusion:vortex-compact +2.1% +14.6% -10.9% +46.9% ➖ noise
20 datafusion:vortex-file-compressed -31.2% +14.6% -40.0% +46.9% ✅ faster
20 duckdb:vortex-compact -17.0% +14.6% -27.6% +46.9% ➖ noise
20 duckdb:vortex-file-compressed +7.1% +14.6% -6.5% +46.9% ➖ noise
21 datafusion:vortex-compact +46.5% +5.1% +39.3% +46.9% ➖ noise
21 datafusion:vortex-file-compressed -26.2% +5.1% -29.8% +49.5% ➖ noise
21 duckdb:vortex-compact -17.1% +5.1% -21.2% +46.9% ➖ noise
21 duckdb:vortex-file-compressed +7.9% +5.1% +2.7% +46.9% ➖ noise
22 datafusion:vortex-compact +57.9% -19.2% +95.4% +70.8% 🚨 regression
22 datafusion:vortex-file-compressed -23.3% -19.2% -5.1% +53.9% ➖ noise
22 duckdb:vortex-compact +5.2% -19.2% +30.1% +46.9% ➖ noise
22 duckdb:vortex-file-compressed -14.6% -19.2% +5.6% +46.9% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Mar 27, 2026

Benchmarks: FineWeb S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -1.3%
Vortex (geomean): 1.084x ➖
Parquet (geomean): 1.098x ➖
Shifts: Parquet (control) +9.8% · Median polish +4.4%


datafusion / vortex-file-compressed (1.079x ➖, 0↑ 1↓)
name PR 53212e6 (ns) base 1f3206f (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 🚨 47352377 35718117 1.33
fineweb_q01/datafusion:vortex-file-compressed 490555229 475951864 1.03
fineweb_q02/datafusion:vortex-file-compressed 553091695 593509387 0.93
fineweb_q03/datafusion:vortex-file-compressed 1551848417 1340716220 1.16
fineweb_q04/datafusion:vortex-file-compressed 1373444584 1367032925 1.00
fineweb_q05/datafusion:vortex-file-compressed 1338028446 1340693861 1.00
fineweb_q06/datafusion:vortex-file-compressed 1746575465 1457030658 1.20
fineweb_q07/datafusion:vortex-file-compressed 1401043636 1323925076 1.06
fineweb_q08/datafusion:vortex-file-compressed 571867101 540100328 1.06
datafusion / vortex-compact (1.050x ➖, 0↑ 1↓)
name PR 53212e6 (ns) base 1f3206f (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 🚨 55864586 32852202 1.70
fineweb_q01/datafusion:vortex-compact 749966616 607616900 1.23
fineweb_q02/datafusion:vortex-compact 743868949 771649108 0.96
fineweb_q03/datafusion:vortex-compact 1847209437 1831851457 1.01
fineweb_q04/datafusion:vortex-compact 2203581845 2263145091 0.97
fineweb_q05/datafusion:vortex-compact 1701009658 1725366509 0.99
fineweb_q06/datafusion:vortex-compact 1449644013 1615371599 0.90
fineweb_q07/datafusion:vortex-compact 1387176504 1403973133 0.99
fineweb_q08/datafusion:vortex-compact 567534298 633849682 0.90
datafusion / parquet (1.148x ➖, 0↑ 2↓)
name PR 53212e6 (ns) base 1f3206f (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 1472071371 1493573435 0.99
fineweb_q01/datafusion:parquet 2342434522 2046345635 1.14
fineweb_q02/datafusion:parquet 🚨 2362485305 1787285770 1.32
fineweb_q03/datafusion:parquet 1868728066 1847940360 1.01
fineweb_q04/datafusion:parquet 2067409779 2000458670 1.03
fineweb_q05/datafusion:parquet 2184126760 1983554358 1.10
fineweb_q06/datafusion:parquet 🚨 2544064706 1778464741 1.43
fineweb_q07/datafusion:parquet 2217345858 1995135316 1.11
fineweb_q08/datafusion:parquet 2146262888 1685943088 1.27
duckdb / vortex-file-compressed (1.086x ➖, 0↑ 1↓)
name PR 53212e6 (ns) base 1f3206f (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 126436922 102414954 1.23
fineweb_q01/duckdb:vortex-file-compressed 🚨 849687540 536784326 1.58
fineweb_q02/duckdb:vortex-file-compressed 484535769 433233618 1.12
fineweb_q03/duckdb:vortex-file-compressed 1479939724 1560295848 0.95
fineweb_q04/duckdb:vortex-file-compressed 1459610598 1557544867 0.94
fineweb_q05/duckdb:vortex-file-compressed 1452614131 1474919952 0.98
fineweb_q06/duckdb:vortex-file-compressed 1666012755 1642342570 1.01
fineweb_q07/duckdb:vortex-file-compressed 1592303024 1466634013 1.09
fineweb_q08/duckdb:vortex-file-compressed 661255122 665789972 0.99
duckdb / vortex-compact (1.122x ➖, 0↑ 2↓)
name PR 53212e6 (ns) base 1f3206f (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 🚨 111843062 76230465 1.47
fineweb_q01/duckdb:vortex-compact 735582677 579140692 1.27
fineweb_q02/duckdb:vortex-compact 🚨 721865491 549089402 1.31
fineweb_q03/duckdb:vortex-compact 1776666131 1693246632 1.05
fineweb_q04/duckdb:vortex-compact 1625927062 1682209544 0.97
fineweb_q05/duckdb:vortex-compact 1477742655 1498705757 0.99
fineweb_q06/duckdb:vortex-compact 1453900589 1416641542 1.03
fineweb_q07/duckdb:vortex-compact 1257636870 1283028986 0.98
fineweb_q08/duckdb:vortex-compact 573961227 501082327 1.15
duckdb / parquet (1.049x ➖, 0↑ 0↓)
name PR 53212e6 (ns) base 1f3206f (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 1141794108 1113483179 1.03
fineweb_q01/duckdb:parquet 1728439837 1595885776 1.08
fineweb_q02/duckdb:parquet 1736054487 1641711043 1.06
fineweb_q03/duckdb:parquet 4225216881 3995281080 1.06
fineweb_q04/duckdb:parquet 2053205087 1803584284 1.14
fineweb_q05/duckdb:parquet 2725448781 2575450562 1.06
fineweb_q06/duckdb:parquet 3472976690 3317102931 1.05
fineweb_q07/duckdb:parquet 4111205461 3958843726 1.04
fineweb_q08/duckdb:parquet 1070360019 1127769870 0.95
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-compact +70.0% +0.5% +69.1% +178.8% ➖ noise
0 datafusion:vortex-file-compressed +32.6% +0.5% +31.9% +206.7% ➖ noise
0 duckdb:vortex-compact +46.7% +0.5% +45.9% +115.5% ➖ noise
0 duckdb:vortex-file-compressed +23.5% +0.5% +22.8% +50.2% ➖ noise
1 datafusion:vortex-compact +23.4% +11.3% +10.9% +68.6% ➖ noise
1 datafusion:vortex-file-compressed +3.1% +11.3% -7.4% +80.0% ➖ noise
1 duckdb:vortex-compact +27.0% +11.3% +14.1% +43.6% ➖ noise
1 duckdb:vortex-file-compressed +58.3% +11.3% +42.2% +39.7% 🚨 regression
2 datafusion:vortex-compact -3.6% +18.2% -18.5% +30.7% ➖ noise
2 datafusion:vortex-file-compressed -6.8% +18.2% -21.2% +31.7% ➖ noise
2 duckdb:vortex-compact +31.5% +18.2% +11.2% +30.0% ➖ noise
2 duckdb:vortex-file-compressed +11.8% +18.2% -5.4% +30.7% ➖ noise
3 datafusion:vortex-compact +0.8% +3.4% -2.5% +30.0% ➖ noise
3 datafusion:vortex-file-compressed +15.7% +3.4% +11.9% +30.0% ➖ noise
3 duckdb:vortex-compact +4.9% +3.4% +1.5% +30.0% ➖ noise
3 duckdb:vortex-file-compressed -5.2% +3.4% -8.3% +30.0% ➖ noise
4 datafusion:vortex-compact -2.6% +8.5% -10.2% +30.0% ➖ noise
4 datafusion:vortex-file-compressed +0.5% +8.5% -7.4% +30.0% ➖ noise
4 duckdb:vortex-compact -3.3% +8.5% -10.9% +30.0% ➖ noise
4 duckdb:vortex-file-compressed -6.3% +8.5% -13.6% +30.0% ➖ noise
5 datafusion:vortex-compact -1.4% +7.9% -8.7% +30.0% ➖ noise
5 datafusion:vortex-file-compressed -0.2% +7.9% -7.5% +30.0% ➖ noise
5 duckdb:vortex-compact -1.4% +7.9% -8.7% +30.0% ➖ noise
5 duckdb:vortex-file-compressed -1.5% +7.9% -8.8% +30.0% ➖ noise
6 datafusion:vortex-compact -10.3% +22.4% -26.7% +30.0% ✅ faster
6 datafusion:vortex-file-compressed +19.9% +22.4% -2.0% +30.0% ➖ noise
6 duckdb:vortex-compact +2.6% +22.4% -16.1% +30.0% ➖ noise
6 duckdb:vortex-file-compressed +1.4% +22.4% -17.1% +30.0% ➖ noise
7 datafusion:vortex-compact -1.2% +7.4% -8.0% +30.0% ➖ noise
7 datafusion:vortex-file-compressed +5.8% +7.4% -1.5% +30.0% ➖ noise
7 duckdb:vortex-compact -2.0% +7.4% -8.8% +30.0% ➖ noise
7 duckdb:vortex-file-compressed +8.6% +7.4% +1.1% +30.0% ➖ noise
8 datafusion:vortex-compact -10.5% +9.9% -18.5% +32.4% ➖ noise
8 datafusion:vortex-file-compressed +5.9% +9.9% -3.7% +30.0% ➖ noise
8 duckdb:vortex-compact +14.5% +9.9% +4.2% +30.0% ➖ noise
8 duckdb:vortex-file-compressed -0.7% +9.9% -9.6% +276.4% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Mar 27, 2026

Benchmarks: Statistical and Population Genetics

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.3%
Vortex (geomean): 0.995x ➖
Parquet (geomean): 0.998x ➖
Shifts: Parquet (control) -0.2% · Median polish -0.2%


duckdb / vortex-file-compressed (1.025x ➖, 0↑ 1↓)
name PR 53212e6 (ns) base 1f3206f (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-file-compressed 10457728 10784148 0.97
statpopgen_q01/duckdb:vortex-file-compressed 🚨 26570382 18485023 1.44
statpopgen_q02/duckdb:vortex-file-compressed 1292642484 1275162985 1.01
statpopgen_q03/duckdb:vortex-file-compressed 3060629152 3053000153 1.00
statpopgen_q04/duckdb:vortex-file-compressed 3038987210 3046493275 1.00
statpopgen_q05/duckdb:vortex-file-compressed 1370770441 1384194651 0.99
statpopgen_q06/duckdb:vortex-file-compressed 2025889505 2058906986 0.98
statpopgen_q07/duckdb:vortex-file-compressed 209870495 212197097 0.99
statpopgen_q08/duckdb:vortex-file-compressed 217059634 221366401 0.98
statpopgen_q09/duckdb:vortex-file-compressed 2860320581 2867504127 1.00
statpopgen_q10/duckdb:vortex-file-compressed 4595340693 4640414104 0.99
duckdb / vortex-compact (0.965x ➖, 1↑ 0↓)
name PR 53212e6 (ns) base 1f3206f (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-compact 10475267 10667523 0.98
statpopgen_q01/duckdb:vortex-compact 🚀 115377818 167901022 0.69
statpopgen_q02/duckdb:vortex-compact 1825523239 1802876617 1.01
statpopgen_q03/duckdb:vortex-compact 3486555250 3497351090 1.00
statpopgen_q04/duckdb:vortex-compact 3505737909 3541305368 0.99
statpopgen_q05/duckdb:vortex-compact 1823191933 1831969834 1.00
statpopgen_q06/duckdb:vortex-compact 2661128166 2659423800 1.00
statpopgen_q07/duckdb:vortex-compact 959380381 951551000 1.01
statpopgen_q08/duckdb:vortex-compact 995770881 993210828 1.00
statpopgen_q09/duckdb:vortex-compact 3327265946 3334621535 1.00
statpopgen_q10/duckdb:vortex-compact 5359162266 5346003959 1.00
duckdb / parquet (0.998x ➖, 0↑ 0↓)
name PR 53212e6 (ns) base 1f3206f (ns) ratio (PR/base)
statpopgen_q00/duckdb:parquet 310169182 314251559 0.99
statpopgen_q01/duckdb:parquet 400068621 398809324 1.00
statpopgen_q02/duckdb:parquet 985933840 991202016 0.99
statpopgen_q03/duckdb:parquet 1464575301 1476276228 0.99
statpopgen_q04/duckdb:parquet 1496009386 1517910377 0.99
statpopgen_q05/duckdb:parquet 1001708916 989599455 1.01
statpopgen_q06/duckdb:parquet 1471600725 1477288557 1.00
statpopgen_q07/duckdb:parquet 1876565671 1868588753 1.00
statpopgen_q08/duckdb:parquet 1896917027 1872597277 1.01
statpopgen_q09/duckdb:parquet 1373072500 1397727369 0.98
statpopgen_q10/duckdb:parquet 2668859974 2649639425 1.01
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 duckdb:vortex-compact -1.8% -1.3% -0.5% +10.0% ➖ noise
0 duckdb:vortex-file-compressed -3.0% -1.3% -1.8% +11.1% ➖ noise
1 duckdb:vortex-compact -31.3% +0.3% -31.5% +33.0% ✅ faster
1 duckdb:vortex-file-compressed +43.7% +0.3% +43.3% +269.6% ➖ noise
2 duckdb:vortex-compact +1.3% -0.5% +1.8% +10.0% ➖ noise
2 duckdb:vortex-file-compressed +1.4% -0.5% +1.9% +10.0% ➖ noise
3 duckdb:vortex-compact -0.3% -0.8% +0.5% +10.0% ➖ noise
3 duckdb:vortex-file-compressed +0.2% -0.8% +1.1% +10.0% ➖ noise
4 duckdb:vortex-compact -1.0% -1.4% +0.4% +10.0% ➖ noise
4 duckdb:vortex-file-compressed -0.2% -1.4% +1.2% +10.0% ➖ noise
5 duckdb:vortex-compact -0.5% +1.2% -1.7% +10.0% ➖ noise
5 duckdb:vortex-file-compressed -1.0% +1.2% -2.2% +10.0% ➖ noise
6 duckdb:vortex-compact +0.1% -0.4% +0.5% +10.0% ➖ noise
6 duckdb:vortex-file-compressed -1.6% -0.4% -1.2% +10.0% ➖ noise
7 duckdb:vortex-compact +0.8% +0.4% +0.4% +10.0% ➖ noise
7 duckdb:vortex-file-compressed -1.1% +0.4% -1.5% +10.0% ➖ noise
8 duckdb:vortex-compact +0.3% +1.3% -1.0% +10.0% ➖ noise
8 duckdb:vortex-file-compressed -1.9% +1.3% -3.2% +10.0% ➖ noise
9 duckdb:vortex-compact -0.2% -1.8% +1.6% +10.0% ➖ noise
9 duckdb:vortex-file-compressed -0.3% -1.8% +1.5% +10.0% ➖ noise
10 duckdb:vortex-compact +0.2% +0.7% -0.5% +10.0% ➖ noise
10 duckdb:vortex-file-compressed -1.0% +0.7% -1.7% +10.0% ➖ noise

Signed-off-by: Adam Gutglick <adam@spiraldb.com>
@AdamGS AdamGS force-pushed the adamg/try-planus-again branch from f04b111 to 53212e6 Compare March 27, 2026 19:02
@AdamGS AdamGS added the action/benchmark Trigger full benchmarks to run on this PR label Mar 27, 2026
@github-actions github-actions bot removed the action/benchmark Trigger full benchmarks to run on this PR label Mar 27, 2026
@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Mar 27, 2026

Benchmarks: TPC-H SF=10 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -12.1%
Vortex (geomean): 1.029x ➖
Parquet (geomean): 1.170x ➖
Shifts: Parquet (control) +17.0% · Median polish +6.7%


datafusion / vortex-file-compressed (1.085x ➖, 0↑ 4↓)
name PR 53212e6 (ns) base 1f3206f (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 822032020 758260599 1.08
tpch_q02/datafusion:vortex-file-compressed 1155371563 1115473626 1.04
tpch_q03/datafusion:vortex-file-compressed 862714208 1178722714 0.73
tpch_q04/datafusion:vortex-file-compressed 710715613 727085959 0.98
tpch_q05/datafusion:vortex-file-compressed 1055156886 958320828 1.10
tpch_q06/datafusion:vortex-file-compressed 690718863 586452038 1.18
tpch_q07/datafusion:vortex-file-compressed 1186076692 1025690990 1.16
tpch_q08/datafusion:vortex-file-compressed 🚨 1520349085 1101596098 1.38
tpch_q09/datafusion:vortex-file-compressed 1549057061 1400486646 1.11
tpch_q10/datafusion:vortex-file-compressed 1091386749 1056037482 1.03
tpch_q11/datafusion:vortex-file-compressed 458189543 562068200 0.82
tpch_q12/datafusion:vortex-file-compressed 1057269061 910940131 1.16
tpch_q13/datafusion:vortex-file-compressed 503542913 441801733 1.14
tpch_q14/datafusion:vortex-file-compressed 648896673 598517007 1.08
tpch_q15/datafusion:vortex-file-compressed 🚨 1515618519 1107607974 1.37
tpch_q16/datafusion:vortex-file-compressed 🚨 592108911 352103814 1.68
tpch_q17/datafusion:vortex-file-compressed 1287018941 1166718565 1.10
tpch_q18/datafusion:vortex-file-compressed 1229404130 1275883085 0.96
tpch_q19/datafusion:vortex-file-compressed 948098282 1158649267 0.82
tpch_q20/datafusion:vortex-file-compressed 1256109281 1419694990 0.88
tpch_q21/datafusion:vortex-file-compressed 2000273434 2152154145 0.93
tpch_q22/datafusion:vortex-file-compressed 🚨 763471724 459288113 1.66
datafusion / vortex-compact (1.151x ➖, 0↑ 6↓)
name PR 53212e6 (ns) base 1f3206f (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 703776255 731651636 0.96
tpch_q02/datafusion:vortex-compact 778640756 763289308 1.02
tpch_q03/datafusion:vortex-compact 🚨 933591689 710537834 1.31
tpch_q04/datafusion:vortex-compact 627272052 573295510 1.09
tpch_q05/datafusion:vortex-compact 🚨 1183202019 876479086 1.35
tpch_q06/datafusion:vortex-compact 🚨 768581525 574900352 1.34
tpch_q07/datafusion:vortex-compact 🚨 1359508968 1001380092 1.36
tpch_q08/datafusion:vortex-compact 🚨 1442498401 1006211086 1.43
tpch_q09/datafusion:vortex-compact 1413676613 1252859845 1.13
tpch_q10/datafusion:vortex-compact 1401254294 1218190846 1.15
tpch_q11/datafusion:vortex-compact 🚨 576817833 396738869 1.45
tpch_q12/datafusion:vortex-compact 930930871 894468811 1.04
tpch_q13/datafusion:vortex-compact 445456724 402985943 1.11
tpch_q14/datafusion:vortex-compact 702576889 573020048 1.23
tpch_q15/datafusion:vortex-compact 1076959837 1049173740 1.03
tpch_q16/datafusion:vortex-compact 369611147 310768893 1.19
tpch_q17/datafusion:vortex-compact 1197569335 1179884045 1.01
tpch_q18/datafusion:vortex-compact 1126016498 1203290344 0.94
tpch_q19/datafusion:vortex-compact 737331749 638608823 1.15
tpch_q20/datafusion:vortex-compact 949624377 906321499 1.05
tpch_q21/datafusion:vortex-compact 1468190097 1542415287 0.95
tpch_q22/datafusion:vortex-compact 593864464 474633796 1.25
datafusion / parquet (1.262x ➖, 0↑ 7↓)
name PR 53212e6 (ns) base 1f3206f (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 876681808 785964646 1.12
tpch_q02/datafusion:parquet 🚨 1008152535 674120121 1.50
tpch_q03/datafusion:parquet 1005629113 1269609308 0.79
tpch_q04/datafusion:parquet 624210390 526391272 1.19
tpch_q05/datafusion:parquet 1474609834 1429827240 1.03
tpch_q06/datafusion:parquet 540135960 545516065 0.99
tpch_q07/datafusion:parquet 1665632640 1424584859 1.17
tpch_q08/datafusion:parquet 1951598146 1706701252 1.14
tpch_q09/datafusion:parquet 2090649440 1818522292 1.15
tpch_q10/datafusion:parquet 🚨 3724318840 2292603828 1.62
tpch_q11/datafusion:parquet 🚨 1374268363 610315554 2.25
tpch_q12/datafusion:parquet 🚨 1202969488 719031711 1.67
tpch_q13/datafusion:parquet 892299961 798071150 1.12
tpch_q14/datafusion:parquet 932826883 808520852 1.15
tpch_q15/datafusion:parquet 1300938124 1155529658 1.13
tpch_q16/datafusion:parquet 442656528 392511486 1.13
tpch_q17/datafusion:parquet 1691531086 1311133200 1.29
tpch_q18/datafusion:parquet 1990298624 2118342803 0.94
tpch_q19/datafusion:parquet 1213522421 950028135 1.28
tpch_q20/datafusion:parquet 🚨 1607030987 1217028654 1.32
tpch_q21/datafusion:parquet 🚨 2873279259 1816804697 1.58
tpch_q22/datafusion:parquet 🚨 1461898459 698072252 2.09
duckdb / vortex-file-compressed (0.967x ➖, 1↑ 1↓)
name PR 53212e6 (ns) base 1f3206f (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 613003742 644975497 0.95
tpch_q02/duckdb:vortex-file-compressed 1080242527 1146392784 0.94
tpch_q03/duckdb:vortex-file-compressed 1044813575 966553337 1.08
tpch_q04/duckdb:vortex-file-compressed 701053339 592127560 1.18
tpch_q05/duckdb:vortex-file-compressed 1116855083 1039920733 1.07
tpch_q06/duckdb:vortex-file-compressed 769962959 882177442 0.87
tpch_q07/duckdb:vortex-file-compressed 1256862791 1118936295 1.12
tpch_q08/duckdb:vortex-file-compressed 1370313398 1654280902 0.83
tpch_q09/duckdb:vortex-file-compressed 1671334540 1552254157 1.08
tpch_q10/duckdb:vortex-file-compressed 1007882078 1274317117 0.79
tpch_q11/duckdb:vortex-file-compressed 682477588 768885025 0.89
tpch_q12/duckdb:vortex-file-compressed 🚨 1103383356 728262108 1.52
tpch_q13/duckdb:vortex-file-compressed 919888586 1185709027 0.78
tpch_q14/duckdb:vortex-file-compressed 976268866 951296681 1.03
tpch_q15/duckdb:vortex-file-compressed 550635377 541606628 1.02
tpch_q16/duckdb:vortex-file-compressed 456101617 440248329 1.04
tpch_q17/duckdb:vortex-file-compressed 1108331185 997817420 1.11
tpch_q18/duckdb:vortex-file-compressed 1094567453 1191353433 0.92
tpch_q19/duckdb:vortex-file-compressed 787287215 829456705 0.95
tpch_q20/duckdb:vortex-file-compressed 🚀 1114916050 1742712225 0.64
tpch_q21/duckdb:vortex-file-compressed 1989514574 1945788145 1.02
tpch_q22/duckdb:vortex-file-compressed 688862208 874272274 0.79
duckdb / vortex-compact (0.926x ➖, 1↑ 1↓)
name PR 53212e6 (ns) base 1f3206f (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 597291153 725047140 0.82
tpch_q02/duckdb:vortex-compact 1052853057 1016905445 1.04
tpch_q03/duckdb:vortex-compact 887237219 968645616 0.92
tpch_q04/duckdb:vortex-compact 538558818 566480570 0.95
tpch_q05/duckdb:vortex-compact 1117822583 1041983107 1.07
tpch_q06/duckdb:vortex-compact 718497348 829664074 0.87
tpch_q07/duckdb:vortex-compact 1197604081 1057497458 1.13
tpch_q08/duckdb:vortex-compact 1336077807 1547583064 0.86
tpch_q09/duckdb:vortex-compact 1429586901 1622096546 0.88
tpch_q10/duckdb:vortex-compact 1120294539 1382671262 0.81
tpch_q11/duckdb:vortex-compact 642260380 730368006 0.88
tpch_q12/duckdb:vortex-compact 704388540 678828540 1.04
tpch_q13/duckdb:vortex-compact 🚨 1356962779 934347799 1.45
tpch_q14/duckdb:vortex-compact 806188255 925392942 0.87
tpch_q15/duckdb:vortex-compact 623114166 568820836 1.10
tpch_q16/duckdb:vortex-compact 424069877 509584803 0.83
tpch_q17/duckdb:vortex-compact 1064729229 902781212 1.18
tpch_q18/duckdb:vortex-compact 🚀 726118586 1123748138 0.65
tpch_q19/duckdb:vortex-compact 753108160 829698075 0.91
tpch_q20/duckdb:vortex-compact 1268694493 1637683704 0.77
tpch_q21/duckdb:vortex-compact 1592737134 1918110396 0.83
tpch_q22/duckdb:vortex-compact 628341313 765342041 0.82
duckdb / parquet (1.085x ➖, 0↑ 2↓)
name PR 53212e6 (ns) base 1f3206f (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 🚨 1207249339 857590439 1.41
tpch_q02/duckdb:parquet 1555900069 1546486625 1.01
tpch_q03/duckdb:parquet 1789482437 1555936981 1.15
tpch_q04/duckdb:parquet 988099701 1120427451 0.88
tpch_q05/duckdb:parquet 2344910830 2024490613 1.16
tpch_q06/duckdb:parquet 812992911 660356760 1.23
tpch_q07/duckdb:parquet 2001050147 1772537255 1.13
tpch_q08/duckdb:parquet 2910378360 2643261138 1.10
tpch_q09/duckdb:parquet 2534106204 2273700854 1.11
tpch_q10/duckdb:parquet 3457841772 2980604021 1.16
tpch_q11/duckdb:parquet 888321120 1104722706 0.80
tpch_q12/duckdb:parquet 🚨 1332982672 908901184 1.47
tpch_q13/duckdb:parquet 1235248264 1179119147 1.05
tpch_q14/duckdb:parquet 1356988698 1258310376 1.08
tpch_q15/duckdb:parquet 928105753 870859466 1.07
tpch_q16/duckdb:parquet 730770381 743572734 0.98
tpch_q17/duckdb:parquet 1281368770 1299374814 0.99
tpch_q18/duckdb:parquet 1469859851 1364775491 1.08
tpch_q19/duckdb:parquet 1562911603 1569920032 1.00
tpch_q20/duckdb:parquet 1771161013 1837255219 0.96
tpch_q21/duckdb:parquet 2265411157 1940447089 1.17
tpch_q22/duckdb:parquet 1086387220 996082814 1.09
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact -3.8% +25.3% -23.2% +69.6% ➖ noise
1 datafusion:vortex-file-compressed +8.4% +25.3% -13.5% +73.6% ➖ noise
1 duckdb:vortex-compact -17.6% +25.3% -34.3% +45.0% ✅ faster
1 duckdb:vortex-file-compressed -5.0% +25.3% -24.2% +39.2% ➖ noise
2 datafusion:vortex-compact +2.0% +22.7% -16.8% +52.3% ➖ noise
2 datafusion:vortex-file-compressed +3.6% +22.7% -15.6% +104.7% ➖ noise
2 duckdb:vortex-compact +3.5% +22.7% -15.6% +56.8% ➖ noise
2 duckdb:vortex-file-compressed -5.8% +22.7% -23.2% +53.3% ➖ noise
3 datafusion:vortex-compact +31.4% -4.6% +37.7% +82.0% ➖ noise
3 datafusion:vortex-file-compressed -26.8% -4.6% -23.3% +84.5% ➖ noise
3 duckdb:vortex-compact -8.4% -4.6% -4.0% +59.0% ➖ noise
3 duckdb:vortex-file-compressed +8.1% -4.6% +13.3% +50.6% ➖ noise
4 datafusion:vortex-compact +9.4% +2.3% +7.0% +39.2% ➖ noise
4 datafusion:vortex-file-compressed -2.3% +2.3% -4.4% +46.3% ➖ noise
4 duckdb:vortex-compact -4.9% +2.3% -7.0% +44.9% ➖ noise
4 duckdb:vortex-file-compressed +18.4% +2.3% +15.8% +39.2% ➖ noise
5 datafusion:vortex-compact +35.0% +9.3% +23.5% +39.2% ➖ noise
5 datafusion:vortex-file-compressed +10.1% +9.3% +0.7% +39.2% ➖ noise
5 duckdb:vortex-compact +7.3% +9.3% -1.8% +39.2% ➖ noise
5 duckdb:vortex-file-compressed +7.4% +9.3% -1.7% +39.2% ➖ noise
6 datafusion:vortex-compact +33.7% +10.4% +21.1% +39.8% ➖ noise
6 datafusion:vortex-file-compressed +17.8% +10.4% +6.7% +39.2% ➖ noise
6 duckdb:vortex-compact -13.4% +10.4% -21.6% +39.2% ➖ noise
6 duckdb:vortex-file-compressed -12.7% +10.4% -20.9% +39.2% ➖ noise
7 datafusion:vortex-compact +35.8% +14.9% +18.2% +39.2% ➖ noise
7 datafusion:vortex-file-compressed +15.6% +14.9% +0.7% +39.2% ➖ noise
7 duckdb:vortex-compact +13.2% +14.9% -1.4% +39.2% ➖ noise
7 duckdb:vortex-file-compressed +12.3% +14.9% -2.2% +39.2% ➖ noise
8 datafusion:vortex-compact +43.4% +12.2% +27.8% +39.2% ➖ noise
8 datafusion:vortex-file-compressed +38.0% +12.2% +23.0% +39.2% ➖ noise
8 duckdb:vortex-compact -13.7% +12.2% -23.1% +39.2% ➖ noise
8 duckdb:vortex-file-compressed -17.2% +12.2% -26.2% +39.2% ➖ noise
9 datafusion:vortex-compact +12.8% +13.2% -0.3% +39.2% ➖ noise
9 datafusion:vortex-file-compressed +10.6% +13.2% -2.3% +39.2% ➖ noise
9 duckdb:vortex-compact -11.9% +13.2% -22.1% +39.2% ➖ noise
9 duckdb:vortex-file-compressed +7.7% +13.2% -4.9% +39.2% ➖ noise
10 datafusion:vortex-compact +15.0% +37.3% -16.2% +50.5% ➖ noise
10 datafusion:vortex-file-compressed +3.3% +37.3% -24.7% +39.2% ➖ noise
10 duckdb:vortex-compact -19.0% +37.3% -41.0% +39.2% ✅ faster
10 duckdb:vortex-file-compressed -20.9% +37.3% -42.4% +60.8% ✅ faster
11 datafusion:vortex-compact +45.4% +34.6% +8.0% +51.5% ➖ noise
11 datafusion:vortex-file-compressed -18.5% +34.6% -39.4% +39.2% ✅ faster
11 duckdb:vortex-compact -12.1% +34.6% -34.6% +39.2% ✅ faster
11 duckdb:vortex-file-compressed -11.2% +34.6% -34.0% +49.3% ✅ faster
12 datafusion:vortex-compact +4.1% +56.6% -33.6% +42.7% ✅ faster
12 datafusion:vortex-file-compressed +16.1% +56.6% -25.9% +39.2% ➖ noise
12 duckdb:vortex-compact +3.8% +56.6% -33.8% +41.6% ✅ faster
12 duckdb:vortex-file-compressed +51.5% +56.6% -3.3% +60.5% ➖ noise
13 datafusion:vortex-compact +10.5% +8.2% +2.1% +51.7% ➖ noise
13 datafusion:vortex-file-compressed +14.0% +8.2% +5.3% +40.4% ➖ noise
13 duckdb:vortex-compact +45.2% +8.2% +34.2% +78.6% ➖ noise
13 duckdb:vortex-file-compressed -22.4% +8.2% -28.3% +66.3% ➖ noise
14 datafusion:vortex-compact +22.6% +11.5% +9.9% +39.2% ➖ noise
14 datafusion:vortex-file-compressed +8.4% +11.5% -2.8% +39.2% ➖ noise
14 duckdb:vortex-compact -12.9% +11.5% -21.9% +39.2% ➖ noise
14 duckdb:vortex-file-compressed +2.6% +11.5% -8.0% +39.2% ➖ noise
15 datafusion:vortex-compact +2.6% +9.5% -6.3% +39.2% ➖ noise
15 datafusion:vortex-file-compressed +36.8% +9.5% +24.9% +39.2% ➖ noise
15 duckdb:vortex-compact +9.5% +9.5% +0.0% +39.2% ➖ noise
15 duckdb:vortex-file-compressed +1.7% +9.5% -7.2% +39.2% ➖ noise
16 datafusion:vortex-compact +18.9% +5.3% +13.0% +61.8% ➖ noise
16 datafusion:vortex-file-compressed +68.2% +5.3% +59.7% +81.8% ➖ noise
16 duckdb:vortex-compact -16.8% +5.3% -21.0% +41.9% ➖ noise
16 duckdb:vortex-file-compressed +3.6% +5.3% -1.6% +48.1% ➖ noise
17 datafusion:vortex-compact +1.5% +12.8% -10.0% +39.2% ➖ noise
17 datafusion:vortex-file-compressed +10.3% +12.8% -2.2% +39.2% ➖ noise
17 duckdb:vortex-compact +17.9% +12.8% +4.6% +39.2% ➖ noise
17 duckdb:vortex-file-compressed +11.1% +12.8% -1.5% +39.2% ➖ noise
18 datafusion:vortex-compact -6.4% +0.6% -7.0% +39.2% ➖ noise
18 datafusion:vortex-file-compressed -3.6% +0.6% -4.2% +39.2% ➖ noise
18 duckdb:vortex-compact -35.4% +0.6% -35.8% +42.4% ✅ faster
18 duckdb:vortex-file-compressed -8.1% +0.6% -8.7% +41.9% ➖ noise
19 datafusion:vortex-compact +15.5% +12.8% +2.4% +44.1% ➖ noise
19 datafusion:vortex-file-compressed -18.2% +12.8% -27.4% +56.9% ➖ noise
19 duckdb:vortex-compact -9.2% +12.8% -19.5% +39.2% ➖ noise
19 duckdb:vortex-file-compressed -5.1% +12.8% -15.8% +39.2% ➖ noise
20 datafusion:vortex-compact +4.8% +12.8% -7.1% +39.2% ➖ noise
20 datafusion:vortex-file-compressed -11.5% +12.8% -21.6% +39.2% ➖ noise
20 duckdb:vortex-compact -22.5% +12.8% -31.3% +39.2% ✅ faster
20 duckdb:vortex-file-compressed -36.0% +12.8% -43.3% +39.2% ✅ faster
21 datafusion:vortex-compact -4.8% +35.9% -29.9% +39.2% ✅ faster
21 datafusion:vortex-file-compressed -7.1% +35.9% -31.6% +40.1% ✅ faster
21 duckdb:vortex-compact -17.0% +35.9% -38.9% +39.2% ✅ faster
21 duckdb:vortex-file-compressed +2.2% +35.9% -24.8% +43.4% ➖ noise
22 datafusion:vortex-compact +25.1% +51.1% -17.2% +46.8% ➖ noise
22 datafusion:vortex-file-compressed +66.2% +51.1% +10.0% +47.2% ➖ noise
22 duckdb:vortex-compact -17.9% +51.1% -45.7% +51.8% ✅ faster
22 duckdb:vortex-file-compressed -21.2% +51.1% -47.9% +39.5% ✅ faster

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Mar 27, 2026

Benchmarks: Random Access

Vortex (geomean): 0.915x ➖
Parquet (geomean): 0.972x ➖


unknown / unknown (0.958x ➖, 7↑ 3↓)
name PR f04b111 (ns) base 1f3206f (ns) ratio (PR/base)
random-access/feature-vectors/correlated/lance-tokio-local-disk 2435741 2529007 0.96
random-access/feature-vectors/correlated/lance-tokio-local-disk-footer 1463537 1528667 0.96
random-access/feature-vectors/correlated/parquet-tokio-local-disk 12062351349 12414503955 0.97
random-access/feature-vectors/correlated/parquet-tokio-local-disk-footer 11458184331 12101773904 0.95
random-access/feature-vectors/correlated/vortex-tokio-local-disk 9169960 8791004 1.04
random-access/feature-vectors/correlated/vortex-tokio-local-disk-footer 6783179 7450186 0.91
random-access/feature-vectors/uniform/lance-tokio-local-disk 1690979 1852451 0.91
random-access/feature-vectors/uniform/lance-tokio-local-disk-footer 2778461 2897158 0.96
random-access/feature-vectors/uniform/parquet-tokio-local-disk 11484915856 12086645688 0.95
random-access/feature-vectors/uniform/parquet-tokio-local-disk-footer 11422552046 12117935263 0.94
random-access/feature-vectors/uniform/vortex-tokio-local-disk 14206527 14707753 0.97
random-access/feature-vectors/uniform/vortex-tokio-local-disk-footer 13939256 14480036 0.96
random-access/lance-tokio-local-disk 818882 822418 1.00
random-access/lance-tokio-local-disk-footer 1501105 1596713 0.94
random-access/nested-lists/correlated/lance-tokio-local-disk 310072 294242 1.05
random-access/nested-lists/correlated/lance-tokio-local-disk-footer 865880 895935 0.97
random-access/nested-lists/correlated/parquet-tokio-local-disk 147372774 144536556 1.02
random-access/nested-lists/correlated/parquet-tokio-local-disk-footer 145630410 142548860 1.02
random-access/nested-lists/correlated/vortex-tokio-local-disk 904788 856358 1.06
random-access/nested-lists/correlated/vortex-tokio-local-disk-footer 892761 886495 1.01
random-access/nested-lists/uniform/lance-tokio-local-disk 1379081 1350623 1.02
random-access/nested-lists/uniform/lance-tokio-local-disk-footer 2008663 1963254 1.02
random-access/nested-lists/uniform/parquet-tokio-local-disk 146611576 143030400 1.03
random-access/nested-lists/uniform/parquet-tokio-local-disk-footer 146932430 141281515 1.04
random-access/nested-lists/uniform/vortex-tokio-local-disk 2730931 3028056 0.90
random-access/nested-lists/uniform/vortex-tokio-local-disk-footer 🚀 2732928 3118706 0.88
random-access/nested-structs/correlated/lance-tokio-local-disk 487816 516245 0.94
random-access/nested-structs/correlated/lance-tokio-local-disk-footer 746456 753696 0.99
random-access/nested-structs/correlated/parquet-tokio-local-disk 32473912 32108178 1.01
random-access/nested-structs/correlated/parquet-tokio-local-disk-footer 32703278 31996513 1.02
random-access/nested-structs/correlated/vortex-tokio-local-disk 891524 829835 1.07
random-access/nested-structs/correlated/vortex-tokio-local-disk-footer 🚨 1031062 912586 1.13
random-access/nested-structs/uniform/lance-tokio-local-disk 3344377 3067489 1.09
random-access/nested-structs/uniform/lance-tokio-local-disk-footer 🚨 3617882 3237756 1.12
random-access/nested-structs/uniform/parquet-tokio-local-disk 31604387 31912268 0.99
random-access/nested-structs/uniform/parquet-tokio-local-disk-footer 32195043 31726732 1.01
random-access/nested-structs/uniform/vortex-tokio-local-disk 🚨 2014251 1791130 1.12
random-access/nested-structs/uniform/vortex-tokio-local-disk-footer 1983560 2120861 0.94
random-access/parquet-tokio-local-disk 189655251 193799288 0.98
random-access/parquet-tokio-local-disk-footer 186669017 205843776 0.91
random-access/taxi/correlated/lance-tokio-local-disk 1050956 1071664 0.98
random-access/taxi/correlated/lance-tokio-local-disk-footer 1799184 1904841 0.94
random-access/taxi/correlated/parquet-tokio-local-disk 281468274 302862850 0.93
random-access/taxi/correlated/parquet-tokio-local-disk-footer 282503657 305326121 0.93
random-access/taxi/correlated/vortex-tokio-local-disk 🚀 1969448 2592064 0.76
random-access/taxi/correlated/vortex-tokio-local-disk-footer 🚀 1949222 2563472 0.76
random-access/taxi/uniform/lance-tokio-local-disk 9817723 10183043 0.96
random-access/taxi/uniform/lance-tokio-local-disk-footer 10560467 10536890 1.00
random-access/taxi/uniform/parquet-tokio-local-disk 298310771 326319646 0.91
random-access/taxi/uniform/parquet-tokio-local-disk-footer 297864385 327449453 0.91
random-access/taxi/uniform/vortex-tokio-local-disk 🚀 4673699 5507291 0.85
random-access/taxi/uniform/vortex-tokio-local-disk-footer 🚀 4785071 5727225 0.84
random-access/vortex-tokio-local-disk 🚀 1405105 2043957 0.69
random-access/vortex-tokio-local-disk-footer 🚀 1435374 1901874 0.75

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Mar 27, 2026

Benchmarks: Clickbench on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.5%
Vortex (geomean): 1.039x ➖
Parquet (geomean): 1.052x ➖
Shifts: Parquet (control) +5.2% · Median polish +4.6%


datafusion / vortex-file-compressed (1.064x ➖, 1↑ 14↓)
name PR f04b111 (ns) base 1f3206f (ns) ratio (PR/base)
clickbench_q00/datafusion:vortex-file-compressed 1934506 1928793 1.00
clickbench_q01/datafusion:vortex-file-compressed 🚀 13418249 15376482 0.87
clickbench_q02/datafusion:vortex-file-compressed 32499258 32376788 1.00
clickbench_q03/datafusion:vortex-file-compressed 35143685 37246233 0.94
clickbench_q04/datafusion:vortex-file-compressed 309298488 310060725 1.00
clickbench_q05/datafusion:vortex-file-compressed 326173800 328309862 0.99
clickbench_q06/datafusion:vortex-file-compressed 1938840 1873633 1.03
clickbench_q07/datafusion:vortex-file-compressed 18805080 18613237 1.01
clickbench_q08/datafusion:vortex-file-compressed 384332847 376206121 1.02
clickbench_q09/datafusion:vortex-file-compressed 554216971 550820778 1.01
clickbench_q10/datafusion:vortex-file-compressed 77408574 73149556 1.06
clickbench_q11/datafusion:vortex-file-compressed 86118259 81914658 1.05
clickbench_q12/datafusion:vortex-file-compressed 278195441 266720779 1.04
clickbench_q13/datafusion:vortex-file-compressed 422156773 421239926 1.00
clickbench_q14/datafusion:vortex-file-compressed 254791830 252478508 1.01
clickbench_q15/datafusion:vortex-file-compressed 384269120 362971034 1.06
clickbench_q16/datafusion:vortex-file-compressed 725938705 687311370 1.06
clickbench_q17/datafusion:vortex-file-compressed 707545839 683734008 1.03
clickbench_q18/datafusion:vortex-file-compressed 1470063269 1369507039 1.07
clickbench_q19/datafusion:vortex-file-compressed 🚨 25760203 22754756 1.13
clickbench_q20/datafusion:vortex-file-compressed 368712520 356359188 1.03
clickbench_q21/datafusion:vortex-file-compressed 448290040 419059553 1.07
clickbench_q22/datafusion:vortex-file-compressed 604103409 552678016 1.09
clickbench_q23/datafusion:vortex-file-compressed 796562281 745541302 1.07
clickbench_q24/datafusion:vortex-file-compressed 52501452 48093496 1.09
clickbench_q25/datafusion:vortex-file-compressed 🚨 78531501 67416252 1.16
clickbench_q26/datafusion:vortex-file-compressed 🚨 52312681 44685342 1.17
clickbench_q27/datafusion:vortex-file-compressed 840496453 787828662 1.07
clickbench_q28/datafusion:vortex-file-compressed 6825015836 6783742618 1.01
clickbench_q29/datafusion:vortex-file-compressed 233856903 241864713 0.97
clickbench_q30/datafusion:vortex-file-compressed 225385692 222585356 1.01
clickbench_q31/datafusion:vortex-file-compressed 274998925 266446442 1.03
clickbench_q32/datafusion:vortex-file-compressed 🚨 1434921766 1210941359 1.18
clickbench_q33/datafusion:vortex-file-compressed 🚨 1710750221 1460274141 1.17
clickbench_q34/datafusion:vortex-file-compressed 🚨 1634731967 1445954112 1.13
clickbench_q35/datafusion:vortex-file-compressed 🚨 574045265 508990591 1.13
clickbench_q36/datafusion:vortex-file-compressed 🚨 98374881 79388605 1.24
clickbench_q37/datafusion:vortex-file-compressed 🚨 45676133 39204875 1.17
clickbench_q38/datafusion:vortex-file-compressed 🚨 25917064 23431773 1.11
clickbench_q39/datafusion:vortex-file-compressed 🚨 169960596 152494794 1.11
clickbench_q40/datafusion:vortex-file-compressed 🚨 22756623 19226506 1.18
clickbench_q41/datafusion:vortex-file-compressed 🚨 20421004 18480638 1.10
clickbench_q42/datafusion:vortex-file-compressed 🚨 23503897 20427610 1.15
datafusion / parquet (1.018x ➖, 1↑ 6↓)
name PR f04b111 (ns) base 1f3206f (ns) ratio (PR/base)
clickbench_q00/datafusion:parquet 2098746 1969337 1.07
clickbench_q01/datafusion:parquet 21738537 21210871 1.02
clickbench_q02/datafusion:parquet 55321855 58519513 0.95
clickbench_q03/datafusion:parquet 45117268 47156481 0.96
clickbench_q04/datafusion:parquet 353111225 382231750 0.92
clickbench_q05/datafusion:parquet 439259969 413994781 1.06
clickbench_q06/datafusion:parquet 🚨 2255411 1995520 1.13
clickbench_q07/datafusion:parquet 28449201 27197822 1.05
clickbench_q08/datafusion:parquet 🚀 417339989 478982572 0.87
clickbench_q09/datafusion:parquet 671802538 689096318 0.97
clickbench_q10/datafusion:parquet 🚨 130554030 115654859 1.13
clickbench_q11/datafusion:parquet 🚨 157599628 142579951 1.11
clickbench_q12/datafusion:parquet 🚨 425508082 372367359 1.14
clickbench_q13/datafusion:parquet 🚨 617407086 509123830 1.21
clickbench_q14/datafusion:parquet 🚨 433539842 360002198 1.20
clickbench_q15/datafusion:parquet 410363479 394184288 1.04
clickbench_q16/datafusion:parquet 715382666 711957513 1.00
clickbench_q17/datafusion:parquet 701609038 685495432 1.02
clickbench_q18/datafusion:parquet 1427891290 1453108580 0.98
clickbench_q19/datafusion:parquet 32007405 33914890 0.94
clickbench_q20/datafusion:parquet 615424464 604112070 1.02
clickbench_q21/datafusion:parquet 667782690 658264084 1.01
clickbench_q22/datafusion:parquet 971915727 961604266 1.01
clickbench_q23/datafusion:parquet 3665026866 3584788087 1.02
clickbench_q24/datafusion:parquet 89771208 89188774 1.01
clickbench_q25/datafusion:parquet 141196294 138824700 1.02
clickbench_q26/datafusion:parquet 87830970 83620180 1.05
clickbench_q27/datafusion:parquet 1044403381 1055601076 0.99
clickbench_q28/datafusion:parquet 6673524051 6574007603 1.02
clickbench_q29/datafusion:parquet 242655060 252527474 0.96
clickbench_q30/datafusion:parquet 362622034 360434815 1.01
clickbench_q31/datafusion:parquet 387783275 385321321 1.01
clickbench_q32/datafusion:parquet 1208600507 1276241892 0.95
clickbench_q33/datafusion:parquet 1491536612 1521771850 0.98
clickbench_q34/datafusion:parquet 1518483107 1508900728 1.01
clickbench_q35/datafusion:parquet 527524014 527725811 1.00
clickbench_q36/datafusion:parquet 145096221 146948585 0.99
clickbench_q37/datafusion:parquet 63812271 60560562 1.05
clickbench_q38/datafusion:parquet 91824027 87963101 1.04
clickbench_q39/datafusion:parquet 276283632 276541645 1.00
clickbench_q40/datafusion:parquet 33261534 34656733 0.96
clickbench_q41/datafusion:parquet 30023654 30295533 0.99
clickbench_q42/datafusion:parquet 31782438 32639867 0.97
duckdb / vortex-file-compressed (1.014x ➖, 1↑ 7↓)
name PR f04b111 (ns) base 1f3206f (ns) ratio (PR/base)
clickbench_q00/duckdb:vortex-file-compressed 🚨 7475989 6065766 1.23
clickbench_q01/duckdb:vortex-file-compressed 13746441 13520150 1.02
clickbench_q02/duckdb:vortex-file-compressed 24364699 23918932 1.02
clickbench_q03/duckdb:vortex-file-compressed 30085737 32270989 0.93
clickbench_q04/duckdb:vortex-file-compressed 167658003 168769882 0.99
clickbench_q05/duckdb:vortex-file-compressed 196639392 197075590 1.00
clickbench_q06/duckdb:vortex-file-compressed 19490501 19077299 1.02
clickbench_q07/duckdb:vortex-file-compressed 🚨 17615003 15136533 1.16
clickbench_q08/duckdb:vortex-file-compressed 262760922 259289000 1.01
clickbench_q09/duckdb:vortex-file-compressed 377923648 375892141 1.01
clickbench_q10/duckdb:vortex-file-compressed 75274911 74408098 1.01
clickbench_q11/duckdb:vortex-file-compressed 83964174 83318450 1.01
clickbench_q12/duckdb:vortex-file-compressed 213459905 215562405 0.99
clickbench_q13/duckdb:vortex-file-compressed 427420372 445674015 0.96
clickbench_q14/duckdb:vortex-file-compressed 244196816 242691088 1.01
clickbench_q15/duckdb:vortex-file-compressed 210006022 208458893 1.01
clickbench_q16/duckdb:vortex-file-compressed 703983503 750150954 0.94
clickbench_q17/duckdb:vortex-file-compressed 548696772 576486965 0.95
clickbench_q18/duckdb:vortex-file-compressed 1270017359 1249306925 1.02
clickbench_q19/duckdb:vortex-file-compressed 20910651 20308044 1.03
clickbench_q20/duckdb:vortex-file-compressed 388118015 399434192 0.97
clickbench_q21/duckdb:vortex-file-compressed 418858085 420244586 1.00
clickbench_q22/duckdb:vortex-file-compressed 701048317 694529069 1.01
clickbench_q23/duckdb:vortex-file-compressed 🚀 1114264684 1735945198 0.64
clickbench_q24/duckdb:vortex-file-compressed 🚨 47429472 42389171 1.12
clickbench_q25/duckdb:vortex-file-compressed 75180375 76814779 0.98
clickbench_q26/duckdb:vortex-file-compressed 🚨 45272737 38932935 1.16
clickbench_q27/duckdb:vortex-file-compressed 539820669 532115101 1.01
clickbench_q28/duckdb:vortex-file-compressed 3007991192 3008104084 1.00
clickbench_q29/duckdb:vortex-file-compressed 28528737 29580120 0.96
clickbench_q30/duckdb:vortex-file-compressed 183411974 174261469 1.05
clickbench_q31/duckdb:vortex-file-compressed 258048359 253656763 1.02
clickbench_q32/duckdb:vortex-file-compressed 1415896968 1399203153 1.01
clickbench_q33/duckdb:vortex-file-compressed 1596818838 1552945603 1.03
clickbench_q34/duckdb:vortex-file-compressed 1676030571 1643469509 1.02
clickbench_q35/duckdb:vortex-file-compressed 364228774 363639964 1.00
clickbench_q36/duckdb:vortex-file-compressed 32789335 31412146 1.04
clickbench_q37/duckdb:vortex-file-compressed 23348638 23053361 1.01
clickbench_q38/duckdb:vortex-file-compressed 🚨 26774305 23929603 1.12
clickbench_q39/duckdb:vortex-file-compressed 45690257 45439367 1.01
clickbench_q40/duckdb:vortex-file-compressed 🚨 25006029 22655115 1.10
clickbench_q41/duckdb:vortex-file-compressed 22362465 21757017 1.03
clickbench_q42/duckdb:vortex-file-compressed 🚨 27698107 24202653 1.14
duckdb / parquet (1.087x ➖, 0↑ 21↓)
name PR f04b111 (ns) base 1f3206f (ns) ratio (PR/base)
clickbench_q00/duckdb:parquet 🚨 289132469 220831422 1.31
clickbench_q01/duckdb:parquet 🚨 56540652 50598975 1.12
clickbench_q02/duckdb:parquet 🚨 77447140 65544863 1.18
clickbench_q03/duckdb:parquet 🚨 72761596 63927553 1.14
clickbench_q04/duckdb:parquet 🚨 234208910 202971652 1.15
clickbench_q05/duckdb:parquet 🚨 314674514 285357950 1.10
clickbench_q06/duckdb:parquet 🚨 70745962 59273954 1.19
clickbench_q07/duckdb:parquet 🚨 60107896 50841020 1.18
clickbench_q08/duckdb:parquet 🚨 304698063 272640804 1.12
clickbench_q09/duckdb:parquet 🚨 436558146 394925373 1.11
clickbench_q10/duckdb:parquet 🚨 104915751 94662047 1.11
clickbench_q11/duckdb:parquet 117553273 108715167 1.08
clickbench_q12/duckdb:parquet 🚨 330374203 298387333 1.11
clickbench_q13/duckdb:parquet 🚨 592970734 515158300 1.15
clickbench_q14/duckdb:parquet 🚨 373063377 332225813 1.12
clickbench_q15/duckdb:parquet 🚨 279353147 240852056 1.16
clickbench_q16/duckdb:parquet 🚨 678487507 612050524 1.11
clickbench_q17/duckdb:parquet 🚨 568353080 508091888 1.12
clickbench_q18/duckdb:parquet 🚨 1218923214 1062529130 1.15
clickbench_q19/duckdb:parquet 🚨 55651599 48701541 1.14
clickbench_q20/duckdb:parquet 478430838 435840147 1.10
clickbench_q21/duckdb:parquet 🚨 615883097 558780281 1.10
clickbench_q22/duckdb:parquet 1021398675 934362005 1.09
clickbench_q23/duckdb:parquet 🚨 351251257 317897364 1.10
clickbench_q24/duckdb:parquet 83283020 78019731 1.07
clickbench_q25/duckdb:parquet 147442295 141033631 1.05
clickbench_q26/duckdb:parquet 56440406 55038830 1.03
clickbench_q27/duckdb:parquet 708304033 646291593 1.10
clickbench_q28/duckdb:parquet 5169318493 4852834870 1.07
clickbench_q29/duckdb:parquet 63265056 60718105 1.04
clickbench_q30/duckdb:parquet 309885853 303867247 1.02
clickbench_q31/duckdb:parquet 356621926 353409245 1.01
clickbench_q32/duckdb:parquet 1161425913 1118392772 1.04
clickbench_q33/duckdb:parquet 1325389657 1226480463 1.08
clickbench_q34/duckdb:parquet 1299459380 1234108951 1.05
clickbench_q35/duckdb:parquet 353163822 352083669 1.00
clickbench_q36/duckdb:parquet 64378700 63601239 1.01
clickbench_q37/duckdb:parquet 53484304 53915772 0.99
clickbench_q38/duckdb:parquet 58509901 58020708 1.01
clickbench_q39/duckdb:parquet 97065314 100050869 0.97
clickbench_q40/duckdb:parquet 55727667 55830375 1.00
clickbench_q41/duckdb:parquet 59291632 59400454 1.00
clickbench_q42/duckdb:parquet 52474919 49540127 1.06
duckdb / duckdb (1.063x ➖, 0↑ 11↓)
name PR f04b111 (ns) base 1f3206f (ns) ratio (PR/base)
clickbench_q00/duckdb:duckdb 🚨 19581521 17747314 1.10
clickbench_q01/duckdb:duckdb 35823936 32569363 1.10
clickbench_q02/duckdb:duckdb 🚨 49745046 44840679 1.11
clickbench_q03/duckdb:duckdb 51516096 47476257 1.09
clickbench_q04/duckdb:duckdb 🚨 236954284 213256005 1.11
clickbench_q05/duckdb:duckdb 351460646 326774300 1.08
clickbench_q06/duckdb:duckdb 🚨 38781003 34945213 1.11
clickbench_q07/duckdb:duckdb 🚨 39365858 35094727 1.12
clickbench_q08/duckdb:duckdb 🚨 350288558 313485503 1.12
clickbench_q09/duckdb:duckdb 497539469 482131401 1.03
clickbench_q10/duckdb:duckdb 102228612 98645475 1.04
clickbench_q11/duckdb:duckdb 115284462 107172602 1.08
clickbench_q12/duckdb:duckdb 🚨 345704665 294626219 1.17
clickbench_q13/duckdb:duckdb 598425527 547481285 1.09
clickbench_q14/duckdb:duckdb 🚨 394716745 327991014 1.20
clickbench_q15/duckdb:duckdb 🚨 293459852 256341338 1.14
clickbench_q16/duckdb:duckdb 742711804 696376502 1.07
clickbench_q17/duckdb:duckdb 🚨 639690128 571373923 1.12
clickbench_q18/duckdb:duckdb 1366843055 1273360302 1.07
clickbench_q19/duckdb:duckdb 37725206 34518468 1.09
clickbench_q20/duckdb:duckdb 1056976425 985029826 1.07
clickbench_q21/duckdb:duckdb 1121202333 1081138423 1.04
clickbench_q22/duckdb:duckdb 1072915754 1168805070 0.92
clickbench_q23/duckdb:duckdb 272405122 251650094 1.08
clickbench_q24/duckdb:duckdb 63941056 60848390 1.05
clickbench_q25/duckdb:duckdb 132142886 124218166 1.06
clickbench_q26/duckdb:duckdb 59016803 54444547 1.08
clickbench_q27/duckdb:duckdb 1060420692 1129558873 0.94
clickbench_q28/duckdb:duckdb 4659753659 4659245096 1.00
clickbench_q29/duckdb:duckdb 49443817 48404468 1.02
clickbench_q30/duckdb:duckdb 293968934 288307633 1.02
clickbench_q31/duckdb:duckdb 409376498 397535753 1.03
clickbench_q32/duckdb:duckdb 1394421684 1477314162 0.94
clickbench_q33/duckdb:duckdb 1809671478 2006885425 0.90
clickbench_q34/duckdb:duckdb 2031673278 1989093655 1.02
clickbench_q35/duckdb:duckdb 265562110 265292857 1.00
clickbench_q36/duckdb:duckdb 🚨 43294454 36875156 1.17
clickbench_q37/duckdb:duckdb 32316103 31125821 1.04
clickbench_q38/duckdb:duckdb 32545094 30295902 1.07
clickbench_q39/duckdb:duckdb 68562358 62534846 1.10
clickbench_q40/duckdb:duckdb 33615852 31666943 1.06
clickbench_q41/duckdb:duckdb 31775817 30241290 1.05
clickbench_q42/duckdb:duckdb 33198301 31186652 1.06
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-file-compressed +0.3% +18.1% -15.1% +518.3% ➖ noise
0 duckdb:duckdb +10.3% +18.1% -6.6% +261.4% ➖ noise
0 duckdb:vortex-file-compressed +23.2% +18.1% +4.3% +305.5% ➖ noise
1 datafusion:vortex-file-compressed -12.7% +7.0% -18.5% +33.4% ➖ noise
1 duckdb:duckdb +10.0% +7.0% +2.8% +56.5% ➖ noise
1 duckdb:vortex-file-compressed +1.7% +7.0% -5.0% +20.2% ➖ noise
2 datafusion:vortex-file-compressed +0.4% +5.7% -5.0% +36.4% ➖ noise
2 duckdb:duckdb +10.9% +5.7% +5.0% +21.6% ➖ noise
2 duckdb:vortex-file-compressed +1.9% +5.7% -3.6% +13.4% ➖ noise
3 datafusion:vortex-file-compressed -5.6% +4.4% -9.6% +173.0% ➖ noise
3 duckdb:duckdb +8.5% +4.4% +4.0% +51.9% ➖ noise
3 duckdb:vortex-file-compressed -6.8% +4.4% -10.7% +30.1% ➖ noise
4 datafusion:vortex-file-compressed -0.2% +3.2% -3.4% +13.4% ➖ noise
4 duckdb:duckdb +11.1% +3.2% +7.6% +13.4% ➖ noise
4 duckdb:vortex-file-compressed -0.7% +3.2% -3.8% +13.4% ➖ noise
5 datafusion:vortex-file-compressed -0.7% +8.2% -8.2% +13.4% ➖ noise
5 duckdb:duckdb +7.6% +8.2% -0.6% +13.4% ➖ noise
5 duckdb:vortex-file-compressed -0.2% +8.2% -7.8% +13.4% ➖ noise
6 datafusion:vortex-file-compressed +3.5% +16.1% -10.9% +44.4% ➖ noise
6 duckdb:duckdb +11.0% +16.1% -4.5% +27.6% ➖ noise
6 duckdb:vortex-file-compressed +2.2% +16.1% -12.0% +16.0% ➖ noise
7 datafusion:vortex-file-compressed +1.0% +11.2% -9.1% +13.4% ➖ noise
7 duckdb:duckdb +12.2% +11.2% +0.9% +13.4% ➖ noise
7 duckdb:vortex-file-compressed +16.4% +11.2% +4.6% +13.4% ➖ noise
8 datafusion:vortex-file-compressed +2.2% -1.3% +3.5% +13.4% ➖ noise
8 duckdb:duckdb +11.7% -1.3% +13.2% +13.4% ➖ noise
8 duckdb:vortex-file-compressed +1.3% -1.3% +2.7% +13.4% ➖ noise
9 datafusion:vortex-file-compressed +0.6% +3.8% -3.1% +13.4% ➖ noise
9 duckdb:duckdb +3.2% +3.8% -0.6% +13.4% ➖ noise
9 duckdb:vortex-file-compressed +0.5% +3.8% -3.2% +13.4% ➖ noise
10 datafusion:vortex-file-compressed +5.8% +11.9% -5.4% +13.4% ➖ noise
10 duckdb:duckdb +3.6% +11.9% -7.3% +13.4% ➖ noise
10 duckdb:vortex-file-compressed +1.2% +11.9% -9.6% +13.4% ➖ noise
11 datafusion:vortex-file-compressed +5.1% +9.3% -3.8% +13.4% ➖ noise
11 duckdb:duckdb +7.6% +9.3% -1.6% +13.4% ➖ noise
11 duckdb:vortex-file-compressed +0.8% +9.3% -7.8% +13.4% ➖ noise
12 datafusion:vortex-file-compressed +4.3% +12.5% -7.3% +13.4% ➖ noise
12 duckdb:duckdb +17.3% +12.5% +4.3% +13.4% ➖ noise
12 duckdb:vortex-file-compressed -1.0% +12.5% -12.0% +13.4% ✅ faster
13 datafusion:vortex-file-compressed +0.2% +18.1% -15.2% +13.4% ✅ faster
13 duckdb:duckdb +9.3% +18.1% -7.5% +13.4% ➖ noise
13 duckdb:vortex-file-compressed -4.1% +18.1% -18.8% +13.4% ✅ faster
14 datafusion:vortex-file-compressed +0.9% +16.3% -13.2% +13.4% ✅ faster
14 duckdb:duckdb +20.3% +16.3% +3.5% +13.4% ➖ noise
14 duckdb:vortex-file-compressed +0.6% +16.3% -13.5% +13.4% ✅ faster
15 datafusion:vortex-file-compressed +5.9% +9.9% -3.7% +13.4% ➖ noise
15 duckdb:duckdb +14.5% +9.9% +4.2% +13.4% ➖ noise
15 duckdb:vortex-file-compressed +0.7% +9.9% -8.3% +13.4% ➖ noise
16 datafusion:vortex-file-compressed +5.6% +5.5% +0.1% +13.4% ➖ noise
16 duckdb:duckdb +6.7% +5.5% +1.1% +13.4% ➖ noise
16 duckdb:vortex-file-compressed -6.2% +5.5% -11.1% +14.5% ➖ noise
17 datafusion:vortex-file-compressed +3.5% +7.0% -3.3% +13.4% ➖ noise
17 duckdb:duckdb +12.0% +7.0% +4.6% +13.4% ➖ noise
17 duckdb:vortex-file-compressed -4.8% +7.0% -11.0% +13.4% ➖ noise
18 datafusion:vortex-file-compressed +7.3% +6.2% +1.1% +13.4% ➖ noise
18 duckdb:duckdb +7.3% +6.2% +1.1% +13.4% ➖ noise
18 duckdb:vortex-file-compressed +1.7% +6.2% -4.3% +13.4% ➖ noise
19 datafusion:vortex-file-compressed +13.2% +3.8% +9.0% +91.8% ➖ noise
19 duckdb:duckdb +9.3% +3.8% +5.2% +13.4% ➖ noise
19 duckdb:vortex-file-compressed +3.0% +3.8% -0.8% +33.5% ➖ noise
20 datafusion:vortex-file-compressed +3.5% +5.7% -2.2% +167.5% ➖ noise
20 duckdb:duckdb +7.3% +5.7% +1.5% +21.2% ➖ noise
20 duckdb:vortex-file-compressed -2.8% +5.7% -8.1% +13.4% ➖ noise
21 datafusion:vortex-file-compressed +7.0% +5.7% +1.2% +13.4% ➖ noise
21 duckdb:duckdb +3.7% +5.7% -1.9% +18.7% ➖ noise
21 duckdb:vortex-file-compressed -0.3% +5.7% -5.7% +13.4% ➖ noise
22 datafusion:vortex-file-compressed +9.3% +5.1% +4.0% +13.4% ➖ noise
22 duckdb:duckdb -8.2% +5.1% -12.7% +15.2% ➖ noise
22 duckdb:vortex-file-compressed +0.9% +5.1% -4.0% +21.4% ➖ noise
23 datafusion:vortex-file-compressed +6.8% +6.3% +0.5% +37.8% ➖ noise
23 duckdb:duckdb +8.2% +6.3% +1.8% +13.4% ➖ noise
23 duckdb:vortex-file-compressed -35.8% +6.3% -39.6% +13.4% ✅ faster
24 datafusion:vortex-file-compressed +9.2% +3.7% +5.3% +20.4% ➖ noise
24 duckdb:duckdb +5.1% +3.7% +1.4% +13.4% ➖ noise
24 duckdb:vortex-file-compressed +11.9% +3.7% +7.9% +30.0% ➖ noise
25 datafusion:vortex-file-compressed +16.5% +3.1% +13.0% +14.1% ➖ noise
25 duckdb:duckdb +6.4% +3.1% +3.2% +13.4% ➖ noise
25 duckdb:vortex-file-compressed -2.1% +3.1% -5.1% +15.7% ➖ noise
26 datafusion:vortex-file-compressed +17.1% +3.8% +12.8% +16.9% ➖ noise
26 duckdb:duckdb +8.4% +3.8% +4.4% +13.4% ➖ noise
26 duckdb:vortex-file-compressed +16.3% +3.8% +12.0% +30.2% ➖ noise
27 datafusion:vortex-file-compressed +6.7% +4.1% +2.5% +13.4% ➖ noise
27 duckdb:duckdb -6.1% +4.1% -9.8% +13.8% ➖ noise
27 duckdb:vortex-file-compressed +1.4% +4.1% -2.6% +13.4% ➖ noise
28 datafusion:vortex-file-compressed +0.6% +4.0% -3.2% +13.4% ➖ noise
28 duckdb:duckdb +0.0% +4.0% -3.8% +13.4% ➖ noise
28 duckdb:vortex-file-compressed -0.0% +4.0% -3.8% +13.4% ➖ noise
29 datafusion:vortex-file-compressed -3.3% +0.1% -3.4% +13.4% ➖ noise
29 duckdb:duckdb +2.1% +0.1% +2.1% +13.4% ➖ noise
29 duckdb:vortex-file-compressed -3.6% +0.1% -3.6% +13.4% ➖ noise
30 datafusion:vortex-file-compressed +1.3% +1.3% -0.0% +13.4% ➖ noise
30 duckdb:duckdb +2.0% +1.3% +0.7% +13.4% ➖ noise
30 duckdb:vortex-file-compressed +5.3% +1.3% +3.9% +13.4% ➖ noise
31 datafusion:vortex-file-compressed +3.2% +0.8% +2.4% +13.4% ➖ noise
31 duckdb:duckdb +3.0% +0.8% +2.2% +13.4% ➖ noise
31 duckdb:vortex-file-compressed +1.7% +0.8% +1.0% +13.4% ➖ noise
32 datafusion:vortex-file-compressed +18.5% -0.8% +19.5% +14.4% 🚨 regression
32 duckdb:duckdb -5.6% -0.8% -4.8% +13.4% ➖ noise
32 duckdb:vortex-file-compressed +1.2% -0.8% +2.0% +13.4% ➖ noise
33 datafusion:vortex-file-compressed +17.2% +2.9% +13.8% +13.4% 🚨 regression
33 duckdb:duckdb -9.8% +2.9% -12.4% +16.0% ➖ noise
33 duckdb:vortex-file-compressed +2.8% +2.9% -0.1% +13.4% ➖ noise
34 datafusion:vortex-file-compressed +13.1% +2.9% +9.8% +13.4% ➖ noise
34 duckdb:duckdb +2.1% +2.9% -0.8% +13.4% ➖ noise
34 duckdb:vortex-file-compressed +2.0% +2.9% -0.9% +13.4% ➖ noise
35 datafusion:vortex-file-compressed +12.8% +0.1% +12.6% +13.4% ➖ noise
35 duckdb:duckdb +0.1% +0.1% -0.0% +13.4% ➖ noise
35 duckdb:vortex-file-compressed +0.2% +0.1% +0.0% +13.4% ➖ noise
36 datafusion:vortex-file-compressed +23.9% -0.0% +23.9% +13.4% 🚨 regression
36 duckdb:duckdb +17.4% -0.0% +17.4% +13.4% 🚨 regression
36 duckdb:vortex-file-compressed +4.4% -0.0% +4.4% +13.4% ➖ noise
37 datafusion:vortex-file-compressed +16.5% +2.2% +14.0% +13.4% 🚨 regression
37 duckdb:duckdb +3.8% +2.2% +1.6% +13.4% ➖ noise
37 duckdb:vortex-file-compressed +1.3% +2.2% -0.9% +13.4% ➖ noise
38 datafusion:vortex-file-compressed +10.6% +2.6% +7.8% +13.4% ➖ noise
38 duckdb:duckdb +7.4% +2.6% +4.7% +13.4% ➖ noise
38 duckdb:vortex-file-compressed +11.9% +2.6% +9.1% +13.4% ➖ noise
39 datafusion:vortex-file-compressed +11.5% -1.5% +13.2% +13.4% ➖ noise
39 duckdb:duckdb +9.6% -1.5% +11.4% +15.2% ➖ noise
39 duckdb:vortex-file-compressed +0.6% -1.5% +2.1% +13.4% ➖ noise
40 datafusion:vortex-file-compressed +18.4% -2.1% +20.9% +13.4% 🚨 regression
40 duckdb:duckdb +6.2% -2.1% +8.5% +13.4% ➖ noise
40 duckdb:vortex-file-compressed +10.4% -2.1% +12.8% +13.4% ➖ noise
41 datafusion:vortex-file-compressed +10.5% -0.5% +11.1% +13.4% ➖ noise
41 duckdb:duckdb +5.1% -0.5% +5.6% +13.4% ➖ noise
41 duckdb:vortex-file-compressed +2.8% -0.5% +3.3% +13.4% ➖ noise
42 datafusion:vortex-file-compressed +15.1% +1.6% +13.3% +13.4% ➖ noise
42 duckdb:duckdb +6.5% +1.6% +4.8% +13.4% ➖ noise
42 duckdb:vortex-file-compressed +14.4% +1.6% +12.7% +13.4% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Mar 27, 2026

Benchmarks: Compression

Vortex (geomean): 1.001x ➖
Parquet (geomean): 0.993x ➖


unknown / unknown (0.991x ➖, 0↑ 0↓)
name PR f04b111 (ns) base 60847b0 (ns) ratio (PR/base)
compress time/Arade 1148482229 1174501696 0.98
compress time/Bimbo 7183094067 7424881193 0.97
compress time/CMSprovider 3021601287 3055327705 0.99
compress time/Euro2016 412313335 442377962 0.93
compress time/Food 399076793 421473034 0.95
compress time/HashTags 937834596 964418023 0.97
compress time/TPC-H l_comment canonical 1323343716 1342713496 0.99
compress time/TPC-H l_comment chunked 1299256105 1359443787 0.96
compress time/taxi 730563307 754550182 0.97
compress time/wide table cols=100 chunks=1 rows=1000 15624571 16260537 0.96
compress time/wide table cols=100 chunks=50 rows=1000 16691234 16831074 0.99
compress time/wide table cols=1000 chunks=1 rows=1000 156953209 158330607 0.99
compress time/wide table cols=1000 chunks=50 rows=1000 157971009 159796538 0.99
compress time/wide table cols=10000 chunks=1 rows=1000 1530248462 1593383039 0.96
compress time/wide table cols=10000 chunks=50 rows=1000 1561231247 1600098101 0.98
decompress time/Arade 30702492 30723615 1.00
decompress time/Bimbo 103160455 100774095 1.02
decompress time/CMSprovider 86828925 85924958 1.01
decompress time/Euro2016 22211412 21944033 1.01
decompress time/Food 8595948 9071444 0.95
decompress time/HashTags 90370649 86324344 1.05
decompress time/TPC-H l_comment canonical 43884642 43049241 1.02
decompress time/TPC-H l_comment chunked 44153575 43288699 1.02
decompress time/taxi 20682828 19502437 1.06
decompress time/wide table cols=100 chunks=1 rows=1000 2613234 2690894 0.97
decompress time/wide table cols=100 chunks=50 rows=1000 2478537 2605991 0.95
decompress time/wide table cols=1000 chunks=1 rows=1000 23214937 23654088 0.98
decompress time/wide table cols=1000 chunks=50 rows=1000 23015103 24063811 0.96
decompress time/wide table cols=10000 chunks=1 rows=1000 234112647 248239983 0.94
decompress time/wide table cols=10000 chunks=50 rows=1000 235985968 243681011 0.97
parquet size/Arade 258014282 258014282 1.00
parquet size/Bimbo 384517292 384517292 1.00
parquet size/CMSprovider 376885545 376885545 1.00
parquet size/Euro2016 122975499 122975499 1.00
parquet size/Food 35699500 35699500 1.00
parquet size/HashTags 133510943 133510943 1.00
parquet size/TPC-H l_comment canonical 158358238 158358238 1.00
parquet size/TPC-H l_comment chunked 158358238 158358238 1.00
parquet size/taxi 55283635 55283635 1.00
parquet size/wide table cols=100 chunks=1 rows=1000 932404 932404 1.00
parquet size/wide table cols=100 chunks=50 rows=1000 932404 932404 1.00
parquet size/wide table cols=1000 chunks=1 rows=1000 9324004 9324004 1.00
parquet size/wide table cols=1000 chunks=50 rows=1000 9324004 9324004 1.00
parquet size/wide table cols=10000 chunks=1 rows=1000 93240004 93240004 1.00
parquet size/wide table cols=10000 chunks=50 rows=1000 93240004 93240004 1.00
parquet_rs-zstd compress time/Arade 3048697886 3095210539 0.98
parquet_rs-zstd compress time/Bimbo 17741472563 18065935906 0.98
parquet_rs-zstd compress time/CMSprovider 7804377755 8074909817 0.97
parquet_rs-zstd compress time/Euro2016 1356851584 1365423706 0.99
parquet_rs-zstd compress time/Food 940107539 963092046 0.98
parquet_rs-zstd compress time/HashTags 2485248398 2542529050 0.98
parquet_rs-zstd compress time/TPC-H l_comment canonical 3098516844 3115026070 0.99
parquet_rs-zstd compress time/TPC-H l_comment chunked 3078918340 3152281277 0.98
parquet_rs-zstd compress time/taxi 1536599726 1569133268 0.98
parquet_rs-zstd compress time/wide table cols=100 chunks=1 rows=1000 6718337 6938449 0.97
parquet_rs-zstd compress time/wide table cols=100 chunks=50 rows=1000 6802030 7022240 0.97
parquet_rs-zstd compress time/wide table cols=1000 chunks=1 rows=1000 88584606 92997548 0.95
parquet_rs-zstd compress time/wide table cols=1000 chunks=50 rows=1000 90300616 91999524 0.98
parquet_rs-zstd compress time/wide table cols=10000 chunks=1 rows=1000 941223111 994049302 0.95
parquet_rs-zstd compress time/wide table cols=10000 chunks=50 rows=1000 940566046 988922549 0.95
parquet_rs-zstd decompress time/Arade 649144518 657990723 0.99
parquet_rs-zstd decompress time/Bimbo 1784113882 1781361683 1.00
parquet_rs-zstd decompress time/CMSprovider 1934655599 1978372850 0.98
parquet_rs-zstd decompress time/Euro2016 392860725 388385191 1.01
parquet_rs-zstd decompress time/Food 222915027 224450516 0.99
parquet_rs-zstd decompress time/HashTags 628544739 647190651 0.97
parquet_rs-zstd decompress time/TPC-H l_comment canonical 567975790 571367300 0.99
parquet_rs-zstd decompress time/TPC-H l_comment chunked 561880669 577894824 0.97
parquet_rs-zstd decompress time/taxi 252582929 249238513 1.01
parquet_rs-zstd decompress time/wide table cols=100 chunks=1 rows=1000 2675579 2776027 0.96
parquet_rs-zstd decompress time/wide table cols=100 chunks=50 rows=1000 2751763 2787135 0.99
parquet_rs-zstd decompress time/wide table cols=1000 chunks=1 rows=1000 32012891 34365493 0.93
parquet_rs-zstd decompress time/wide table cols=1000 chunks=50 rows=1000 32954743 34634332 0.95
parquet_rs-zstd decompress time/wide table cols=10000 chunks=1 rows=1000 373259738 390565192 0.96
parquet_rs-zstd decompress time/wide table cols=10000 chunks=50 rows=1000 377492740 380044119 0.99
vortex-file-compressed size/Arade 143406520 143435604 1.00
vortex-file-compressed size/Bimbo 526731778 526882596 1.00
vortex-file-compressed size/CMSprovider 448346630 448399308 1.00
vortex-file-compressed size/Euro2016 164900396 164916900 1.00
vortex-file-compressed size/Food 44201364 44208064 1.00
vortex-file-compressed size/HashTags 195372532 195421908 1.00
vortex-file-compressed size/TPC-H l_comment canonical 179447489 179481808 1.00
vortex-file-compressed size/TPC-H l_comment chunked 179447489 179481808 1.00
vortex-file-compressed size/taxi 51520627 51543292 1.00
vortex-file-compressed size/wide table cols=100 chunks=1 rows=1000 875460 884384 0.99
vortex-file-compressed size/wide table cols=100 chunks=50 rows=1000 875460 884384 0.99
vortex-file-compressed size/wide table cols=1000 chunks=1 rows=1000 8741460 8829584 0.99
vortex-file-compressed size/wide table cols=1000 chunks=50 rows=1000 8741460 8829584 0.99
vortex-file-compressed size/wide table cols=10000 chunks=1 rows=1000 87437460 88317584 0.99
vortex-file-compressed size/wide table cols=10000 chunks=50 rows=1000 87437460 88317584 0.99
vortex:parquet-zstd ratio compress time/Arade 0 0 0.99
vortex:parquet-zstd ratio compress time/Bimbo 0 0 0.99
vortex:parquet-zstd ratio compress time/CMSprovider 0 0 1.02
vortex:parquet-zstd ratio compress time/Euro2016 0 0 0.94
vortex:parquet-zstd ratio compress time/Food 0 0 0.97
vortex:parquet-zstd ratio compress time/HashTags 0 0 0.99
vortex:parquet-zstd ratio compress time/TPC-H l_comment canonical 0 0 0.99
vortex:parquet-zstd ratio compress time/TPC-H l_comment chunked 0 0 0.98
vortex:parquet-zstd ratio compress time/taxi 0 0 0.99
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=1 rows=1000 2 2 0.99
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=50 rows=1000 2 2 1.02
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=1 rows=1000 1 1 1.04
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=50 rows=1000 1 1 1.01
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=1 rows=1000 1 1 1.01
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=50 rows=1000 1 1 1.03
vortex:parquet-zstd ratio decompress time/Arade 0 0 1.01
vortex:parquet-zstd ratio decompress time/Bimbo 0 0 1.02
vortex:parquet-zstd ratio decompress time/CMSprovider 0 0 1.03
vortex:parquet-zstd ratio decompress time/Euro2016 0 0 1.00
vortex:parquet-zstd ratio decompress time/Food 0 0 0.95
vortex:parquet-zstd ratio decompress time/HashTags 0 0 1.08
vortex:parquet-zstd ratio decompress time/TPC-H l_comment canonical 0 0 1.03
vortex:parquet-zstd ratio decompress time/TPC-H l_comment chunked 0 0 1.05
vortex:parquet-zstd ratio decompress time/taxi 0 0 1.05
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=1 rows=1000 0 0 1.01
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=50 rows=1000 0 0 0.96
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=1 rows=1000 0 0 1.05
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=50 rows=1000 0 0 1.01
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=1 rows=1000 0 0 0.99
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=50 rows=1000 0 0 0.97
vortex:parquet-zstd size/Arade 0 0 1.00
vortex:parquet-zstd size/Bimbo 1 1 1.00
vortex:parquet-zstd size/CMSprovider 1 1 1.00
vortex:parquet-zstd size/Euro2016 1 1 1.00
vortex:parquet-zstd size/Food 1 1 1.00
vortex:parquet-zstd size/HashTags 1 1 1.00
vortex:parquet-zstd size/TPC-H l_comment canonical 1 1 1.00
vortex:parquet-zstd size/TPC-H l_comment chunked 1 1 1.00
vortex:parquet-zstd size/taxi 0 0 1.00
vortex:parquet-zstd size/wide table cols=100 chunks=1 rows=1000 0 0 0.99
vortex:parquet-zstd size/wide table cols=100 chunks=50 rows=1000 0 0 0.99
vortex:parquet-zstd size/wide table cols=1000 chunks=1 rows=1000 0 0 0.99
vortex:parquet-zstd size/wide table cols=1000 chunks=50 rows=1000 0 0 0.99
vortex:parquet-zstd size/wide table cols=10000 chunks=1 rows=1000 0 0 0.99
vortex:parquet-zstd size/wide table cols=10000 chunks=50 rows=1000 0 0 0.99

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

changelog/performance A performance improvement

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant