Use mimalloc with purging disabled in each e2e benchmark binary by joseph-isaacs · Pull Request #10490 · vortex-data/vortex

joseph-isaacs · 2026-10-14T13:19:29Z

Summary

The end-to-end benchmark binaries (SQL via DataFusion and DuckDB, random access, compression, string, Lance) only ran with mimalloc implicitly, through a #[global_allocator] declared in the vortex-bench library. This makes the choice explicit in each benchmark binary, and stops mimalloc from purging freed memory back to the OS during a run: mimalloc v3 purges 1s after a free, and that work lands in the middle of measured queries.

Changes

Declare #[global_allocator] static GLOBAL: MiMalloc = MiMalloc; in the main.rs of compress-bench, datafusion-bench, duckdb-bench, lance-bench, random-access-bench, string-bench, and in vortex-bench's data-gen binary.
Remove the global allocator from vortex-bench/src/lib.rs, so the library no longer picks the allocator for whatever links it.
Add vortex_bench::configure_allocator(), which sets mimalloc's purge_delay option to -1 (never purge), and call it first thing in each of those binaries. This uses libmimalloc-sys with its extended feature (adds cty to the lockfile).
Add mimalloc to each benchmark crate's dependencies and update Cargo.lock.

Checks: cargo clippy --locked --bins -D warnings for vortex-bench, compress-bench, random-access-bench, string-bench and datafusion-bench; formatted with the pinned nightly rustfmt. duckdb-bench and lance-bench could not be built locally (DuckDB source download and the lance-encoding build script fail in this environment), so CI covers them.

🤖 Generated with Claude Code

https://claude.ai/code/session_0122rGn9fTSV47KLv191MTHB

The SQL, random-access, compress, string and lance benchmark binaries picked up mimalloc only implicitly, through a #[global_allocator] declared in the vortex-bench library. Declare it explicitly in each benchmark binary's main (and in data-gen) instead, and drop it from the library so a library never chooses the allocator for its users. Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk> Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_0122rGn9fTSV47KLv191MTHB

codspeed · 2026-10-14T13:26:03Z

Merging this PR will degrade performance by 23.15%

⚠️

Unknown Walltime execution environment detected

Using the Walltime instrument on standard Hosted Runners will lead to inconsistent data.

For the most accurate results, we recommend using CodSpeed Macro Runners: bare-metal machines fine-tuned for performance measurement consistency.

⚠️

1 benchmark measured no execution time

Nothing ran under measurement, usually because the compiler removed the code under test. This result is not comparable, so it counts as unchanged.

Preventing compiler optimizations

bench_compare_primitive[(10000, 2)]

⚠️

10 benchmarks spent significant time in system calls

System calls cannot be consistently instrumented, so they are not included in the measure, which understates the real cost. Please switch to the Walltime instrument to accurately measure system calls.

Measurement and system calls

random_i128[0.01]

take_varbin

decompress[u16, (4000, 256)]

decompress[u32, (1000, 256)]

multipolygon_mixed_validity

pcodec_compress_f64

filter_run_end[len=4096_run=16_density=0.1]

zstd_compress_string

from_vec_drop_vortex[65536]

bench_compare_primitive[(10000, 2)]

⚠️

Different runtime environments detected

Some benchmarks with significant performance changes were compared across different runtime environments,
which may affect the accuracy of the results.

Open the report in CodSpeed to investigate

⚡ 1 improved benchmark
❌ 7 regressed benchmarks
✅ 2211 untouched benchmarks

Warning

Please fix the performance issues or acknowledge them on CodSpeed.

Performance Changes

	Mode	Benchmark	`BASE`	`HEAD`	Efficiency
❌	WallTime	`filter_neon[64]`	2.7 µs	5.2 µs	-47.71%
❌	WallTime	`filter_neon[8]`	1 µs	1.6 µs	-35.73%
❌	Simulation	`decode_primitives[i64, (1000, 32)]`	25.1 µs	38.6 µs	-35.04%
❌	WallTime	`filter_neon[80]`	2.9 µs	3.9 µs	-24.51%
❌	WallTime	`threshold_neon[8]`	2.9 µs	3.4 µs	-15.33%
❌	WallTime	`threshold_neon[64]`	4.3 µs	5 µs	-12.62%
❌	WallTime	`threshold_neon[80]`	4.8 µs	5.4 µs	-11.27%
⚡	WallTime	`bitpack_blocked_compress_avx2`	7.6 µs	6.7 µs	+12.44%

Tip

Investigate this regression by commenting @codspeedbot fix this regression on this PR, or directly use the CodSpeed MCP with your agent.

_{Comparing ji/e2e-bench-mimalloc (a209097) with develop (1d1161f)}

github-actions · 2026-10-14T13:26:10Z

Polar Signals Profiling Results

Latest Run

Status	Commit	Job	Attempt	Link
🟢 Done	`85e620b`	statpopgen	2	Explore Profiling Data
🟢 Done	`85e620b`	clickbench-sorted-nvme	2	Explore Profiling Data
🟢 Done	`85e620b`	tpch-nvme-10	2	Explore Profiling Data
🟢 Done	`85e620b`	tpch-s3-10	2	Explore Profiling Data
🟢 Done	`85e620b`	tpcds-nvme	2	Explore Profiling Data
🟢 Done	`85e620b`	clickbench-nvme	2	Explore Profiling Data
🟢 Done	`85e620b`	fineweb-s3	2	Explore Profiling Data
🟢 Done	`85e620b`	appian-nvme	2	Explore Profiling Data
🟢 Done	`85e620b`	polarsignals	2	Explore Profiling Data
🟢 Done	`85e620b`	tpch-s3	2	Explore Profiling Data
🟢 Done	`85e620b`	tpch-nvme	2	Explore Profiling Data
🟢 Done	`85e620b`	fineweb	2	Explore Profiling Data
🟢 Done	`85e620b`	random-access-bench	1	Explore Profiling Data
🟢 Done	`85e620b`	compress-bench	1	Explore Profiling Data
🟢 Done	`85e620b`	string-bench	1	Explore Profiling Data

Previous Runs (15)

Status	Commit	Job	Attempt	Link
🟢 Done	`917b7f9`	random-access-bench	1	Explore Profiling Data
🟢 Done	`917b7f9`	compress-bench	1	Explore Profiling Data
🟢 Done	`917b7f9`	string-bench	1	Explore Profiling Data
🟢 Done	`917b7f9`	statpopgen	1	Explore Profiling Data
🟢 Done	`917b7f9`	tpch-nvme-10	1	Explore Profiling Data
🟢 Done	`917b7f9`	clickbench-sorted-nvme	1	Explore Profiling Data
🟢 Done	`917b7f9`	tpch-s3-10	1	Explore Profiling Data
🟢 Done	`917b7f9`	tpcds-nvme	1	Explore Profiling Data
🟢 Done	`917b7f9`	clickbench-nvme	1	Explore Profiling Data
🟢 Done	`917b7f9`	fineweb-s3	1	Explore Profiling Data
🟢 Done	`917b7f9`	appian-nvme	1	Explore Profiling Data
🟢 Done	`917b7f9`	polarsignals	1	Explore Profiling Data
🟢 Done	`917b7f9`	tpch-s3	1	Explore Profiling Data
🟢 Done	`917b7f9`	tpch-nvme	1	Explore Profiling Data
🟢 Done	`917b7f9`	fineweb	1	Explore Profiling Data

Powered by Polar Signals Cloud

github-actions · 2026-10-14T13:27:26Z

Benchmarks: PolarSignals Profiling 📖

Commits: PR 85e620b1 vs base 73192765
Vortex (geomean): hot 1.001x ➖ · cold 0.933x ➖

datafusion / vortex-file-compressed / ns (1.001x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
polarsignals_q00/datafusion:vortex-file-compressed	45261978 / 45326606 / -0.1%	94246285 / 99254397 / -5.0%	0.48 / 0.46 / +5.2%
polarsignals_q01/datafusion:vortex-file-compressed	51326734 / 51145099 / +0.4%	119612496 / 122855384 / -2.6%	0.43 / 0.42 / +3.1%
polarsignals_q02/datafusion:vortex-file-compressed	46432513 / 48604652 / -4.5%	91319902 / 93789207 / -2.6%	0.51 / 0.52 / -1.9%
polarsignals_q03/datafusion:vortex-file-compressed	55292504 / 55194309 / +0.2%	118607493 / 125671619 / -5.6%	0.47 / 0.44 / +6.1%
polarsignals_q04/datafusion:vortex-file-compressed	9667994 / 9535238 / +1.4%	50641092 / 56780029 / -10.8% 🟢	0.19 / 0.17 / +13.7%
polarsignals_q05/datafusion:vortex-file-compressed	12422710 / 12037956 / +3.2%	58996954 / 61792774 / -4.5%	0.21 / 0.19 / +8.1%
polarsignals_q06/datafusion:vortex-file-compressed	23442081 / 23558093 / -0.5%	64486879 / 71220634 / -9.5%	0.36 / 0.33 / +9.9%
polarsignals_q07/datafusion:vortex-file-compressed	11463224 / 11589920 / -1.1%	53670473 / 59650779 / -10.0% 🟢	0.21 / 0.19 / +9.9%
polarsignals_q08/datafusion:vortex-file-compressed	98435042 / 98113650 / +0.3%	165284200 / 169518490 / -2.5%	0.60 / 0.58 / +2.9%
polarsignals_q09/datafusion:vortex-file-compressed	10394362 / 10204778 / +1.9%	50637823 / 58030972 / -12.7% 🟢	0.21 / 0.18 / +16.7%

No file size changes detected.

github-actions · 2026-10-14T13:27:56Z

Benchmarks: FineWeb NVMe 📖

Commits: PR 85e620b1 vs base 73192765
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +1.5%
Engines: DataFusion No clear signal (-1.3%, low confidence) · DuckDB No clear signal (+4.3%, low confidence)
Vortex (geomean): hot 1.011x ➖ · cold 1.006x ➖
Parquet (geomean): hot 0.996x ➖ · cold 1.027x ➖
Shifts: Parquet (control) -0.4% · Median polish -0.0%

How to read Verdict and Engines

Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.984x ➖, 1↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-file-compressed	6948886 / 6812529 / +2.0%	18673586 / 19520750 / -4.3%	0.37 / 0.35 / +6.6%
fineweb_q01/datafusion:vortex-file-compressed	12055650 / 12619319 / -4.5%	47312190 / 51883528 / -8.8%	0.25 / 0.24 / +4.8%
fineweb_q02/datafusion:vortex-file-compressed	13809844 / 14194671 / -2.7%	50728908 / 58813712 / -13.7% 🟢	0.27 / 0.24 / +12.8%
fineweb_q03/datafusion:vortex-file-compressed	23745990 / 21862148 / +8.6%	113652987 / 112186131 / +1.3%	0.21 / 0.19 / +7.2%
fineweb_q04/datafusion:vortex-file-compressed	84183962 / 82406764 / +2.2%	168848648 / 175731535 / -3.9%	0.50 / 0.47 / +6.3%
fineweb_q05/datafusion:vortex-file-compressed	67589484 / 68618996 / -1.5%	157739146 / 155767967 / +1.3%	0.43 / 0.44 / -2.7%
fineweb_q06/datafusion:vortex-file-compressed	19972559 / 20790664 / -3.9%	112460313 / 109415351 / +2.8%	0.18 / 0.19 / -6.5%
fineweb_q07/datafusion:vortex-file-compressed	19620791 / 19142155 / +2.5%	110349892 / 114417987 / -3.6%	0.18 / 0.17 / +6.3%
fineweb_q08/datafusion:vortex-file-compressed	10302220 / 12195532 / -15.5% 🟢	43852945 / 51318572 / -14.5% 🟢	0.23 / 0.24 / -1.1%

datafusion / vortex-compact / ns (0.980x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-compact	6896131 / 6932954 / -0.5%	18908284 / 19181912 / -1.4%	0.36 / 0.36 / +0.9%
fineweb_q01/datafusion:vortex-compact	44465170 / 44187998 / +0.6%	111018544 / 82338125 / +34.8% 🔴	0.40 / 0.54 / -25.4%
fineweb_q02/datafusion:vortex-compact	44019529 / 45219005 / -2.7%	109175193 / 113453116 / -3.8%	0.40 / 0.40 / +1.2%
fineweb_q03/datafusion:vortex-compact	156686681 / 156316006 / +0.2%	230404478 / 233884604 / -1.5%	0.68 / 0.67 / +1.8%
fineweb_q04/datafusion:vortex-compact	178866838 / 193603458 / -7.6%	244701821 / 247782643 / -1.2%	0.73 / 0.78 / -6.4%
fineweb_q05/datafusion:vortex-compact	154800172 / 158077963 / -2.1%	241977417 / 233316792 / +3.7%	0.64 / 0.68 / -5.6%
fineweb_q06/datafusion:vortex-compact	87700838 / 86087579 / +1.9%	164771130 / 168684077 / -2.3%	0.53 / 0.51 / +4.3%
fineweb_q07/datafusion:vortex-compact	87833442 / 88105978 / -0.3%	159184489 / 163066827 / -2.4%	0.55 / 0.54 / +2.1%
fineweb_q08/datafusion:vortex-compact	8423290 / 9090854 / -7.3%	47386963 / 50592338 / -6.3%	0.18 / 0.18 / -1.1%

datafusion / parquet / ns (0.995x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
fineweb_q00/datafusion:parquet	9351224 / 9651590 / -3.1%	34509420 / 34234643 / +0.8%	0.27 / 0.28 / -3.9%
fineweb_q01/datafusion:parquet	74555700 / 74667591 / -0.1%	160813320 / 151643643 / +6.0%	0.46 / 0.49 / -5.8%
fineweb_q02/datafusion:parquet	76216842 / 75046699 / +1.6%	162915329 / 162614415 / +0.2%	0.47 / 0.46 / +1.4%
fineweb_q03/datafusion:parquet	73674458 / 73847094 / -0.2%	159218195 / 156348771 / +1.8%	0.46 / 0.47 / -2.0%
fineweb_q04/datafusion:parquet	81463446 / 82658926 / -1.4%	158359134 / 166044448 / -4.6%	0.51 / 0.50 / +3.3%
fineweb_q05/datafusion:parquet	80380888 / 81059558 / -0.8%	168373780 / 155597357 / +8.2%	0.48 / 0.52 / -8.4%
fineweb_q06/datafusion:parquet	76418271 / 75158142 / +1.7%	166631869 / 156369575 / +6.6%	0.46 / 0.48 / -4.6%
fineweb_q07/datafusion:parquet	73310698 / 74869982 / -2.1%	172823180 / 154902174 / +11.6% 🔴	0.42 / 0.48 / -12.2%
fineweb_q08/datafusion:parquet	74036690 / 74075384 / -0.1%	166506918 / 152929520 / +8.9%	0.44 / 0.48 / -8.2%

duckdb / vortex-file-compressed / ns (1.029x ➖, 3↑ 3↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-file-compressed	3106075 / 1804288 / +72.1% 🔴	7233414 / 4695570 / +54.0% 🔴	0.43 / 0.38 / +11.8%
fineweb_q01/duckdb:vortex-file-compressed	18578675 / 19456394 / -4.5%	57410453 / 51607485 / +11.2% 🔴	0.32 / 0.38 / -14.2%
fineweb_q02/duckdb:vortex-file-compressed	19355990 / 18505947 / +4.6%	55306474 / 61190313 / -9.6%	0.35 / 0.30 / +15.7%
fineweb_q03/duckdb:vortex-file-compressed	31863187 / 25734454 / +23.8% 🔴	128336922 / 96225927 / +33.4% 🔴	0.25 / 0.27 / -7.2%
fineweb_q04/duckdb:vortex-file-compressed	79058170 / 79794582 / -0.9%	121465305 / 141706776 / -14.3% 🟢	0.65 / 0.56 / +15.6%
fineweb_q05/duckdb:vortex-file-compressed	67655468 / 82499892 / -18.0% 🟢	128096316 / 166962866 / -23.3% 🟢	0.53 / 0.49 / +6.9%
fineweb_q06/duckdb:vortex-file-compressed	39900012 / 51374538 / -22.3% 🟢	125306226 / 168623586 / -25.7% 🟢	0.32 / 0.30 / +4.5%
fineweb_q07/duckdb:vortex-file-compressed	30574983 / 37220523 / -17.9% 🟢	162910544 / 129513553 / +25.8% 🔴	0.19 / 0.29 / -34.7%
fineweb_q08/duckdb:vortex-file-compressed	7206156 / 6121708 / +17.7% 🔴	14895059 / 21077628 / -29.3% 🟢	0.48 / 0.29 / +66.6%

duckdb / vortex-compact / ns (1.054x ➖, 1↑ 3↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-compact	2447308 / 1971491 / +24.1% 🔴	5059871 / 7354467 / -31.2% 🟢	0.48 / 0.27 / +80.4%
fineweb_q01/duckdb:vortex-compact	54176090 / 48102182 / +12.6% 🔴	105148298 / 96686817 / +8.8%	0.52 / 0.50 / +3.6%
fineweb_q02/duckdb:vortex-compact	48553438 / 45296520 / +7.2%	128230491 / 66932841 / +91.6% 🔴	0.38 / 0.68 / -44.0%
fineweb_q03/duckdb:vortex-compact	183291708 / 186598707 / -1.8%	282028033 / 313186116 / -9.9%	0.65 / 0.60 / +9.1%
fineweb_q04/duckdb:vortex-compact	205321760 / 189139580 / +8.6%	309006198 / 218251560 / +41.6% 🔴	0.66 / 0.87 / -23.3%
fineweb_q05/duckdb:vortex-compact	178392562 / 178708784 / -0.2%	213982517 / 263236763 / -18.7% 🟢	0.83 / 0.68 / +22.8%
fineweb_q06/duckdb:vortex-compact	108828769 / 94701729 / +14.9% 🔴	195889367 / 145891974 / +34.3% 🔴	0.56 / 0.65 / -14.4%
fineweb_q07/duckdb:vortex-compact	100103542 / 101217526 / -1.1%	151142061 / 173254785 / -12.8% 🟢	0.66 / 0.58 / +13.4%
fineweb_q08/duckdb:vortex-compact	6863608 / 7748918 / -11.4% 🟢	13707654 / 12536394 / +9.3%	0.50 / 0.62 / -19.0%

duckdb / parquet / ns (0.998x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
fineweb_q00/duckdb:parquet	23362690 / 23403716 / -0.2%	26379823 / 22818728 / +15.6% 🔴	0.89 / 1.03 / -13.7%
fineweb_q01/duckdb:parquet	44374970 / 44345942 / +0.1%	57249608 / 55552264 / +3.1%	0.78 / 0.80 / -2.9%
fineweb_q02/duckdb:parquet	43737270 / 43672122 / +0.1%	55973474 / 55315519 / +1.2%	0.78 / 0.79 / -1.0%
fineweb_q03/duckdb:parquet	95509242 / 94837885 / +0.7%	183769367 / 191665070 / -4.1%	0.52 / 0.49 / +5.0%
fineweb_q04/duckdb:parquet	151985184 / 152855122 / -0.6%	195407968 / 213629525 / -8.5%	0.78 / 0.72 / +8.7%
fineweb_q05/duckdb:parquet	144604893 / 147883182 / -2.2%	199420339 / 194571181 / +2.5%	0.73 / 0.76 / -4.6%
fineweb_q06/duckdb:parquet	71501212 / 71349989 / +0.2%	133336440 / 130965717 / +1.8%	0.54 / 0.54 / -1.6%
fineweb_q07/duckdb:parquet	72188387 / 72071392 / +0.2%	155781809 / 149338675 / +4.3%	0.46 / 0.48 / -4.0%
fineweb_q08/duckdb:parquet	22474601 / 22436154 / +0.2%	24228188 / 25205092 / -3.9%	0.93 / 0.89 / +4.2%

No file size changes detected.

github-actions · 2026-10-14T13:29:05Z

Benchmarks: TPC-H SF=1 on NVME 📖

Commits: PR 85e620b1 vs base 73192765
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.2%
Engines: DataFusion No clear signal (-0.6%, low confidence) · DuckDB No clear signal (+0.3%, low confidence)
Vortex (geomean): hot 0.999x ➖ · cold 0.974x ➖
Parquet (geomean): hot 1.001x ➖ · cold 0.981x ➖
Shifts: Parquet (control) +0.1% · Median polish -0.3%

How to read Verdict and Engines

Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.992x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed	15735877 / 16143299 / -2.5%	43712197 / 42772206 / +2.2%	0.36 / 0.38 / -4.6%
tpch_q02/datafusion:vortex-file-compressed	17302719 / 17300279 / +0.0%	36414865 / 36472221 / -0.2%	0.48 / 0.47 / +0.2%
tpch_q03/datafusion:vortex-file-compressed	19318232 / 19480800 / -0.8%	49112335 / 49398968 / -0.6%	0.39 / 0.39 / -0.3%
tpch_q04/datafusion:vortex-file-compressed	10090144 / 10076448 / +0.1%	32967424 / 33728993 / -2.3%	0.31 / 0.30 / +2.4%
tpch_q05/datafusion:vortex-file-compressed	37078290 / 36941000 / +0.4%	63000039 / 67030274 / -6.0%	0.59 / 0.55 / +6.8%
tpch_q06/datafusion:vortex-file-compressed	6392454 / 6437103 / -0.7%	28432035 / 29804729 / -4.6%	0.22 / 0.22 / +4.1%
tpch_q07/datafusion:vortex-file-compressed	51950477 / 51980073 / -0.1%	78543080 / 82113688 / -4.3%	0.66 / 0.63 / +4.5%
tpch_q08/datafusion:vortex-file-compressed	52092554 / 52397458 / -0.6%	78794432 / 83097350 / -5.2%	0.66 / 0.63 / +4.8%
tpch_q09/datafusion:vortex-file-compressed	49728499 / 50266682 / -1.1%	76530317 / 76081308 / +0.6%	0.65 / 0.66 / -1.7%
tpch_q10/datafusion:vortex-file-compressed	17667268 / 17721709 / -0.3%	49245044 / 51383261 / -4.2%	0.36 / 0.34 / +4.0%
tpch_q11/datafusion:vortex-file-compressed	14931680 / 15065536 / -0.9%	34139752 / 34966507 / -2.4%	0.44 / 0.43 / +1.5%
tpch_q12/datafusion:vortex-file-compressed	22970603 / 23205641 / -1.0%	45709298 / 48506689 / -5.8%	0.50 / 0.48 / +5.0%
tpch_q13/datafusion:vortex-file-compressed	19673020 / 19991318 / -1.6%	39012589 / 40037362 / -2.6%	0.50 / 0.50 / +1.0%
tpch_q14/datafusion:vortex-file-compressed	14946825 / 15429595 / -3.1%	39619509 / 41617285 / -4.8%	0.38 / 0.37 / +1.8%
tpch_q15/datafusion:vortex-file-compressed	18500353 / 18824977 / -1.7%	43588183 / 45126789 / -3.4%	0.42 / 0.42 / +1.7%
tpch_q16/datafusion:vortex-file-compressed	18537454 / 18800129 / -1.4%	37625638 / 39581705 / -4.9%	0.49 / 0.47 / +3.7%
tpch_q17/datafusion:vortex-file-compressed	27965642 / 28593965 / -2.2%	57338710 / 56709109 / +1.1%	0.49 / 0.50 / -3.3%
tpch_q18/datafusion:vortex-file-compressed	36297551 / 36632436 / -0.9%	57566609 / 57416679 / +0.3%	0.63 / 0.64 / -1.2%
tpch_q19/datafusion:vortex-file-compressed	14910019 / 14549001 / +2.5%	37884503 / 42339903 / -10.5% 🟢	0.39 / 0.34 / +14.5%
tpch_q20/datafusion:vortex-file-compressed	20966232 / 20846272 / +0.6%	42778179 / 44558139 / -4.0%	0.49 / 0.47 / +4.8%
tpch_q21/datafusion:vortex-file-compressed	39017830 / 39624317 / -1.5%	66471729 / 70205625 / -5.3%	0.59 / 0.56 / +4.0%
tpch_q22/datafusion:vortex-file-compressed	11872112 / 11905324 / -0.3%	32312939 / 34069954 / -5.2%	0.37 / 0.35 / +5.1%

datafusion / vortex-compact / ns (0.991x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-compact	17004305 / 17224005 / -1.3%	41596663 / 41716578 / -0.3%	0.41 / 0.41 / -1.0%
tpch_q02/datafusion:vortex-compact	20135292 / 20303778 / -0.8%	36435331 / 38133457 / -4.5%	0.55 / 0.53 / +3.8%
tpch_q03/datafusion:vortex-compact	19806264 / 20099511 / -1.5%	45883074 / 49577859 / -7.5%	0.43 / 0.41 / +6.5%
tpch_q04/datafusion:vortex-compact	10497379 / 10948265 / -4.1%	32147002 / 34717203 / -7.4%	0.33 / 0.32 / +3.5%
tpch_q05/datafusion:vortex-compact	38044610 / 38078855 / -0.1%	62918664 / 62931510 / -0.0%	0.60 / 0.61 / -0.1%
tpch_q06/datafusion:vortex-compact	6960809 / 7176452 / -3.0%	27356078 / 30410701 / -10.0% 🟢	0.25 / 0.24 / +7.8%
tpch_q07/datafusion:vortex-compact	52449204 / 52457853 / -0.0%	76985492 / 79343020 / -3.0%	0.68 / 0.66 / +3.0%
tpch_q08/datafusion:vortex-compact	52311466 / 53648415 / -2.5%	81457820 / 85949389 / -5.2%	0.64 / 0.62 / +2.9%
tpch_q09/datafusion:vortex-compact	50270925 / 50843070 / -1.1%	77254072 / 79924216 / -3.3%	0.65 / 0.64 / +2.3%
tpch_q10/datafusion:vortex-compact	20601173 / 20439508 / +0.8%	49769051 / 51709548 / -3.8%	0.41 / 0.40 / +4.7%
tpch_q11/datafusion:vortex-compact	16113592 / 15993844 / +0.7%	35125257 / 36154709 / -2.8%	0.46 / 0.44 / +3.7%
tpch_q12/datafusion:vortex-compact	23938741 / 24148888 / -0.9%	45805486 / 46618728 / -1.7%	0.52 / 0.52 / +0.9%
tpch_q13/datafusion:vortex-compact	20012213 / 20712642 / -3.4%	38780142 / 40387422 / -4.0%	0.52 / 0.51 / +0.6%
tpch_q14/datafusion:vortex-compact	16201953 / 16586695 / -2.3%	39281532 / 41801717 / -6.0%	0.41 / 0.40 / +3.9%
tpch_q15/datafusion:vortex-compact	20057735 / 20137735 / -0.4%	47231975 / 48322330 / -2.3%	0.42 / 0.42 / +1.9%
tpch_q16/datafusion:vortex-compact	19689456 / 19230135 / +2.4%	38462376 / 39408198 / -2.4%	0.51 / 0.49 / +4.9%
tpch_q17/datafusion:vortex-compact	28533358 / 28935282 / -1.4%	56218306 / 57213521 / -1.7%	0.51 / 0.51 / +0.4%
tpch_q18/datafusion:vortex-compact	37048207 / 37626707 / -1.5%	56504586 / 56270703 / +0.4%	0.66 / 0.67 / -1.9%
tpch_q19/datafusion:vortex-compact	17920690 / 17899370 / +0.1%	42893125 / 46106025 / -7.0%	0.42 / 0.39 / +7.6%
tpch_q20/datafusion:vortex-compact	22174266 / 22001197 / +0.8%	44587704 / 45557823 / -2.1%	0.50 / 0.48 / +3.0%
tpch_q21/datafusion:vortex-compact	40737292 / 40993618 / -0.6%	67917990 / 66899469 / +1.5%	0.60 / 0.61 / -2.1%
tpch_q22/datafusion:vortex-compact	14303495 / 14251870 / +0.4%	32562092 / 35339967 / -7.9%	0.44 / 0.40 / +8.9%

datafusion / parquet / ns (0.998x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet	71804036 / 71887895 / -0.1%	88004633 / 90770583 / -3.0%	0.82 / 0.79 / +3.0%
tpch_q02/datafusion:parquet	57688812 / 56874048 / +1.4%	76596176 / 77651128 / -1.4%	0.75 / 0.73 / +2.8%
tpch_q03/datafusion:parquet	84409411 / 83891376 / +0.6%	107696053 / 110995989 / -3.0%	0.78 / 0.76 / +3.7%
tpch_q04/datafusion:parquet	46776254 / 47043855 / -0.6%	63925223 / 66425726 / -3.8%	0.73 / 0.71 / +3.3%
tpch_q05/datafusion:parquet	99395505 / 99562736 / -0.2%	125531875 / 129544818 / -3.1%	0.79 / 0.77 / +3.0%
tpch_q06/datafusion:parquet	31866485 / 31747026 / +0.4%	49750737 / 51021354 / -2.5%	0.64 / 0.62 / +2.9%
tpch_q07/datafusion:parquet	104424066 / 108009673 / -3.3%	133532774 / 134971720 / -1.1%	0.78 / 0.80 / -2.3%
tpch_q08/datafusion:parquet	113408260 / 113080187 / +0.3%	134379130 / 143488640 / -6.3%	0.84 / 0.79 / +7.1%
tpch_q09/datafusion:parquet	130058262 / 130056947 / +0.0%	160116494 / 163826777 / -2.3%	0.81 / 0.79 / +2.3%
tpch_q10/datafusion:parquet	103878620 / 104261233 / -0.4%	130932254 / 134757372 / -2.8%	0.79 / 0.77 / +2.5%
tpch_q11/datafusion:parquet	42352467 / 42421218 / -0.2%	64130144 / 64514817 / -0.6%	0.66 / 0.66 / +0.4%
tpch_q12/datafusion:parquet	69057625 / 68994877 / +0.1%	94707972 / 95184915 / -0.5%	0.73 / 0.72 / +0.6%
tpch_q13/datafusion:parquet	186704811 / 186951418 / -0.1%	208211164 / 210740752 / -1.2%	0.90 / 0.89 / +1.1%
tpch_q14/datafusion:parquet	47987233 / 47898621 / +0.2%	73365257 / 77739115 / -5.6%	0.65 / 0.62 / +6.2%
tpch_q15/datafusion:parquet	55062769 / 54492941 / +1.0%	74092783 / 77005429 / -3.8%	0.74 / 0.71 / +5.0%
tpch_q16/datafusion:parquet	40997404 / 41051781 / -0.1%	60193078 / 61196237 / -1.6%	0.68 / 0.67 / +1.5%
tpch_q17/datafusion:parquet	128372884 / 129369271 / -0.8%	152666890 / 154484888 / -1.2%	0.84 / 0.84 / +0.4%
tpch_q18/datafusion:parquet	129468006 / 130485216 / -0.8%	150501370 / 152013946 / -1.0%	0.86 / 0.86 / +0.2%
tpch_q19/datafusion:parquet	59711077 / 59019003 / +1.2%	85141556 / 87042989 / -2.2%	0.70 / 0.68 / +3.4%
tpch_q20/datafusion:parquet	67328885 / 68194833 / -1.3%	90358877 / 92496639 / -2.3%	0.75 / 0.74 / +1.1%
tpch_q21/datafusion:parquet	106970223 / 107796448 / -0.8%	130759888 / 131581770 / -0.6%	0.82 / 0.82 / -0.1%
tpch_q22/datafusion:parquet	46698509 / 47655765 / -2.0%	64684672 / 67590909 / -4.3%	0.72 / 0.71 / +2.4%

duckdb / vortex-file-compressed / ns (1.005x ➖, 0↑ 1↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed	11261274 / 11523982 / -2.3%	26537324 / 18195577 / +45.8% 🔴	0.42 / 0.63 / -33.0%
tpch_q02/duckdb:vortex-file-compressed	17478990 / 17338390 / +0.8%	26962743 / 27634037 / -2.4%	0.65 / 0.63 / +3.3%
tpch_q03/duckdb:vortex-file-compressed	18203111 / 18127494 / +0.4%	36518332 / 37991165 / -3.9%	0.50 / 0.48 / +4.5%
tpch_q04/duckdb:vortex-file-compressed	17966225 / 17170557 / +4.6%	31809906 / 30365848 / +4.8%	0.56 / 0.57 / -0.1%
tpch_q05/duckdb:vortex-file-compressed	21299345 / 22457083 / -5.2%	34123693 / 37438644 / -8.9%	0.62 / 0.60 / +4.1%
tpch_q06/duckdb:vortex-file-compressed	7169948 / 5303338 / +35.2% 🔴	15578611 / 15751344 / -1.1%	0.46 / 0.34 / +36.7%
tpch_q07/duckdb:vortex-file-compressed	20831380 / 20360285 / +2.3%	36058178 / 35036447 / +2.9%	0.58 / 0.58 / -0.6%
tpch_q08/duckdb:vortex-file-compressed	23121385 / 23318649 / -0.8%	37351901 / 39151243 / -4.6%	0.62 / 0.60 / +3.9%
tpch_q09/duckdb:vortex-file-compressed	29878836 / 30219294 / -1.1%	46895278 / 46035028 / +1.9%	0.64 / 0.66 / -2.9%
tpch_q10/duckdb:vortex-file-compressed	28763888 / 28967402 / -0.7%	42143735 / 43872740 / -3.9%	0.68 / 0.66 / +3.4%
tpch_q11/duckdb:vortex-file-compressed	8784979 / 8763492 / +0.2%	14639801 / 14526212 / +0.8%	0.60 / 0.60 / -0.5%
tpch_q12/duckdb:vortex-file-compressed	16166050 / 16732570 / -3.4%	33159830 / 34116587 / -2.8%	0.49 / 0.49 / -0.6%
tpch_q13/duckdb:vortex-file-compressed	23782022 / 21677191 / +9.7%	39484699 / 37811839 / +4.4%	0.60 / 0.57 / +5.1%
tpch_q14/duckdb:vortex-file-compressed	13105289 / 13055943 / +0.4%	25408226 / 27978304 / -9.2%	0.52 / 0.47 / +10.5%
tpch_q15/duckdb:vortex-file-compressed	9284344 / 9993764 / -7.1%	20013081 / 20977615 / -4.6%	0.46 / 0.48 / -2.6%
tpch_q16/duckdb:vortex-file-compressed	18416922 / 18773614 / -1.9%	23140804 / 23400228 / -1.1%	0.80 / 0.80 / -0.8%
tpch_q17/duckdb:vortex-file-compressed	15185463 / 15066444 / +0.8%	30897297 / 32594751 / -5.2%	0.49 / 0.46 / +6.3%
tpch_q18/duckdb:vortex-file-compressed	24336251 / 24608939 / -1.1%	33099594 / 36306004 / -8.8%	0.74 / 0.68 / +8.5%
tpch_q19/duckdb:vortex-file-compressed	22670243 / 23927935 / -5.3%	34765529 / 34263911 / +1.5%	0.65 / 0.70 / -6.6%
tpch_q20/duckdb:vortex-file-compressed	16349868 / 17372097 / -5.9%	31709874 / 33428242 / -5.1%	0.52 / 0.52 / -0.8%
tpch_q21/duckdb:vortex-file-compressed	65129141 / 66496303 / -2.1%	83486979 / 89246389 / -6.5%	0.78 / 0.75 / +4.7%
tpch_q22/duckdb:vortex-file-compressed	14433846 / 14406699 / +0.2%	21173374 / 21479140 / -1.4%	0.68 / 0.67 / +1.6%

duckdb / vortex-compact / ns (1.007x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-compact	12685436 / 12610635 / +0.6%	22916211 / 24311863 / -5.7%	0.55 / 0.52 / +6.7%
tpch_q02/duckdb:vortex-compact	20075234 / 20231325 / -0.8%	27215226 / 27995715 / -2.8%	0.74 / 0.72 / +2.1%
tpch_q03/duckdb:vortex-compact	20606293 / 19440938 / +6.0%	39071426 / 36336835 / +7.5%	0.53 / 0.54 / -1.4%
tpch_q04/duckdb:vortex-compact	17224485 / 16791451 / +2.6%	29257000 / 30924305 / -5.4%	0.59 / 0.54 / +8.4%
tpch_q05/duckdb:vortex-compact	22940856 / 22044157 / +4.1%	34936035 / 37187177 / -6.1%	0.66 / 0.59 / +10.8%
tpch_q06/duckdb:vortex-compact	6366687 / 6277276 / +1.4%	15217179 / 16585246 / -8.2%	0.42 / 0.38 / +10.5%
tpch_q07/duckdb:vortex-compact	21790171 / 21401600 / +1.8%	36000074 / 40804542 / -11.8% 🟢	0.61 / 0.52 / +15.4%
tpch_q08/duckdb:vortex-compact	24435180 / 25233138 / -3.2%	38284186 / 39018058 / -1.9%	0.64 / 0.65 / -1.3%
tpch_q09/duckdb:vortex-compact	30239363 / 29777070 / +1.6%	46519914 / 46800243 / -0.6%	0.65 / 0.64 / +2.2%
tpch_q10/duckdb:vortex-compact	32095420 / 32772720 / -2.1%	46512959 / 47090665 / -1.2%	0.69 / 0.70 / -0.9%
tpch_q11/duckdb:vortex-compact	9993307 / 9816241 / +1.8%	15990232 / 16082660 / -0.6%	0.62 / 0.61 / +2.4%
tpch_q12/duckdb:vortex-compact	17685891 / 17640101 / +0.3%	32616250 / 31087365 / +4.9%	0.54 / 0.57 / -4.4%
tpch_q13/duckdb:vortex-compact	21954314 / 23024826 / -4.6%	38831375 / 42772845 / -9.2%	0.57 / 0.54 / +5.0%
tpch_q14/duckdb:vortex-compact	14334977 / 14313749 / +0.1%	29005537 / 26924427 / +7.7%	0.49 / 0.53 / -7.0%
tpch_q15/duckdb:vortex-compact	10947169 / 10248484 / +6.8%	20696790 / 20564040 / +0.6%	0.53 / 0.50 / +6.1%
tpch_q16/duckdb:vortex-compact	20587121 / 20278650 / +1.5%	26594408 / 24052624 / +10.6% 🔴	0.77 / 0.84 / -8.2%
tpch_q17/duckdb:vortex-compact	16048411 / 15757900 / +1.8%	35179742 / 34033686 / +3.4%	0.46 / 0.46 / -1.5%
tpch_q18/duckdb:vortex-compact	25426681 / 24718108 / +2.9%	32828378 / 38648986 / -15.1% 🟢	0.77 / 0.64 / +21.1%
tpch_q19/duckdb:vortex-compact	23713749 / 23853734 / -0.6%	34083484 / 33789684 / +0.9%	0.70 / 0.71 / -1.4%
tpch_q20/duckdb:vortex-compact	19089594 / 19597291 / -2.6%	38516286 / 42597256 / -9.6%	0.50 / 0.46 / +7.7%
tpch_q21/duckdb:vortex-compact	66025359 / 67613292 / -2.3%	81911662 / 83006109 / -1.3%	0.81 / 0.81 / -1.0%
tpch_q22/duckdb:vortex-compact	17548058 / 17523147 / +0.1%	23916997 / 25854600 / -7.5%	0.73 / 0.68 / +8.3%

duckdb / parquet / ns (1.004x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet	63174472 / 65596538 / -3.7%	70076318 / 72629533 / -3.5%	0.90 / 0.90 / -0.2%
tpch_q02/duckdb:parquet	37758773 / 37593441 / +0.4%	49784079 / 46871835 / +6.2%	0.76 / 0.80 / -5.4%
tpch_q03/duckdb:parquet	67756259 / 70631089 / -4.1%	78397419 / 80931744 / -3.1%	0.86 / 0.87 / -1.0%
tpch_q04/duckdb:parquet	46809364 / 46557476 / +0.5%	55706648 / 56671459 / -1.7%	0.84 / 0.82 / +2.3%
tpch_q05/duckdb:parquet	66309844 / 65657636 / +1.0%	77143757 / 76847866 / +0.4%	0.86 / 0.85 / +0.6%
tpch_q06/duckdb:parquet	22086250 / 21837600 / +1.1%	27329569 / 37967120 / -28.0% 🟢	0.81 / 0.58 / +40.5%
tpch_q07/duckdb:parquet	68265483 / 65332558 / +4.5%	78480284 / 75523712 / +3.9%	0.87 / 0.87 / +0.6%
tpch_q08/duckdb:parquet	80427642 / 80135195 / +0.4%	92882770 / 92758013 / +0.1%	0.87 / 0.86 / +0.2%
tpch_q09/duckdb:parquet	119634666 / 119886840 / -0.2%	133372164 / 133251166 / +0.1%	0.90 / 0.90 / -0.3%
tpch_q10/duckdb:parquet	119006523 / 119030927 / -0.0%	131882156 / 130876074 / +0.8%	0.90 / 0.91 / -0.8%
tpch_q11/duckdb:parquet	21386957 / 21190991 / +0.9%	26341571 / 25216207 / +4.5%	0.81 / 0.84 / -3.4%
tpch_q12/duckdb:parquet	44691803 / 44685651 / +0.0%	52201883 / 52472116 / -0.5%	0.86 / 0.85 / +0.5%
tpch_q13/duckdb:parquet	244066894 / 243562563 / +0.2%	253273017 / 253855093 / -0.2%	0.96 / 0.96 / +0.4%
tpch_q14/duckdb:parquet	47370392 / 47410723 / -0.1%	55670582 / 55599418 / +0.1%	0.85 / 0.85 / -0.2%
tpch_q15/duckdb:parquet	28924897 / 26543487 / +9.0%	33015945 / 33870236 / -2.5%	0.88 / 0.78 / +11.8%
tpch_q16/duckdb:parquet	52249992 / 52430976 / -0.3%	60528719 / 57476462 / +5.3%	0.86 / 0.91 / -5.4%
tpch_q17/duckdb:parquet	49084452 / 48903843 / +0.4%	58644783 / 59013014 / -0.6%	0.84 / 0.83 / +1.0%
tpch_q18/duckdb:parquet	96414311 / 98277083 / -1.9%	104258122 / 107416433 / -2.9%	0.92 / 0.91 / +1.1%
tpch_q19/duckdb:parquet	65180815 / 64788352 / +0.6%	75200204 / 75929550 / -1.0%	0.87 / 0.85 / +1.6%
tpch_q20/duckdb:parquet	61743513 / 61822811 / -0.1%	73733898 / 73736915 / -0.0%	0.84 / 0.84 / -0.1%
tpch_q21/duckdb:parquet	142224167 / 142239281 / -0.0%	151958468 / 154834143 / -1.9%	0.94 / 0.92 / +1.9%
tpch_q22/duckdb:parquet	51498620 / 51522168 / -0.0%	59606497 / 59121920 / +0.8%	0.86 / 0.87 / -0.9%

No file size changes detected.

github-actions · 2026-10-14T13:30:55Z

Benchmarks: Clickbench Sorted on NVME 📖

Commits: PR 85e620b1 vs base 73192765
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +1.5%
Engines: DataFusion No clear signal (+0.4%, low confidence) · DuckDB No clear signal (+2.6%, environment too noisy confidence)
Vortex (geomean): hot 1.010x ➖ · cold 1.008x ➖
Parquet (geomean): hot 0.995x ➖ · cold 1.013x ➖
Shifts: Parquet (control) -0.5% · Median polish +0.9%

How to read Verdict and Engines

Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.984x ➖, 1↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
clickbench-sorted_q23/datafusion:vortex-file-compressed	148913250 / 166123073 / -10.4% 🟢	561694587 / 573645241 / -2.1%	0.27 / 0.29 / -8.5%
clickbench-sorted_q24/datafusion:vortex-file-compressed	11129314 / 11242450 / -1.0%	50732991 / 50629737 / +0.2%	0.22 / 0.22 / -1.2%
clickbench-sorted_q26/datafusion:vortex-file-compressed	11257354 / 11450243 / -1.7%	50601005 / 53221559 / -4.9%	0.22 / 0.22 / +3.4%
clickbench-sorted_q36/datafusion:vortex-file-compressed	23550817 / 22791367 / +3.3%	72652547 / 70249083 / +3.4%	0.32 / 0.32 / -0.1%
clickbench-sorted_q37/datafusion:vortex-file-compressed	18626771 / 18486840 / +0.8%	61425441 / 61118996 / +0.5%	0.30 / 0.30 / +0.3%
clickbench-sorted_q38/datafusion:vortex-file-compressed	17533548 / 18220084 / -3.8%	63453480 / 62363258 / +1.7%	0.28 / 0.29 / -5.4%
clickbench-sorted_q39/datafusion:vortex-file-compressed	40122690 / 39662110 / +1.2%	95387747 / 95063141 / +0.3%	0.42 / 0.42 / +0.8%
clickbench-sorted_q40/datafusion:vortex-file-compressed	11859160 / 11706836 / +1.3%	47255981 / 48343312 / -2.2%	0.25 / 0.24 / +3.6%
clickbench-sorted_q41/datafusion:vortex-file-compressed	11926656 / 11970597 / -0.4%	46687845 / 46220958 / +1.0%	0.26 / 0.26 / -1.4%
clickbench-sorted_q42/datafusion:vortex-file-compressed	9765084 / 10189954 / -4.2%	37932200 / 37666188 / +0.7%	0.26 / 0.27 / -4.8%

datafusion / vortex-compact / ns (0.997x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
clickbench-sorted_q23/datafusion:vortex-compact	171426762 / 164361998 / +4.3%	499230312 / 462760048 / +7.9%	0.34 / 0.36 / -3.3%
clickbench-sorted_q24/datafusion:vortex-compact	18790744 / 18214455 / +3.2%	54292581 / 53462060 / +1.6%	0.35 / 0.34 / +1.6%
clickbench-sorted_q26/datafusion:vortex-compact	18209882 / 18453610 / -1.3%	48661624 / 49771085 / -2.2%	0.37 / 0.37 / +0.9%
clickbench-sorted_q36/datafusion:vortex-compact	25834706 / 26055874 / -0.8%	71251303 / 73625903 / -3.2%	0.36 / 0.35 / +2.5%
clickbench-sorted_q37/datafusion:vortex-compact	22194178 / 22741068 / -2.4%	68932094 / 71001820 / -2.9%	0.32 / 0.32 / +0.5%
clickbench-sorted_q38/datafusion:vortex-compact	20538798 / 20987895 / -2.1%	65919778 / 71068234 / -7.2%	0.31 / 0.30 / +5.5%
clickbench-sorted_q39/datafusion:vortex-compact	42338768 / 43200584 / -2.0%	89838323 / 90268188 / -0.5%	0.47 / 0.48 / -1.5%
clickbench-sorted_q40/datafusion:vortex-compact	14004064 / 14220126 / -1.5%	46979032 / 48626247 / -3.4%	0.30 / 0.29 / +1.9%
clickbench-sorted_q41/datafusion:vortex-compact	13770645 / 13893088 / -0.9%	48395175 / 49610975 / -2.5%	0.28 / 0.28 / +1.6%
clickbench-sorted_q42/datafusion:vortex-compact	11055460 / 10993393 / +0.6%	38202499 / 37128409 / +2.9%	0.29 / 0.30 / -2.3%

datafusion / parquet / ns (0.987x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
clickbench-sorted_q23/datafusion:parquet	755437551 / 762998669 / -1.0%	975331696 / 987581650 / -1.2%	0.77 / 0.77 / +0.3%
clickbench-sorted_q24/datafusion:parquet	8932495 / 9144048 / -2.3%	74765531 / 74779914 / -0.0%	0.12 / 0.12 / -2.3%
clickbench-sorted_q26/datafusion:parquet	8855570 / 9744138 / -9.1%	74983617 / 74710384 / +0.4%	0.12 / 0.13 / -9.5%
clickbench-sorted_q36/datafusion:parquet	94430846 / 94278062 / +0.2%	172425377 / 174122869 / -1.0%	0.55 / 0.54 / +1.1%
clickbench-sorted_q37/datafusion:parquet	64317668 / 64400969 / -0.1%	134258569 / 133982022 / +0.2%	0.48 / 0.48 / -0.3%
clickbench-sorted_q38/datafusion:parquet	87696606 / 87584739 / +0.1%	166897427 / 166449376 / +0.3%	0.53 / 0.53 / -0.1%
clickbench-sorted_q39/datafusion:parquet	160044205 / 160443178 / -0.2%	240505215 / 242643269 / -0.9%	0.67 / 0.66 / +0.6%
clickbench-sorted_q40/datafusion:parquet	44557244 / 44703608 / -0.3%	117594629 / 117217146 / +0.3%	0.38 / 0.38 / -0.6%
clickbench-sorted_q41/datafusion:parquet	42341729 / 42173693 / +0.4%	113799852 / 111762995 / +1.8%	0.37 / 0.38 / -1.4%
clickbench-sorted_q42/datafusion:parquet	26356916 / 26436937 / -0.3%	87994605 / 86900384 / +1.3%	0.30 / 0.30 / -1.5%

duckdb / vortex-file-compressed / ns (1.036x ➖, 0↑ 2↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
clickbench-sorted_q23/duckdb:vortex-file-compressed	58898678 / 55112104 / +6.9%	95438474 / 91554900 / +4.2%	0.62 / 0.60 / +2.5%
clickbench-sorted_q24/duckdb:vortex-file-compressed	23795434 / 22145746 / +7.4%	34299143 / 38386731 / -10.6% 🟢	0.69 / 0.58 / +20.3%
clickbench-sorted_q26/duckdb:vortex-file-compressed	17319917 / 14860982 / +16.5% 🔴	30299384 / 25495900 / +18.8% 🔴	0.57 / 0.58 / -1.9%
clickbench-sorted_q36/duckdb:vortex-file-compressed	30060016 / 29390652 / +2.3%	66629374 / 64148615 / +3.9%	0.45 / 0.46 / -1.5%
clickbench-sorted_q37/duckdb:vortex-file-compressed	23257660 / 23377686 / -0.5%	53586312 / 52655910 / +1.8%	0.43 / 0.44 / -2.2%
clickbench-sorted_q38/duckdb:vortex-file-compressed	26966500 / 24307913 / +10.9% 🔴	60738413 / 60268722 / +0.8%	0.44 / 0.40 / +10.1%
clickbench-sorted_q39/duckdb:vortex-file-compressed	46634088 / 46521114 / +0.2%	102847161 / 101891301 / +0.9%	0.45 / 0.46 / -0.7%
clickbench-sorted_q40/duckdb:vortex-file-compressed	15114559 / 15203870 / -0.6%	40255081 / 40222074 / +0.1%	0.38 / 0.38 / -0.7%
clickbench-sorted_q41/duckdb:vortex-file-compressed	15393912 / 15896180 / -3.2%	37505100 / 38960474 / -3.7%	0.41 / 0.41 / +0.6%
clickbench-sorted_q42/duckdb:vortex-file-compressed	12112000 / 12422918 / -2.5%	29286688 / 31657505 / -7.5%	0.41 / 0.39 / +5.4%

duckdb / vortex-compact / ns (1.023x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
clickbench-sorted_q23/duckdb:vortex-compact	65733574 / 62623702 / +5.0%	97294996 / 83137579 / +17.0% 🔴	0.68 / 0.75 / -10.3%
clickbench-sorted_q24/duckdb:vortex-compact	23161951 / 22454067 / +3.2%	38171947 / 29430509 / +29.7% 🔴	0.61 / 0.76 / -20.5%
clickbench-sorted_q26/duckdb:vortex-compact	18340352 / 16764580 / +9.4%	28347478 / 32144895 / -11.8% 🟢	0.65 / 0.52 / +24.1%
clickbench-sorted_q36/duckdb:vortex-compact	33286614 / 33810296 / -1.5%	71872457 / 70329939 / +2.2%	0.46 / 0.48 / -3.7%
clickbench-sorted_q37/duckdb:vortex-compact	27771361 / 29422666 / -5.6%	62187908 / 59457747 / +4.6%	0.45 / 0.49 / -9.8%
clickbench-sorted_q38/duckdb:vortex-compact	28002720 / 29401626 / -4.8%	65481072 / 64899863 / +0.9%	0.43 / 0.45 / -5.6%
clickbench-sorted_q39/duckdb:vortex-compact	58016336 / 55632248 / +4.3%	96021668 / 101790877 / -5.7%	0.60 / 0.55 / +10.6%
clickbench-sorted_q40/duckdb:vortex-compact	18572038 / 17280872 / +7.5%	40134527 / 39896142 / +0.6%	0.46 / 0.43 / +6.8%
clickbench-sorted_q41/duckdb:vortex-compact	16178736 / 15969368 / +1.3%	41186265 / 45097026 / -8.7%	0.39 / 0.35 / +10.9%
clickbench-sorted_q42/duckdb:vortex-compact	13192257 / 12547260 / +5.1%	38204036 / 32061764 / +19.2% 🔴	0.35 / 0.39 / -11.8%

duckdb / parquet / ns (1.003x ➖, 1↑ 1↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
clickbench-sorted_q23/duckdb:parquet	128406081 / 128243772 / +0.1%	135459089 / 148402839 / -8.7%	0.95 / 0.86 / +9.7%
clickbench-sorted_q24/duckdb:parquet	18365105 / 17843158 / +2.9%	32377158 / 27888481 / +16.1% 🔴	0.57 / 0.64 / -11.3%
clickbench-sorted_q26/duckdb:parquet	11992102 / 14303308 / -16.2% 🟢	26345547 / 23711513 / +11.1% 🔴	0.46 / 0.60 / -24.5%
clickbench-sorted_q36/duckdb:parquet	44360481 / 44768256 / -0.9%	73415239 / 66136694 / +11.0% 🔴	0.60 / 0.68 / -10.7%
clickbench-sorted_q37/duckdb:parquet	30634388 / 33004664 / -7.2%	54391965 / 53211916 / +2.2%	0.56 / 0.62 / -9.2%
clickbench-sorted_q38/duckdb:parquet	43101704 / 39068560 / +10.3% 🔴	64610734 / 66899511 / -3.4%	0.67 / 0.58 / +14.2%
clickbench-sorted_q39/duckdb:parquet	73214842 / 71735093 / +2.1%	90938287 / 92864963 / -2.1%	0.81 / 0.77 / +4.2%
clickbench-sorted_q40/duckdb:parquet	18004175 / 17086860 / +5.4%	46746851 / 44669182 / +4.7%	0.39 / 0.38 / +0.7%
clickbench-sorted_q41/duckdb:parquet	17085554 / 16197802 / +5.5%	44911237 / 41825443 / +7.4%	0.38 / 0.39 / -1.8%
clickbench-sorted_q42/duckdb:parquet	11374712 / 10964382 / +3.7%	25095242 / 27787529 / -9.7%	0.45 / 0.39 / +14.9%

File Size Changes (200 files changed, +0.0% overall, 100↑ 100↓)

File	Scale	Format	Base	HEAD	Change	%
hits_001.vortex	1.0	vortex-file-compressed	188.92 MB	193.11 MB	+4.19 MB	+2.2%
hits_076.vortex	1.0	vortex-file-compressed	159.83 MB	162.07 MB	+2.23 MB	+1.4%
hits_061.vortex	1.0	vortex-compact	123.73 MB	125.26 MB	+1.53 MB	+1.2%
hits_064.vortex	1.0	vortex-file-compressed	190.58 MB	192.70 MB	+2.12 MB	+1.1%
hits_024.vortex	1.0	vortex-file-compressed	159.34 MB	161.02 MB	+1.68 MB	+1.1%
hits_063.vortex	1.0	vortex-compact	97.67 MB	98.67 MB	+1.00 MB	+1.0%
hits_001.vortex	1.0	vortex-compact	137.68 MB	139.06 MB	+1.37 MB	+1.0%
hits_011.vortex	1.0	vortex-file-compressed	198.64 MB	200.52 MB	+1.88 MB	+0.9%
hits_029.vortex	1.0	vortex-file-compressed	199.28 MB	200.97 MB	+1.69 MB	+0.8%
hits_064.vortex	1.0	vortex-compact	138.87 MB	140.02 MB	+1.15 MB	+0.8%
hits_075.vortex	1.0	vortex-compact	137.91 MB	138.95 MB	+1.04 MB	+0.8%
hits_014.vortex	1.0	vortex-file-compressed	172.79 MB	174.05 MB	+1.27 MB	+0.7%
hits_084.vortex	1.0	vortex-compact	110.20 MB	110.99 MB	+805.27 KB	+0.7%
hits_081.vortex	1.0	vortex-file-compressed	199.94 MB	201.13 MB	+1.19 MB	+0.6%
hits_092.vortex	1.0	vortex-file-compressed	199.59 MB	200.78 MB	+1.18 MB	+0.6%
hits_023.vortex	1.0	vortex-file-compressed	194.96 MB	196.10 MB	+1.14 MB	+0.6%
hits_016.vortex	1.0	vortex-compact	126.69 MB	127.38 MB	+714.47 KB	+0.6%
hits_091.vortex	1.0	vortex-compact	111.50 MB	112.10 MB	+621.02 KB	+0.5%
hits_018.vortex	1.0	vortex-compact	152.09 MB	152.91 MB	+833.12 KB	+0.5%
hits_044.vortex	1.0	vortex-file-compressed	200.05 MB	201.06 MB	+1.02 MB	+0.5%
hits_045.vortex	1.0	vortex-file-compressed	139.19 MB	139.79 MB	+611.84 KB	+0.4%
hits_043.vortex	1.0	vortex-compact	95.89 MB	96.27 MB	+393.16 KB	+0.4%
hits_030.vortex	1.0	vortex-compact	98.39 MB	98.76 MB	+381.99 KB	+0.4%
hits_052.vortex	1.0	vortex-file-compressed	130.01 MB	130.46 MB	+459.74 KB	+0.3%
hits_086.vortex	1.0	vortex-compact	139.53 MB	140.01 MB	+490.62 KB	+0.3%
hits_081.vortex	1.0	vortex-compact	152.66 MB	153.13 MB	+475.55 KB	+0.3%
hits_066.vortex	1.0	vortex-compact	117.49 MB	117.83 MB	+348.12 KB	+0.3%
hits_096.vortex	1.0	vortex-compact	152.30 MB	152.73 MB	+433.31 KB	+0.3%
hits_027.vortex	1.0	vortex-file-compressed	189.44 MB	189.93 MB	+502.55 KB	+0.3%
hits_089.vortex	1.0	vortex-file-compressed	130.66 MB	130.98 MB	+331.87 KB	+0.2%
hits_048.vortex	1.0	vortex-compact	151.83 MB	152.19 MB	+369.17 KB	+0.2%
hits_068.vortex	1.0	vortex-compact	112.09 MB	112.34 MB	+252.52 KB	+0.2%
hits_071.vortex	1.0	vortex-file-compressed	139.31 MB	139.60 MB	+303.08 KB	+0.2%
hits_086.vortex	1.0	vortex-file-compressed	191.75 MB	192.13 MB	+382.91 KB	+0.2%
hits_053.vortex	1.0	vortex-compact	138.34 MB	138.60 MB	+266.31 KB	+0.2%
hits_088.vortex	1.0	vortex-file-compressed	172.57 MB	172.88 MB	+318.70 KB	+0.2%
hits_070.vortex	1.0	vortex-compact	152.78 MB	153.04 MB	+274.38 KB	+0.2%
hits_046.vortex	1.0	vortex-compact	74.91 MB	75.03 MB	+121.15 KB	+0.2%
hits_080.vortex	1.0	vortex-compact	96.83 MB	96.98 MB	+155.07 KB	+0.2%
hits_075.vortex	1.0	vortex-file-compressed	189.13 MB	189.43 MB	+301.87 KB	+0.2%
hits_007.vortex	1.0	vortex-file-compressed	201.05 MB	201.35 MB	+304.37 KB	+0.1%
hits_041.vortex	1.0	vortex-file-compressed	130.25 MB	130.43 MB	+187.45 KB	+0.1%
hits_052.vortex	1.0	vortex-compact	97.64 MB	97.78 MB	+137.80 KB	+0.1%
hits_005.vortex	1.0	vortex-file-compressed	167.17 MB	167.39 MB	+223.00 KB	+0.1%
hits_017.vortex	1.0	vortex-compact	112.04 MB	112.19 MB	+145.66 KB	+0.1%
hits_059.vortex	1.0	vortex-compact	151.73 MB	151.92 MB	+191.33 KB	+0.1%
hits_097.vortex	1.0	vortex-compact	140.20 MB	140.37 MB	+173.95 KB	+0.1%
hits_056.vortex	1.0	vortex-file-compressed	135.05 MB	135.20 MB	+154.95 KB	+0.1%
hits_077.vortex	1.0	vortex-compact	134.15 MB	134.30 MB	+148.03 KB	+0.1%
hits_097.vortex	1.0	vortex-file-compressed	192.68 MB	192.89 MB	+210.80 KB	+0.1%
hits_022.vortex	1.0	vortex-file-compressed	200.13 MB	200.34 MB	+215.02 KB	+0.1%
hits_028.vortex	1.0	vortex-compact	115.35 MB	115.47 MB	+123.26 KB	+0.1%
hits_030.vortex	1.0	vortex-file-compressed	131.03 MB	131.16 MB	+139.11 KB	+0.1%
hits_025.vortex	1.0	vortex-file-compressed	172.42 MB	172.59 MB	+174.31 KB	+0.1%
hits_057.vortex	1.0	vortex-compact	111.52 MB	111.63 MB	+109.50 KB	+0.1%
hits_036.vortex	1.0	vortex-compact	133.24 MB	133.37 MB	+129.95 KB	+0.1%
hits_088.vortex	1.0	vortex-compact	133.64 MB	133.76 MB	+128.80 KB	+0.1%
hits_059.vortex	1.0	vortex-file-compressed	200.22 MB	200.40 MB	+182.10 KB	+0.1%
hits_049.vortex	1.0	vortex-compact	139.36 MB	139.47 MB	+119.88 KB	+0.1%
hits_003.vortex	1.0	vortex-file-compressed	136.61 MB	136.72 MB	+108.84 KB	+0.1%
hits_015.vortex	1.0	vortex-file-compressed	130.19 MB	130.29 MB	+97.00 KB	+0.1%
hits_057.vortex	1.0	vortex-file-compressed	159.82 MB	159.93 MB	+114.33 KB	+0.1%
hits_084.vortex	1.0	vortex-file-compressed	153.91 MB	154.02 MB	+108.96 KB	+0.1%
hits_033.vortex	1.0	vortex-compact	153.05 MB	153.16 MB	+107.68 KB	+0.1%
hits_092.vortex	1.0	vortex-compact	152.89 MB	152.99 MB	+103.78 KB	+0.1%
hits_021.vortex	1.0	vortex-file-compressed	153.75 MB	153.85 MB	+104.25 KB	+0.1%
hits_051.vortex	1.0	vortex-file-compressed	172.90 MB	173.02 MB	+115.32 KB	+0.1%
hits_043.vortex	1.0	vortex-file-compressed	126.68 MB	126.76 MB	+82.97 KB	+0.1%
hits_074.vortex	1.0	vortex-file-compressed	200.19 MB	200.30 MB	+121.44 KB	+0.1%
hits_040.vortex	1.0	vortex-file-compressed	144.58 MB	144.67 MB	+86.62 KB	+0.1%
hits_044.vortex	1.0	vortex-compact	153.28 MB	153.37 MB	+90.40 KB	+0.1%
hits_045.vortex	1.0	vortex-compact	105.68 MB	105.74 MB	+58.83 KB	+0.1%
hits_071.vortex	1.0	vortex-compact	105.62 MB	105.68 MB	+56.80 KB	+0.1%
hits_068.vortex	1.0	vortex-file-compressed	160.26 MB	160.34 MB	+81.23 KB	+0.0%
hits_000.vortex	1.0	vortex-file-compressed	130.65 MB	130.71 MB	+61.45 KB	+0.0%
hits_020.vortex	1.0	vortex-compact	111.70 MB	111.74 MB	+49.49 KB	+0.0%
hits_051.vortex	1.0	vortex-compact	133.77 MB	133.83 MB	+58.18 KB	+0.0%
hits_040.vortex	1.0	vortex-compact	110.26 MB	110.30 MB	+42.54 KB	+0.0%
hits_054.vortex	1.0	vortex-file-compressed	147.28 MB	147.33 MB	+52.08 KB	+0.0%
hits_031.vortex	1.0	vortex-file-compressed	159.11 MB	159.17 MB	+52.55 KB	+0.0%
hits_094.vortex	1.0	vortex-compact	110.84 MB	110.87 MB	+31.35 KB	+0.0%
hits_065.vortex	1.0	vortex-compact	125.72 MB	125.76 MB	+35.12 KB	+0.0%
hits_027.vortex	1.0	vortex-compact	138.10 MB	138.14 MB	+35.59 KB	+0.0%
hits_078.vortex	1.0	vortex-file-compressed	130.26 MB	130.29 MB	+30.32 KB	+0.0%
hits_067.vortex	1.0	vortex-file-compressed	130.95 MB	130.98 MB	+28.41 KB	+0.0%
hits_006.vortex	1.0	vortex-file-compressed	126.58 MB	126.61 MB	+27.26 KB	+0.0%
hits_096.vortex	1.0	vortex-file-compressed	200.51 MB	200.54 MB	+40.81 KB	+0.0%
hits_019.vortex	1.0	vortex-compact	106.13 MB	106.15 MB	+19.92 KB	+0.0%
hits_049.vortex	1.0	vortex-file-compressed	191.15 MB	191.18 MB	+29.91 KB	+0.0%
hits_037.vortex	1.0	vortex-file-compressed	178.09 MB	178.11 MB	+26.73 KB	+0.0%
hits_047.vortex	1.0	vortex-compact	110.00 MB	110.02 MB	+16.20 KB	+0.0%
hits_035.vortex	1.0	vortex-compact	75.94 MB	75.95 MB	+11.09 KB	+0.0%
hits_062.vortex	1.0	vortex-compact	132.49 MB	132.50 MB	+10.12 KB	+0.0%
hits_022.vortex	1.0	vortex-compact	152.58 MB	152.59 MB	+9.02 KB	+0.0%
hits_053.vortex	1.0	vortex-file-compressed	189.45 MB	189.46 MB	+10.70 KB	+0.0%
hits_028.vortex	1.0	vortex-file-compressed	152.11 MB	152.12 MB	+7.63 KB	+0.0%
hits_018.vortex	1.0	vortex-file-compressed	200.87 MB	200.88 MB	+7.00 KB	+0.0%
hits_017.vortex	1.0	vortex-file-compressed	147.22 MB	147.22 MB	+2.63 KB	+0.0%
hits_069.vortex	1.0	vortex-compact	99.71 MB	99.71 MB	+1.52 KB	+0.0%
hits_060.vortex	1.0	vortex-file-compressed	192.85 MB	192.86 MB	+2.93 KB	+0.0%
hits_079.vortex	1.0	vortex-compact	128.05 MB	128.05 MB	7.23 KB	-0.0%
hits_009.vortex	1.0	vortex-compact	75.25 MB	75.24 MB	4.66 KB	-0.0%
hits_032.vortex	1.0	vortex-file-compressed	154.06 MB	154.05 MB	10.14 KB	-0.0%
hits_037.vortex	1.0	vortex-compact	132.04 MB	132.03 MB	12.87 KB	-0.0%
hits_095.vortex	1.0	vortex-compact	110.61 MB	110.60 MB	12.20 KB	-0.0%
hits_042.vortex	1.0	vortex-compact	136.73 MB	136.71 MB	16.50 KB	-0.0%
hits_062.vortex	1.0	vortex-file-compressed	171.33 MB	171.31 MB	21.33 KB	-0.0%
hits_094.vortex	1.0	vortex-file-compressed	158.70 MB	158.68 MB	21.20 KB	-0.0%
hits_067.vortex	1.0	vortex-compact	98.04 MB	98.03 MB	13.22 KB	-0.0%
hits_021.vortex	1.0	vortex-compact	110.16 MB	110.15 MB	15.99 KB	-0.0%
hits_008.vortex	1.0	vortex-compact	105.77 MB	105.76 MB	17.97 KB	-0.0%
hits_042.vortex	1.0	vortex-file-compressed	202.28 MB	202.24 MB	35.13 KB	-0.0%
hits_010.vortex	1.0	vortex-compact	122.62 MB	122.60 MB	23.01 KB	-0.0%
hits_070.vortex	1.0	vortex-file-compressed	201.05 MB	201.01 MB	38.51 KB	-0.0%
hits_091.vortex	1.0	vortex-file-compressed	147.44 MB	147.41 MB	34.45 KB	-0.0%
hits_098.vortex	1.0	vortex-file-compressed	137.91 MB	137.87 MB	37.62 KB	-0.0%
hits_029.vortex	1.0	vortex-compact	153.19 MB	153.14 MB	48.65 KB	-0.0%
hits_039.vortex	1.0	vortex-file-compressed	161.83 MB	161.78 MB	53.45 KB	-0.0%
hits_038.vortex	1.0	vortex-file-compressed	189.66 MB	189.59 MB	66.29 KB	-0.0%
hits_079.vortex	1.0	vortex-file-compressed	180.59 MB	180.52 MB	66.14 KB	-0.0%
hits_015.vortex	1.0	vortex-compact	97.50 MB	97.47 MB	37.12 KB	-0.0%
hits_038.vortex	1.0	vortex-compact	138.32 MB	138.26 MB	54.50 KB	-0.0%
hits_082.vortex	1.0	vortex-compact	105.78 MB	105.74 MB	42.91 KB	-0.0%
hits_065.vortex	1.0	vortex-file-compressed	161.91 MB	161.85 MB	67.41 KB	-0.0%
hits_004.vortex	1.0	vortex-file-compressed	130.71 MB	130.65 MB	56.27 KB	-0.0%
hits_082.vortex	1.0	vortex-file-compressed	139.26 MB	139.20 MB	60.05 KB	-0.0%
hits_083.vortex	1.0	vortex-compact	110.13 MB	110.08 MB	49.57 KB	-0.0%
hits_050.vortex	1.0	vortex-file-compressed	161.66 MB	161.58 MB	78.05 KB	-0.0%
hits_085.vortex	1.0	vortex-file-compressed	200.73 MB	200.63 MB	102.17 KB	-0.0%
hits_033.vortex	1.0	vortex-file-compressed	200.98 MB	200.88 MB	105.39 KB	-0.1%
hits_083.vortex	1.0	vortex-file-compressed	156.30 MB	156.22 MB	83.00 KB	-0.1%
hits_019.vortex	1.0	vortex-file-compressed	140.12 MB	140.05 MB	75.98 KB	-0.1%
hits_060.vortex	1.0	vortex-compact	140.15 MB	140.08 MB	78.02 KB	-0.1%
hits_009.vortex	1.0	vortex-file-compressed	101.16 MB	101.10 MB	58.46 KB	-0.1%
hits_093.vortex	1.0	vortex-file-compressed	130.95 MB	130.87 MB	77.45 KB	-0.1%
hits_008.vortex	1.0	vortex-file-compressed	139.41 MB	139.32 MB	89.95 KB	-0.1%
hits_058.vortex	1.0	vortex-file-compressed	154.53 MB	154.42 MB	104.88 KB	-0.1%
hits_063.vortex	1.0	vortex-file-compressed	130.94 MB	130.86 MB	90.58 KB	-0.1%
hits_099.vortex	1.0	vortex-compact	133.15 MB	133.06 MB	92.80 KB	-0.1%
hits_024.vortex	1.0	vortex-compact	124.80 MB	124.71 MB	92.31 KB	-0.1%
hits_072.vortex	1.0	vortex-compact	75.60 MB	75.54 MB	58.68 KB	-0.1%
hits_002.vortex	1.0	vortex-file-compressed	161.71 MB	161.59 MB	128.23 KB	-0.1%
hits_073.vortex	1.0	vortex-file-compressed	173.18 MB	173.04 MB	137.75 KB	-0.1%
hits_002.vortex	1.0	vortex-compact	123.91 MB	123.82 MB	99.48 KB	-0.1%
hits_080.vortex	1.0	vortex-file-compressed	127.15 MB	127.05 MB	108.57 KB	-0.1%
hits_011.vortex	1.0	vortex-compact	152.39 MB	152.26 MB	133.03 KB	-0.1%
hits_073.vortex	1.0	vortex-compact	134.18 MB	134.07 MB	122.26 KB	-0.1%
hits_025.vortex	1.0	vortex-compact	133.54 MB	133.41 MB	123.96 KB	-0.1%
hits_016.vortex	1.0	vortex-file-compressed	179.89 MB	179.73 MB	169.23 KB	-0.1%
hits_020.vortex	1.0	vortex-file-compressed	160.03 MB	159.87 MB	158.83 KB	-0.1%
hits_061.vortex	1.0	vortex-file-compressed	161.57 MB	161.41 MB	161.12 KB	-0.1%
hits_055.vortex	1.0	vortex-file-compressed	200.72 MB	200.52 MB	204.05 KB	-0.1%
hits_003.vortex	1.0	vortex-compact	104.81 MB	104.71 MB	108.18 KB	-0.1%
hits_013.vortex	1.0	vortex-file-compressed	161.99 MB	161.79 MB	204.90 KB	-0.1%
hits_056.vortex	1.0	vortex-compact	100.97 MB	100.83 MB	136.12 KB	-0.1%
hits_035.vortex	1.0	vortex-file-compressed	102.31 MB	102.17 MB	146.34 KB	-0.1%
hits_072.vortex	1.0	vortex-file-compressed	101.96 MB	101.81 MB	150.09 KB	-0.1%
hits_054.vortex	1.0	vortex-compact	111.96 MB	111.79 MB	173.57 KB	-0.2%
hits_034.vortex	1.0	vortex-compact	133.37 MB	133.16 MB	210.70 KB	-0.2%
hits_093.vortex	1.0	vortex-compact	98.48 MB	98.33 MB	156.91 KB	-0.2%
hits_036.vortex	1.0	vortex-file-compressed	172.13 MB	171.86 MB	276.80 KB	-0.2%
hits_046.vortex	1.0	vortex-file-compressed	100.84 MB	100.67 MB	167.45 KB	-0.2%
hits_095.vortex	1.0	vortex-file-compressed	154.11 MB	153.86 MB	264.99 KB	-0.2%
hits_014.vortex	1.0	vortex-compact	133.69 MB	133.47 MB	231.20 KB	-0.2%
hits_050.vortex	1.0	vortex-compact	125.47 MB	125.25 MB	225.06 KB	-0.2%
hits_005.vortex	1.0	vortex-compact	116.23 MB	116.01 MB	222.54 KB	-0.2%
hits_087.vortex	1.0	vortex-compact	125.58 MB	125.34 MB	244.88 KB	-0.2%
hits_098.vortex	1.0	vortex-compact	103.82 MB	103.60 MB	220.45 KB	-0.2%
hits_055.vortex	1.0	vortex-compact	152.99 MB	152.67 MB	326.66 KB	-0.2%
hits_007.vortex	1.0	vortex-compact	153.59 MB	153.26 MB	344.47 KB	-0.2%
hits_085.vortex	1.0	vortex-compact	152.78 MB	152.44 MB	346.85 KB	-0.2%
hits_099.vortex	1.0	vortex-file-compressed	172.26 MB	171.87 MB	392.53 KB	-0.2%
hits_074.vortex	1.0	vortex-compact	152.64 MB	152.28 MB	366.71 KB	-0.2%
hits_031.vortex	1.0	vortex-compact	111.56 MB	111.29 MB	273.55 KB	-0.2%
hits_077.vortex	1.0	vortex-file-compressed	173.32 MB	172.87 MB	458.41 KB	-0.3%
hits_069.vortex	1.0	vortex-file-compressed	143.13 MB	142.76 MB	381.70 KB	-0.3%
hits_026.vortex	1.0	vortex-file-compressed	130.80 MB	130.42 MB	386.91 KB	-0.3%
hits_026.vortex	1.0	vortex-compact	98.28 MB	97.99 MB	299.47 KB	-0.3%
hits_078.vortex	1.0	vortex-compact	98.03 MB	97.73 MB	306.16 KB	-0.3%
hits_048.vortex	1.0	vortex-file-compressed	200.62 MB	199.83 MB	811.01 KB	-0.4%
hits_058.vortex	1.0	vortex-compact	110.81 MB	110.36 MB	462.41 KB	-0.4%
hits_032.vortex	1.0	vortex-compact	110.59 MB	110.13 MB	470.61 KB	-0.4%
hits_047.vortex	1.0	vortex-file-compressed	154.52 MB	153.84 MB	691.13 KB	-0.4%
hits_066.vortex	1.0	vortex-file-compressed	163.69 MB	162.97 MB	739.44 KB	-0.4%
hits_089.vortex	1.0	vortex-compact	98.95 MB	98.49 MB	465.52 KB	-0.5%
hits_023.vortex	1.0	vortex-compact	142.56 MB	141.74 MB	835.95 KB	-0.6%
hits_010.vortex	1.0	vortex-file-compressed	170.05 MB	169.04 MB	1.01 MB	-0.6%
hits_004.vortex	1.0	vortex-compact	98.37 MB	97.75 MB	628.53 KB	-0.6%
hits_076.vortex	1.0	vortex-compact	125.04 MB	124.12 MB	942.91 KB	-0.7%
hits_039.vortex	1.0	vortex-compact	124.45 MB	123.49 MB	980.77 KB	-0.8%
hits_041.vortex	1.0	vortex-compact	97.88 MB	97.11 MB	786.67 KB	-0.8%
hits_090.vortex	1.0	vortex-compact	141.15 MB	140.04 MB	1.11 MB	-0.8%
hits_012.vortex	1.0	vortex-compact	139.87 MB	138.75 MB	1.12 MB	-0.8%
hits_013.vortex	1.0	vortex-compact	125.40 MB	124.38 MB	1.02 MB	-0.8%
hits_034.vortex	1.0	vortex-file-compressed	183.41 MB	181.80 MB	1.61 MB	-0.9%
hits_012.vortex	1.0	vortex-file-compressed	192.29 MB	190.45 MB	1.84 MB	-1.0%
hits_087.vortex	1.0	vortex-file-compressed	161.65 MB	160.08 MB	1.56 MB	-1.0%
hits_000.vortex	1.0	vortex-compact	99.04 MB	97.93 MB	1.10 MB	-1.1%
hits_090.vortex	1.0	vortex-file-compressed	195.39 MB	192.44 MB	2.95 MB	-1.5%
hits_006.vortex	1.0	vortex-compact	95.83 MB	94.11 MB	1.72 MB	-1.8%

Totals:

vortex-compact: 11.91 GB → 11.90 GB (-0.0%)
vortex-file-compressed: 15.96 GB → 15.97 GB (+0.1%)

github-actions · 2026-10-14T13:32:22Z

Benchmarks: FineWeb S3 📖

Commits: PR 85e620b1 vs base 73192765
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +2.0%
Engines: DataFusion No clear signal (+4.9%, environment too noisy confidence) · DuckDB No clear signal (-0.8%, environment too noisy confidence)
Vortex (geomean): hot 1.010x ➖ · cold 1.055x ➖
Parquet (geomean): hot 0.990x ➖ · cold 0.984x ➖
Shifts: Parquet (control) -1.0% · Median polish +0.3%

How to read Verdict and Engines

Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.943x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-file-compressed	66572098 / 68148322 / -2.3%	181192981 / 157470701 / +15.1%	0.37 / 0.43 / -15.1%
fineweb_q01/datafusion:vortex-file-compressed	501721714 / 707552498 / -29.1%	1214457622 / 857745836 / +41.6% 🔴	0.41 / 0.82 / -49.9%
fineweb_q02/datafusion:vortex-file-compressed	586105102 / 636077413 / -7.9%	856215963 / 887351301 / -3.5%	0.68 / 0.72 / -4.5%
fineweb_q03/datafusion:vortex-file-compressed	558789666 / 627195202 / -10.9%	864427285 / 1004919974 / -14.0%	0.65 / 0.62 / +3.6%
fineweb_q04/datafusion:vortex-file-compressed	463230312 / 579186030 / -20.0%	652187444 / 483395203 / +34.9% 🔴	0.71 / 1.20 / -40.7%
fineweb_q05/datafusion:vortex-file-compressed	639599440 / 549240653 / +16.5%	507793257 / 656844763 / -22.7%	1.26 / 0.84 / +50.6%
fineweb_q06/datafusion:vortex-file-compressed	951267726 / 797306664 / +19.3%	852265599 / 761252012 / +12.0%	1.12 / 1.05 / +6.6%
fineweb_q07/datafusion:vortex-file-compressed	590056158 / 663907166 / -11.1%	639186196 / 522627697 / +22.3%	0.92 / 1.27 / -27.3%
fineweb_q08/datafusion:vortex-file-compressed	269560610 / 257663738 / +4.6%	475555293 / 292016293 / +62.9% 🔴	0.57 / 0.88 / -35.8%

datafusion / vortex-compact / ns (1.076x ➖, 0↑ 2↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-compact	73036957 / 52017674 / +40.4% 🔴	175326192 / 133205224 / +31.6% 🔴	0.42 / 0.39 / +6.7%
fineweb_q01/datafusion:vortex-compact	500669625 / 570827864 / -12.3%	793843908 / 816724351 / -2.8%	0.63 / 0.70 / -9.8%
fineweb_q02/datafusion:vortex-compact	777806140 / 666197294 / +16.8%	606188036 / 593560577 / +2.1%	1.28 / 1.12 / +14.3%
fineweb_q03/datafusion:vortex-compact	624381310 / 607951582 / +2.7%	902045253 / 1082876014 / -16.7%	0.69 / 0.56 / +23.3%
fineweb_q04/datafusion:vortex-compact	482212804 / 560250648 / -13.9%	515468899 / 495039828 / +4.1%	0.94 / 1.13 / -17.3%
fineweb_q05/datafusion:vortex-compact	450622256 / 583076041 / -22.7%	504249282 / 616100917 / -18.2%	0.89 / 0.95 / -5.6%
fineweb_q06/datafusion:vortex-compact	1031681858 / 657330842 / +57.0% 🔴	821057332 / 654497542 / +25.4%	1.26 / 1.00 / +25.1%
fineweb_q07/datafusion:vortex-compact	545916254 / 519571402 / +5.1%	485168353 / 667750657 / -27.3%	1.13 / 0.78 / +44.6%
fineweb_q08/datafusion:vortex-compact	396937914 / 332621632 / +19.3%	722253575 / 280061958 / +157.9% 🔴	0.55 / 1.19 / -53.7%

datafusion / parquet / ns (0.960x ➖, 0↑ 1↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
fineweb_q00/datafusion:parquet	686036463 / 717743318 / -4.4%	994732985 / 932186807 / +6.7%	0.69 / 0.77 / -10.4%
fineweb_q01/datafusion:parquet	1062031206 / 1137541810 / -6.6%	1194782509 / 1136025480 / +5.2%	0.89 / 1.00 / -11.2%
fineweb_q02/datafusion:parquet	1787612140 / 1181100768 / +51.4% 🔴	1583830090 / 1609459261 / -1.6%	1.13 / 0.73 / +53.8%
fineweb_q03/datafusion:parquet	1116039338 / 1115970628 / +0.0%	1058232099 / 1399109025 / -24.4%	1.05 / 0.80 / +32.2%
fineweb_q04/datafusion:parquet	1068705368 / 1333512074 / -19.9%	1078784182 / 1319360383 / -18.2%	0.99 / 1.01 / -2.0%
fineweb_q05/datafusion:parquet	1187164640 / 1296989216 / -8.5%	1820938883 / 1487631768 / +22.4%	0.65 / 0.87 / -25.2%
fineweb_q06/datafusion:parquet	1143034573 / 1331098533 / -14.1%	1879161938 / 1345066164 / +39.7% 🔴	0.61 / 0.99 / -38.5%
fineweb_q07/datafusion:parquet	1140569452 / 1287535536 / -11.4%	1160402173 / 1830879367 / -36.6% 🟢	0.98 / 0.70 / +39.8%
fineweb_q08/datafusion:parquet	1190422455 / 1298183549 / -8.3%	1250910471 / 1385302985 / -9.7%	0.95 / 0.94 / +1.6%

duckdb / vortex-file-compressed / ns (1.022x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-file-compressed	73384334 / 74996100 / -2.1%	74937992 / 114927846 / -34.8% 🟢	0.98 / 0.65 / +50.1%
fineweb_q01/duckdb:vortex-file-compressed	517776376 / 505242738 / +2.5%	839129761 / 683875479 / +22.7%	0.62 / 0.74 / -16.5%
fineweb_q02/duckdb:vortex-file-compressed	657640454 / 635400104 / +3.5%	693431239 / 670105357 / +3.5%	0.95 / 0.95 / +0.0%
fineweb_q03/duckdb:vortex-file-compressed	1068200892 / 1042831016 / +2.4%	1361910763 / 1218580492 / +11.8%	0.78 / 0.86 / -8.3%
fineweb_q04/duckdb:vortex-file-compressed	1113452792 / 996957972 / +11.7%	1041980494 / 1015201808 / +2.6%	1.07 / 0.98 / +8.8%
fineweb_q05/duckdb:vortex-file-compressed	1007180678 / 1169783884 / -13.9%	1690161062 / 1369856199 / +23.4%	0.60 / 0.85 / -30.2%
fineweb_q06/duckdb:vortex-file-compressed	1500124118 / 1240001881 / +21.0%	1339275408 / 1251573660 / +7.0%	1.12 / 0.99 / +13.1%
fineweb_q07/duckdb:vortex-file-compressed	1026976312 / 1022836921 / +0.4%	1517172130 / 1052143257 / +44.2% 🔴	0.68 / 0.97 / -30.4%
fineweb_q08/duckdb:vortex-file-compressed	421240840 / 429029093 / -1.8%	467574144 / 499190912 / -6.3%	0.90 / 0.86 / +4.8%

duckdb / vortex-compact / ns (1.003x ➖, 0↑ 1↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-compact	91410900 / 68953440 / +32.6% 🔴	70042377 / 71065538 / -1.4%	1.31 / 0.97 / +34.5%
fineweb_q01/duckdb:vortex-compact	401212672 / 453745344 / -11.6%	620405519 / 469819783 / +32.1% 🔴	0.65 / 0.97 / -33.0%
fineweb_q02/duckdb:vortex-compact	591702439 / 580143558 / +2.0%	592549655 / 700971228 / -15.5%	1.00 / 0.83 / +20.7%
fineweb_q03/duckdb:vortex-compact	1095034166 / 1120253380 / -2.3%	1358422825 / 1441915501 / -5.8%	0.81 / 0.78 / +3.8%
fineweb_q04/duckdb:vortex-compact	1118106614 / 1176279238 / -4.9%	1146744213 / 1407090282 / -18.5%	0.98 / 0.84 / +16.6%
fineweb_q05/duckdb:vortex-compact	1123046150 / 922410010 / +21.8%	1016534371 / 1111910265 / -8.6%	1.10 / 0.83 / +33.2%
fineweb_q06/duckdb:vortex-compact	1121375420 / 1285757175 / -12.8%	1253556195 / 1278258224 / -1.9%	0.89 / 1.01 / -11.1%
fineweb_q07/duckdb:vortex-compact	958584460 / 986196164 / -2.8%	1007271508 / 1116652541 / -9.8%	0.95 / 0.88 / +7.8%
fineweb_q08/duckdb:vortex-compact	412383502 / 459269208 / -10.2%	473821231 / 545303676 / -13.1%	0.87 / 0.84 / +3.3%

duckdb / parquet / ns (1.021x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
fineweb_q00/duckdb:parquet	662711782 / 715050272 / -7.3%	771662849 / 854604419 / -9.7%	0.86 / 0.84 / +2.6%
fineweb_q01/duckdb:parquet	755197344 / 821089821 / -8.0%	926203550 / 742126542 / +24.8%	0.82 / 1.11 / -26.3%
fineweb_q02/duckdb:parquet	757891690 / 766880070 / -1.2%	773801141 / 791737851 / -2.3%	0.98 / 0.97 / +1.1%
fineweb_q03/duckdb:parquet	2060960928 / 1637545579 / +25.9%	1812361350 / 1704862999 / +6.3%	1.14 / 0.96 / +18.4%
fineweb_q04/duckdb:parquet	1030663068 / 929629440 / +10.9%	926253817 / 1002370633 / -7.6%	1.11 / 0.93 / +20.0%
fineweb_q05/duckdb:parquet	1136089804 / 1074767608 / +5.7%	1085769890 / 1102800677 / -1.5%	1.05 / 0.97 / +7.4%
fineweb_q06/duckdb:parquet	2203906414 / 2213363821 / -0.4%	2109938569 / 2386880412 / -11.6%	1.04 / 0.93 / +12.6%
fineweb_q07/duckdb:parquet	1384745089 / 1416001710 / -2.2%	1562633408 / 1652542109 / -5.4%	0.89 / 0.86 / +3.4%
fineweb_q08/duckdb:parquet	663484692 / 664074746 / -0.1%	760820704 / 609562531 / +24.8%	0.87 / 1.09 / -20.0%

github-actions · 2026-10-14T13:32:24Z

Benchmarks: Appian on NVME 📖

Commits: PR 85e620b1 vs base 73192765
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.0%
Engines: DataFusion No clear signal (+0.6%, low confidence) · DuckDB No clear signal (-0.7%, low confidence)
Vortex (geomean): hot 0.985x ➖ · cold 1.014x ➖
Parquet (geomean): hot 0.985x ➖ · cold 0.998x ➖
Shifts: Parquet (control) -1.5% · Median polish -1.3%

How to read Verdict and Engines

Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-compact / ns (0.979x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
appian_q01/datafusion:vortex-compact	52169764 / 52638768 / -0.9%	75549625 / 71879665 / +5.1%	0.69 / 0.73 / -5.7%
appian_q02/datafusion:vortex-compact	230444615 / 237733595 / -3.1%	274653923 / 265981967 / +3.3%	0.84 / 0.89 / -6.1%
appian_q03/datafusion:vortex-compact	144309310 / 148020962 / -2.5%	192799644 / 186343875 / +3.5%	0.75 / 0.79 / -5.8%
appian_q04/datafusion:vortex-compact	9642788420 / 9885412168 / -2.5%	9741360848 / 9751821557 / -0.1%	0.99 / 1.01 / -2.3%
appian_q05/datafusion:vortex-compact	135792012 / 137085060 / -0.9%	166079938 / 171673104 / -3.3%	0.82 / 0.80 / +2.4%
appian_q06/datafusion:vortex-compact	143986769 / 144996603 / -0.7%	167197714 / 169445009 / -1.3%	0.86 / 0.86 / +0.6%
appian_q07/datafusion:vortex-compact	162178531 / 166254831 / -2.5%	199938856 / 201891535 / -1.0%	0.81 / 0.82 / -1.5%
appian_q08/datafusion:vortex-compact	525228333 / 547720675 / -4.1%	594614092 / 582079529 / +2.2%	0.88 / 0.94 / -6.1%

datafusion / parquet / ns (0.973x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
appian_q01/datafusion:parquet	73112225 / 73225281 / -0.2%	94300888 / 97291691 / -3.1%	0.78 / 0.75 / +3.0%
appian_q02/datafusion:parquet	291872912 / 306371753 / -4.7%	335339868 / 335249462 / +0.0%	0.87 / 0.91 / -4.8%
appian_q03/datafusion:parquet	185994352 / 190411287 / -2.3%	227442631 / 226973686 / +0.2%	0.82 / 0.84 / -2.5%
appian_q04/datafusion:parquet	9673201384 / 9976523679 / -3.0%	9778627147 / 9816616398 / -0.4%	0.99 / 1.02 / -2.7%
appian_q05/datafusion:parquet	194536740 / 199477354 / -2.5%	225695917 / 223156565 / +1.1%	0.86 / 0.89 / -3.6%
appian_q06/datafusion:parquet	167951513 / 171579651 / -2.1%	189069723 / 192799261 / -1.9%	0.89 / 0.89 / -0.2%
appian_q07/datafusion:parquet	206712080 / 210463589 / -1.8%	244317220 / 245266805 / -0.4%	0.85 / 0.86 / -1.4%
appian_q08/datafusion:parquet	635060205 / 670315936 / -5.3%	705640712 / 695154491 / +1.5%	0.90 / 0.96 / -6.7%

duckdb / vortex-compact / ns (0.992x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
appian_q01/duckdb:vortex-compact	89961919 / 90093770 / -0.1%	105040528 / 105318133 / -0.3%	0.86 / 0.86 / +0.1%
appian_q02/duckdb:vortex-compact	214344323 / 212307894 / +1.0%	233873760 / 228376200 / +2.4%	0.92 / 0.93 / -1.4%
appian_q03/duckdb:vortex-compact	120573346 / 121564322 / -0.8%	138305380 / 144305457 / -4.2%	0.87 / 0.84 / +3.5%
appian_q04/duckdb:vortex-compact	569120373 / 579827205 / -1.8%	584692425 / 590900778 / -1.1%	0.97 / 0.98 / -0.8%
appian_q05/duckdb:vortex-compact	133825918 / 133586765 / +0.2%	156782650 / 151845888 / +3.3%	0.85 / 0.88 / -3.0%
appian_q06/duckdb:vortex-compact	391674831 / 408640987 / -4.2%	410332249 / 393735529 / +4.2%	0.95 / 1.04 / -8.0%
appian_q07/duckdb:vortex-compact	137137404 / 137618495 / -0.3%	174568540 / 155640488 / +12.2% 🔴	0.79 / 0.88 / -11.2%
appian_q08/duckdb:vortex-compact	423280770 / 424240098 / -0.2%	456688558 / 459770737 / -0.7%	0.93 / 0.92 / +0.4%

duckdb / parquet / ns (0.998x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
appian_q01/duckdb:parquet	98483054 / 99356440 / -0.9%	113925008 / 111293456 / +2.4%	0.86 / 0.89 / -3.2%
appian_q02/duckdb:parquet	197396352 / 197504279 / -0.1%	194913694 / 201034064 / -3.0%	1.01 / 0.98 / +3.1%
appian_q03/duckdb:parquet	123377611 / 123801324 / -0.3%	137509561 / 146802767 / -6.3%	0.90 / 0.84 / +6.4%
appian_q04/duckdb:parquet	446846861 / 458152898 / -2.5%	454902338 / 459386714 / -1.0%	0.98 / 1.00 / -1.5%
appian_q05/duckdb:parquet	142116372 / 142824899 / -0.5%	160033134 / 162822796 / -1.7%	0.89 / 0.88 / +1.2%
appian_q06/duckdb:parquet	261896114 / 257317213 / +1.8%	255363932 / 235505431 / +8.4%	1.03 / 1.09 / -6.1%
appian_q07/duckdb:parquet	153951837 / 154369024 / -0.3%	169511597 / 166895280 / +1.6%	0.91 / 0.92 / -1.8%
appian_q08/duckdb:parquet	380403662 / 374515317 / +1.6%	383872697 / 384792492 / -0.2%	0.99 / 0.97 / +1.8%

No file size changes detected.

github-actions · 2026-10-14T13:33:18Z

Benchmarks: Clickbench on NVME 📖

Commits: PR 85e620b1 vs base 73192765
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.6%
Engines: DataFusion No clear signal (+0.2%, low confidence) · DuckDB No clear signal (+1.0%, environment too noisy confidence)
Vortex (geomean): hot 1.001x ➖ · cold 1.010x ➖
Parquet (geomean): hot 0.995x ➖ · cold 1.005x ➖
Shifts: Parquet (control) -0.5% · Median polish -0.0%

How to read Verdict and Engines

Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.995x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
clickbench_q00/datafusion:vortex-file-compressed	1250137 / 1219744 / +2.5%	22124290 / 20898149 / +5.9%	0.06 / 0.06 / -3.2%
clickbench_q01/datafusion:vortex-file-compressed	5860036 / 5951636 / -1.5%	35529627 / 34123982 / +4.1%	0.16 / 0.17 / -5.4%
clickbench_q02/datafusion:vortex-file-compressed	10032498 / 10082474 / -0.5%	41021154 / 35542641 / +15.4% 🔴	0.24 / 0.28 / -13.8%
clickbench_q03/datafusion:vortex-file-compressed	11501607 / 11638326 / -1.2%	54175015 / 53917777 / +0.5%	0.21 / 0.22 / -1.6%
clickbench_q04/datafusion:vortex-file-compressed	56671211 / 56835908 / -0.3%	92136135 / 90823977 / +1.4%	0.62 / 0.63 / -1.7%
clickbench_q05/datafusion:vortex-file-compressed	74601240 / 74525257 / +0.1%	117147147 / 120226370 / -2.6%	0.64 / 0.62 / +2.7%
clickbench_q06/datafusion:vortex-file-compressed	1237104 / 1230938 / +0.5%	21447146 / 21025996 / +2.0%	0.06 / 0.06 / -1.5%
clickbench_q07/datafusion:vortex-file-compressed	9512766 / 9255309 / +2.8%	37554080 / 33454158 / +12.3% 🔴	0.25 / 0.28 / -8.4%
clickbench_q08/datafusion:vortex-file-compressed	76194446 / 76678632 / -0.6%	119118839 / 120486848 / -1.1%	0.64 / 0.64 / +0.5%
clickbench_q09/datafusion:vortex-file-compressed	171492704 / 171525484 / -0.0%	206089652 / 206946477 / -0.4%	0.83 / 0.83 / +0.4%
clickbench_q10/datafusion:vortex-file-compressed	23483371 / 23265460 / +0.9%	71112314 / 70451978 / +0.9%	0.33 / 0.33 / -0.0%
clickbench_q11/datafusion:vortex-file-compressed	25572846 / 25980960 / -1.6%	69093412 / 70552542 / -2.1%	0.37 / 0.37 / +0.5%
clickbench_q12/datafusion:vortex-file-compressed	74297631 / 73344366 / +1.3%	115558705 / 116635726 / -0.9%	0.64 / 0.63 / +2.2%
clickbench_q13/datafusion:vortex-file-compressed	116026096 / 119202017 / -2.7%	178012294 / 176955079 / +0.6%	0.65 / 0.67 / -3.2%
clickbench_q14/datafusion:vortex-file-compressed	73978306 / 75547030 / -2.1%	115675754 / 119695611 / -3.4%	0.64 / 0.63 / +1.3%
clickbench_q15/datafusion:vortex-file-compressed	61805970 / 60436725 / +2.3%	95973589 / 94554108 / +1.5%	0.64 / 0.64 / +0.8%
clickbench_q16/datafusion:vortex-file-compressed	146903036 / 148159440 / -0.8%	204027786 / 207976392 / -1.9%	0.72 / 0.71 / +1.1%
clickbench_q17/datafusion:vortex-file-compressed	148554396 / 149094295 / -0.4%	211421568 / 214159572 / -1.3%	0.70 / 0.70 / +0.9%
clickbench_q18/datafusion:vortex-file-compressed	296877596 / 299885324 / -1.0%	388215212 / 376310190 / +3.2%	0.76 / 0.80 / -4.0%
clickbench_q19/datafusion:vortex-file-compressed	7871074 / 8056185 / -2.3%	48711580 / 48400374 / +0.6%	0.16 / 0.17 / -2.9%
clickbench_q20/datafusion:vortex-file-compressed	63120436 / 63806222 / -1.1%	232129960 / 229000471 / +1.4%	0.27 / 0.28 / -2.4%
clickbench_q21/datafusion:vortex-file-compressed	91009707 / 93853676 / -3.0%	271904672 / 274427584 / -0.9%	0.33 / 0.34 / -2.1%
clickbench_q22/datafusion:vortex-file-compressed	99181168 / 99147835 / +0.0%	350547935 / 348033284 / +0.7%	0.28 / 0.28 / -0.7%
clickbench_q23/datafusion:vortex-file-compressed	178579490 / 188056590 / -5.0%	524203375 / 503822351 / +4.0%	0.34 / 0.37 / -8.7%
clickbench_q24/datafusion:vortex-file-compressed	15743007 / 16027560 / -1.8%	64779305 / 66670555 / -2.8%	0.24 / 0.24 / +1.1%
clickbench_q25/datafusion:vortex-file-compressed	17705592 / 17883608 / -1.0%	56648060 / 58447588 / -3.1%	0.31 / 0.31 / +2.1%
clickbench_q26/datafusion:vortex-file-compressed	16886754 / 15695131 / +7.6%	64540718 / 64855237 / -0.5%	0.26 / 0.24 / +8.1%
clickbench_q27/datafusion:vortex-file-compressed	98524766 / 99498846 / -1.0%	245094985 / 241101968 / +1.7%	0.40 / 0.41 / -2.6%
clickbench_q28/datafusion:vortex-file-compressed	556883627 / 564823066 / -1.4%	604875754 / 623477013 / -3.0%	0.92 / 0.91 / +1.6%
clickbench_q29/datafusion:vortex-file-compressed	22894866 / 23023526 / -0.6%	53305645 / 51092419 / +4.3%	0.43 / 0.45 / -4.7%
clickbench_q30/datafusion:vortex-file-compressed	57589418 / 56724670 / +1.5%	107443207 / 110785974 / -3.0%	0.54 / 0.51 / +4.7%
clickbench_q31/datafusion:vortex-file-compressed	67922905 / 68996672 / -1.6%	149509278 / 154341811 / -3.1%	0.45 / 0.45 / +1.6%
clickbench_q32/datafusion:vortex-file-compressed	283362533 / 300792454 / -5.8%	386340434 / 387490081 / -0.3%	0.73 / 0.78 / -5.5%
clickbench_q33/datafusion:vortex-file-compressed	324021450 / 325934472 / -0.6%	428415180 / 423150786 / +1.2%	0.76 / 0.77 / -1.8%
clickbench_q34/datafusion:vortex-file-compressed	317916400 / 331234072 / -4.0%	444969540 / 428145963 / +3.9%	0.71 / 0.77 / -7.6%
clickbench_q35/datafusion:vortex-file-compressed	55755819 / 54838436 / +1.7%	86924068 / 91457948 / -5.0%	0.64 / 0.60 / +7.0%
clickbench_q36/datafusion:vortex-file-compressed	37329430 / 37148290 / +0.5%	66233307 / 66331722 / -0.1%	0.56 / 0.56 / +0.6%
clickbench_q37/datafusion:vortex-file-compressed	21949250 / 21718082 / +1.1%	48040285 / 47849185 / +0.4%	0.46 / 0.45 / +0.7%
clickbench_q38/datafusion:vortex-file-compressed	11876193 / 11714336 / +1.4%	40550006 / 39583758 / +2.4%	0.29 / 0.30 / -1.0%
clickbench_q39/datafusion:vortex-file-compressed	78045193 / 78185420 / -0.2%	109928926 / 109915199 / +0.0%	0.71 / 0.71 / -0.2%
clickbench_q40/datafusion:vortex-file-compressed	11204869 / 11136459 / +0.6%	37017843 / 37047103 / -0.1%	0.30 / 0.30 / +0.7%
clickbench_q41/datafusion:vortex-file-compressed	10611158 / 11009957 / -3.6%	36357882 / 35173730 / +3.4%	0.29 / 0.31 / -6.8%
clickbench_q42/datafusion:vortex-file-compressed	11194176 / 11014398 / +1.6%	37158413 / 36858550 / +0.8%	0.30 / 0.30 / +0.8%

datafusion / vortex-compact / ns (0.993x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
clickbench_q00/datafusion:vortex-compact	1261154 / 1223126 / +3.1%	21722766 / 19990447 / +8.7%	0.06 / 0.06 / -5.1%
clickbench_q01/datafusion:vortex-compact	6106926 / 6240487 / -2.1%	33447876 / 33551696 / -0.3%	0.18 / 0.19 / -1.8%
clickbench_q02/datafusion:vortex-compact	12119926 / 12585771 / -3.7%	38944629 / 35389410 / +10.0% 🔴	0.31 / 0.36 / -12.5%
clickbench_q03/datafusion:vortex-compact	10719184 / 10788124 / -0.6%	38955322 / 38328601 / +1.6%	0.28 / 0.28 / -2.2%
clickbench_q04/datafusion:vortex-compact	55534057 / 56016731 / -0.9%	87809042 / 88479117 / -0.8%	0.63 / 0.63 / -0.1%
clickbench_q05/datafusion:vortex-compact	80733500 / 83018706 / -2.8%	127304225 / 120487016 / +5.7%	0.63 / 0.69 / -8.0%
clickbench_q06/datafusion:vortex-compact	1202267 / 1225445 / -1.9%	21464021 / 20542101 / +4.5%	0.06 / 0.06 / -6.1%
clickbench_q07/datafusion:vortex-compact	10029026 / 10071372 / -0.4%	38585546 / 34212856 / +12.8% 🔴	0.26 / 0.29 / -11.7%
clickbench_q08/datafusion:vortex-compact	81494229 / 77526454 / +5.1%	113387717 / 117275101 / -3.3%	0.72 / 0.66 / +8.7%
clickbench_q09/datafusion:vortex-compact	174674794 / 174055576 / +0.4%	206360185 / 203666946 / +1.3%	0.85 / 0.85 / -1.0%
clickbench_q10/datafusion:vortex-compact	26842744 / 26464504 / +1.4%	58294736 / 58679260 / -0.7%	0.46 / 0.45 / +2.1%
clickbench_q11/datafusion:vortex-compact	30842224 / 30823536 / +0.1%	62507256 / 60356837 / +3.6%	0.49 / 0.51 / -3.4%
clickbench_q12/datafusion:vortex-compact	80454308 / 79629726 / +1.0%	119439364 / 117457823 / +1.7%	0.67 / 0.68 / -0.6%
clickbench_q13/datafusion:vortex-compact	127543910 / 128545409 / -0.8%	186036214 / 186826442 / -0.4%	0.69 / 0.69 / -0.4%
clickbench_q14/datafusion:vortex-compact	83708948 / 83288944 / +0.5%	131486473 / 125373670 / +4.9%	0.64 / 0.66 / -4.2%
clickbench_q15/datafusion:vortex-compact	62015074 / 64907488 / -4.5%	95243006 / 94133550 / +1.2%	0.65 / 0.69 / -5.6%
clickbench_q16/datafusion:vortex-compact	159893656 / 159567600 / +0.2%	210488154 / 209960725 / +0.3%	0.76 / 0.76 / -0.0%
clickbench_q17/datafusion:vortex-compact	158179850 / 157813362 / +0.2%	212794701 / 223133017 / -4.6%	0.74 / 0.71 / +5.1%
clickbench_q18/datafusion:vortex-compact	282972856 / 288155622 / -1.8%	359072211 / 377556386 / -4.9%	0.79 / 0.76 / +3.3%
clickbench_q19/datafusion:vortex-compact	8301890 / 8362886 / -0.7%	40623750 / 38403562 / +5.8%	0.20 / 0.22 / -6.2%
clickbench_q20/datafusion:vortex-compact	71091656 / 72354280 / -1.7%	194687734 / 186044832 / +4.6%	0.37 / 0.39 / -6.1%
clickbench_q21/datafusion:vortex-compact	100279562 / 100383742 / -0.1%	230718885 / 227745010 / +1.3%	0.43 / 0.44 / -1.4%
clickbench_q22/datafusion:vortex-compact	142679355 / 142640832 / +0.0%	276859389 / 267447901 / +3.5%	0.52 / 0.53 / -3.4%
clickbench_q23/datafusion:vortex-compact	251323509 / 249199112 / +0.9%	404176231 / 399728841 / +1.1%	0.62 / 0.62 / -0.3%
clickbench_q24/datafusion:vortex-compact	21301980 / 21721194 / -1.9%	61015405 / 57682697 / +5.8%	0.35 / 0.38 / -7.3%
clickbench_q25/datafusion:vortex-compact	25931624 / 26089076 / -0.6%	59848938 / 61207597 / -2.2%	0.43 / 0.43 / +1.7%
clickbench_q26/datafusion:vortex-compact	22075822 / 22289258 / -1.0%	59819868 / 55889231 / +7.0%	0.37 / 0.40 / -7.5%
clickbench_q27/datafusion:vortex-compact	100657258 / 104610012 / -3.8%	211460803 / 210653870 / +0.4%	0.48 / 0.50 / -4.1%
clickbench_q28/datafusion:vortex-compact	585273510 / 585436906 / -0.0%	624217933 / 625037963 / -0.1%	0.94 / 0.94 / +0.1%
clickbench_q29/datafusion:vortex-compact	24670318 / 24744352 / -0.3%	51482361 / 51047162 / +0.9%	0.48 / 0.48 / -1.1%
clickbench_q30/datafusion:vortex-compact	74954302 / 76046448 / -1.4%	111061461 / 110635669 / +0.4%	0.67 / 0.69 / -1.8%
clickbench_q31/datafusion:vortex-compact	84717716 / 84047718 / +0.8%	146875471 / 147878542 / -0.7%	0.58 / 0.57 / +1.5%
clickbench_q32/datafusion:vortex-compact	283084683 / 305250953 / -7.3%	376182988 / 381548744 / -1.4%	0.75 / 0.80 / -5.9%
clickbench_q33/datafusion:vortex-compact	343482178 / 343827792 / -0.1%	422083812 / 419251608 / +0.7%	0.81 / 0.82 / -0.8%
clickbench_q34/datafusion:vortex-compact	335189022 / 339616826 / -1.3%	415555326 / 423950244 / -2.0%	0.81 / 0.80 / +0.7%
clickbench_q35/datafusion:vortex-compact	58675246 / 59061796 / -0.7%	88555948 / 86068966 / +2.9%	0.66 / 0.69 / -3.4%
clickbench_q36/datafusion:vortex-compact	38657672 / 38138146 / +1.4%	66910119 / 67330456 / -0.6%	0.58 / 0.57 / +2.0%
clickbench_q37/datafusion:vortex-compact	22466822 / 22628304 / -0.7%	49383628 / 47870308 / +3.2%	0.45 / 0.47 / -3.8%
clickbench_q38/datafusion:vortex-compact	12930516 / 13060590 / -1.0%	42030356 / 39392576 / +6.7%	0.31 / 0.33 / -7.2%
clickbench_q39/datafusion:vortex-compact	78461836 / 79088187 / -0.8%	109781620 / 110856201 / -1.0%	0.71 / 0.71 / +0.2%
clickbench_q40/datafusion:vortex-compact	12550606 / 12251446 / +2.4%	38776854 / 36712739 / +5.6%	0.32 / 0.33 / -3.0%
clickbench_q41/datafusion:vortex-compact	11592489 / 11643720 / -0.4%	35990320 / 34768652 / +3.5%	0.32 / 0.33 / -3.8%
clickbench_q42/datafusion:vortex-compact	10812658 / 11247456 / -3.9%	36863764 / 34455274 / +7.0%	0.29 / 0.33 / -10.1%

datafusion / parquet / ns (0.992x ➖, 1↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
clickbench_q00/datafusion:parquet	1240260 / 1273016 / -2.6%	51378383 / 50101105 / +2.5%	0.02 / 0.03 / -5.0%
clickbench_q01/datafusion:parquet	15947928 / 16351390 / -2.5%	75980484 / 74280552 / +2.3%	0.21 / 0.22 / -4.6%
clickbench_q02/datafusion:parquet	18535231 / 18754084 / -1.2%	86400427 / 83638417 / +3.3%	0.21 / 0.22 / -4.3%
clickbench_q03/datafusion:parquet	17095130 / 16344462 / +4.6%	85197482 / 81783456 / +4.2%	0.20 / 0.20 / +0.4%
clickbench_q04/datafusion:parquet	64234846 / 62869995 / +2.2%	135016029 / 129691605 / +4.1%	0.48 / 0.48 / -1.9%
clickbench_q05/datafusion:parquet	87936972 / 88482050 / -0.6%	159806731 / 160955983 / -0.7%	0.55 / 0.55 / +0.1%
clickbench_q06/datafusion:parquet	1243400 / 1276215 / -2.6%	52062132 / 50074581 / +4.0%	0.02 / 0.03 / -6.3%
clickbench_q07/datafusion:parquet	16681774 / 17004792 / -1.9%	71506973 / 70703255 / +1.1%	0.23 / 0.24 / -3.0%
clickbench_q08/datafusion:parquet	86154588 / 84470588 / +2.0%	169574783 / 168181455 / +0.8%	0.51 / 0.50 / +1.2%
clickbench_q09/datafusion:parquet	189412364 / 191806678 / -1.2%	277667882 / 279366926 / -0.6%	0.68 / 0.69 / -0.6%
clickbench_q10/datafusion:parquet	36158316 / 36014926 / +0.4%	104852574 / 101997030 / +2.8%	0.34 / 0.35 / -2.3%
clickbench_q11/datafusion:parquet	43772718 / 42926680 / +2.0%	115623363 / 117914879 / -1.9%	0.38 / 0.36 / +4.0%
clickbench_q12/datafusion:parquet	95212476 / 96715875 / -1.6%	165760210 / 164253884 / +0.9%	0.57 / 0.59 / -2.4%
clickbench_q13/datafusion:parquet	150186266 / 149141584 / +0.7%	232577465 / 234015896 / -0.6%	0.65 / 0.64 / +1.3%
clickbench_q14/datafusion:parquet	101595486 / 102050542 / -0.4%	180332385 / 175671061 / +2.7%	0.56 / 0.58 / -3.0%
clickbench_q15/datafusion:parquet	76906009 / 71925744 / +6.9%	136189589 / 135566171 / +0.5%	0.56 / 0.53 / +6.4%
clickbench_q16/datafusion:parquet	156148396 / 156331796 / -0.1%	240472882 / 238899632 / +0.7%	0.65 / 0.65 / -0.8%
clickbench_q17/datafusion:parquet	154851819 / 156046224 / -0.8%	242829663 / 240520697 / +1.0%	0.64 / 0.65 / -1.7%
clickbench_q18/datafusion:parquet	308034940 / 322443627 / -4.5%	424538500 / 429891917 / -1.2%	0.73 / 0.75 / -3.3%
clickbench_q19/datafusion:parquet	18929421 / 19049226 / -0.6%	81275463 / 78195998 / +3.9%	0.23 / 0.24 / -4.4%
clickbench_q20/datafusion:parquet	177299148 / 179349754 / -1.1%	304003296 / 300698175 / +1.1%	0.58 / 0.60 / -2.2%
clickbench_q21/datafusion:parquet	171786388 / 174020338 / -1.3%	320303212 / 314885493 / +1.7%	0.54 / 0.55 / -3.0%
clickbench_q22/datafusion:parquet	260153918 / 263774877 / -1.4%	456674570 / 460539093 / -0.8%	0.57 / 0.57 / -0.5%
clickbench_q23/datafusion:parquet	1012501848 / 1126524377 / -10.1% 🟢	1200397658 / 1246461720 / -3.7%	0.84 / 0.90 / -6.7%
clickbench_q24/datafusion:parquet	29866718 / 29978330 / -0.4%	92745471 / 92958200 / -0.2%	0.32 / 0.32 / -0.1%
clickbench_q25/datafusion:parquet	36394737 / 39155420 / -7.1%	106159245 / 105768550 / +0.4%	0.34 / 0.37 / -7.4%
clickbench_q26/datafusion:parquet	30685057 / 30955540 / -0.9%	93236943 / 94463776 / -1.3%	0.33 / 0.33 / +0.4%
clickbench_q27/datafusion:parquet	192751667 / 193230374 / -0.2%	302672022 / 305862753 / -1.0%	0.64 / 0.63 / +0.8%
clickbench_q28/datafusion:parquet	617347098 / 622919638 / -0.9%	705445794 / 712062495 / -0.9%	0.88 / 0.87 / +0.0%
clickbench_q29/datafusion:parquet	28658445 / 28780648 / -0.4%	97094004 / 93032775 / +4.4%	0.30 / 0.31 / -4.6%
clickbench_q30/datafusion:parquet	90497935 / 91418590 / -1.0%	179152192 / 174256592 / +2.8%	0.51 / 0.52 / -3.7%
clickbench_q31/datafusion:parquet	103401707 / 103073860 / +0.3%	209432366 / 200226077 / +4.6%	0.49 / 0.51 / -4.1%
clickbench_q32/datafusion:parquet	309349156 / 326149746 / -5.2%	432218722 / 429286489 / +0.7%	0.72 / 0.76 / -5.8%
clickbench_q33/datafusion:parquet	377536106 / 382322701 / -1.3%	482789040 / 484431642 / -0.3%	0.78 / 0.79 / -0.9%
clickbench_q34/datafusion:parquet	375419854 / 382856106 / -1.9%	477293485 / 482620213 / -1.1%	0.79 / 0.79 / -0.8%
clickbench_q35/datafusion:parquet	65097352 / 64436730 / +1.0%	124879694 / 129787222 / -3.8%	0.52 / 0.50 / +5.0%
clickbench_q36/datafusion:parquet	73595183 / 73294302 / +0.4%	138118750 / 136102901 / +1.5%	0.53 / 0.54 / -1.1%
clickbench_q37/datafusion:parquet	35550760 / 35376668 / +0.5%	94151954 / 92757297 / +1.5%	0.38 / 0.38 / -1.0%
clickbench_q38/datafusion:parquet	47465512 / 47547880 / -0.2%	109948658 / 108694731 / +1.2%	0.43 / 0.44 / -1.3%
clickbench_q39/datafusion:parquet	143833494 / 142867932 / +0.7%	214813752 / 212777291 / +1.0%	0.67 / 0.67 / -0.3%
clickbench_q40/datafusion:parquet	19894406 / 19975278 / -0.4%	78685214 / 78749855 / -0.1%	0.25 / 0.25 / -0.3%
clickbench_q41/datafusion:parquet	19079523 / 19055114 / +0.1%	77146109 / 75747314 / +1.8%	0.25 / 0.25 / -1.7%
clickbench_q42/datafusion:parquet	19523451 / 19406300 / +0.6%	77588737 / 74774693 / +3.8%	0.25 / 0.26 / -3.0%

duckdb / vortex-file-compressed / ns (1.009x ➖, 0↑ 3↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
clickbench_q00/duckdb:vortex-file-compressed	1810678 / 1577940 / +14.7% 🔴	28057204 / 28474728 / -1.5%	0.06 / 0.06 / +16.5%
clickbench_q01/duckdb:vortex-file-compressed	14485674 / 12490143 / +16.0% 🔴	31055242 / 28147424 / +10.3% 🔴	0.47 / 0.44 / +5.1%
clickbench_q02/duckdb:vortex-file-compressed	14688561 / 13220216 / +11.1% 🔴	33658748 / 32475164 / +3.6%	0.44 / 0.41 / +7.2%
clickbench_q03/duckdb:vortex-file-compressed	17914096 / 17134923 / +4.5%	52481029 / 49449333 / +6.1%	0.34 / 0.35 / -1.5%
clickbench_q04/duckdb:vortex-file-compressed	70481846 / 68187706 / +3.4%	107257195 / 106590264 / +0.6%	0.66 / 0.64 / +2.7%
clickbench_q05/duckdb:vortex-file-compressed	70052998 / 67950858 / +3.1%	98330902 / 93680502 / +5.0%	0.71 / 0.73 / -1.8%
clickbench_q06/duckdb:vortex-file-compressed	1949590 / 1888644 / +3.2%	29248680 / 28660983 / +2.1%	0.07 / 0.07 / +1.2%
clickbench_q07/duckdb:vortex-file-compressed	14484022 / 14339286 / +1.0%	33461844 / 36223256 / -7.6%	0.43 / 0.40 / +9.3%
clickbench_q08/duckdb:vortex-file-compressed	85016110 / 82013139 / +3.7%	137290733 / 133518693 / +2.8%	0.62 / 0.61 / +0.8%
clickbench_q09/duckdb:vortex-file-compressed	106473692 / 104750708 / +1.6%	146827992 / 150473495 / -2.4%	0.73 / 0.70 / +4.2%
clickbench_q10/duckdb:vortex-file-compressed	34593046 / 34232954 / +1.1%	70042785 / 71481797 / -2.0%	0.49 / 0.48 / +3.1%
clickbench_q11/duckdb:vortex-file-compressed	36005794 / 37321258 / -3.5%	74671081 / 76879321 / -2.9%	0.48 / 0.49 / -0.7%
clickbench_q12/duckdb:vortex-file-compressed	74308908 / 74589323 / -0.4%	109720418 / 111441987 / -1.5%	0.68 / 0.67 / +1.2%
clickbench_q13/duckdb:vortex-file-compressed	138922832 / 135538120 / +2.5%	183148433 / 181451442 / +0.9%	0.76 / 0.75 / +1.5%
clickbench_q14/duckdb:vortex-file-compressed	80301487 / 81577210 / -1.6%	111747662 / 109223883 / +2.3%	0.72 / 0.75 / -3.8%
clickbench_q15/duckdb:vortex-file-compressed	91926190 / 92073570 / -0.2%	129261140 / 137447943 / -6.0%	0.71 / 0.67 / +6.2%
clickbench_q16/duckdb:vortex-file-compressed	162208748 / 159985232 / +1.4%	208909169 / 211684380 / -1.3%	0.78 / 0.76 / +2.7%
clickbench_q17/duckdb:vortex-file-compressed	162823660 / 166977036 / -2.5%	217359432 / 214028420 / +1.6%	0.75 / 0.78 / -4.0%
clickbench_q18/duckdb:vortex-file-compressed	315128094 / 312991073 / +0.7%	383730750 / 401900373 / -4.5%	0.82 / 0.78 / +5.5%
clickbench_q19/duckdb:vortex-file-compressed	17440959 / 18814227 / -7.3%	45128874 / 42568502 / +6.0%	0.39 / 0.44 / -12.6%
clickbench_q20/duckdb:vortex-file-compressed	115832853 / 107948166 / +7.3%	195768943 / 192484017 / +1.7%	0.59 / 0.56 / +5.5%
clickbench_q21/duckdb:vortex-file-compressed	159926314 / 155220254 / +3.0%	303258001 / 303783890 / -0.2%	0.53 / 0.51 / +3.2%
clickbench_q22/duckdb:vortex-file-compressed	237852836 / 236473473 / +0.6%	470522591 / 477832980 / -1.5%	0.51 / 0.49 / +2.1%
clickbench_q23/duckdb:vortex-file-compressed	60351658 / 61060224 / -1.2%	108234511 / 97702644 / +10.8% 🔴	0.56 / 0.62 / -10.8%
clickbench_q24/duckdb:vortex-file-compressed	25422990 / 25419508 / +0.0%	48504000 / 49692534 / -2.4%	0.52 / 0.51 / +2.5%
clickbench_q25/duckdb:vortex-file-compressed	31456288 / 32386738 / -2.9%	53612025 / 56498116 / -5.1%	0.59 / 0.57 / +2.4%
clickbench_q26/duckdb:vortex-file-compressed	20418021 / 20446982 / -0.1%	39102269 / 40966929 / -4.6%	0.52 / 0.50 / +4.6%
clickbench_q27/duckdb:vortex-file-compressed	139417684 / 135940540 / +2.6%	252392452 / 251545987 / +0.3%	0.55 / 0.54 / +2.2%
clickbench_q28/duckdb:vortex-file-compressed	555652611 / 602865614 / -7.8%	678199355 / 703614783 / -3.6%	0.82 / 0.86 / -4.4%
clickbench_q29/duckdb:vortex-file-compressed	18044583 / 18843500 / -4.2%	37531618 / 39406139 / -4.8%	0.48 / 0.48 / +0.5%
clickbench_q30/duckdb:vortex-file-compressed	68556803 / 64687296 / +6.0%	111986710 / 115864182 / -3.3%	0.61 / 0.56 / +9.7%
clickbench_q31/duckdb:vortex-file-compressed	124593169 / 126099960 / -1.2%	209872329 / 210468123 / -0.3%	0.59 / 0.60 / -0.9%
clickbench_q32/duckdb:vortex-file-compressed	437473688 / 433763394 / +0.9%	480279620 / 486046470 / -1.2%	0.91 / 0.89 / +2.1%
clickbench_q33/duckdb:vortex-file-compressed	380953677 / 401744044 / -5.2%	505129180 / 518222576 / -2.5%	0.75 / 0.78 / -2.7%
clickbench_q34/duckdb:vortex-file-compressed	404649822 / 405341522 / -0.2%	545874532 / 546923672 / -0.2%	0.74 / 0.74 / +0.0%
clickbench_q35/duckdb:vortex-file-compressed	102213410 / 102299277 / -0.1%	141586770 / 140039200 / +1.1%	0.72 / 0.73 / -1.2%
clickbench_q36/duckdb:vortex-file-compressed	15291721 / 15134085 / +1.0%	33170463 / 32308006 / +2.7%	0.46 / 0.47 / -1.6%
clickbench_q37/duckdb:vortex-file-compressed	11503294 / 11976203 / -3.9%	27006855 / 26655462 / +1.3%	0.43 / 0.45 / -5.2%
clickbench_q38/duckdb:vortex-file-compressed	12852548 / 12528566 / +2.6%	29170922 / 27233541 / +7.1%	0.44 / 0.46 / -4.2%
clickbench_q39/duckdb:vortex-file-compressed	22436932 / 23193421 / -3.3%	41595914 / 42116799 / -1.2%	0.54 / 0.55 / -2.1%
clickbench_q40/duckdb:vortex-file-compressed	10459118 / 10905780 / -4.1%	27356654 / 28724790 / -4.8%	0.38 / 0.38 / +0.7%
clickbench_q41/duckdb:vortex-file-compressed	11279496 / 12042556 / -6.3%	31231249 / 25977068 / +20.2% 🔴	0.36 / 0.46 / -22.1%
clickbench_q42/duckdb:vortex-file-compressed	12856568 / 11961030 / +7.5%	27631678 / 27895976 / -0.9%	0.47 / 0.43 / +8.5%

duckdb / vortex-compact / ns (1.008x ➖, 1↑ 2↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
clickbench_q00/duckdb:vortex-compact	1799423 / 1672228 / +7.6%	23950812 / 22412868 / +6.9%	0.08 / 0.07 / +0.7%
clickbench_q01/duckdb:vortex-compact	12527821 / 15328448 / -18.3% 🟢	28494371 / 31062687 / -8.3%	0.44 / 0.49 / -10.9%
clickbench_q02/duckdb:vortex-compact	14573874 / 14466641 / +0.7%	34306196 / 30659606 / +11.9% 🔴	0.42 / 0.47 / -10.0%
clickbench_q03/duckdb:vortex-compact	17746656 / 17536448 / +1.2%	46552620 / 47666895 / -2.3%	0.38 / 0.37 / +3.6%
clickbench_q04/duckdb:vortex-compact	70626681 / 69950320 / +1.0%	103868863 / 105723530 / -1.8%	0.68 / 0.66 / +2.8%
clickbench_q05/duckdb:vortex-compact	74377607 / 73032538 / +1.8%	97778485 / 106413538 / -8.1%	0.76 / 0.69 / +10.8%
clickbench_q06/duckdb:vortex-compact	2039422 / 1872882 / +8.9%	27616280 / 30668868 / -10.0%	0.07 / 0.06 / +20.9%
clickbench_q07/duckdb:vortex-compact	17381364 / 14841141 / +17.1% 🔴	37011642 / 35991528 / +2.8%	0.47 / 0.41 / +13.9%
clickbench_q08/duckdb:vortex-compact	89830706 / 86958024 / +3.3%	137842687 / 130496804 / +5.6%	0.65 / 0.67 / -2.2%
clickbench_q09/duckdb:vortex-compact	127884080 / 121800432 / +5.0%	166422414 / 157688750 / +5.5%	0.77 / 0.77 / -0.5%
clickbench_q10/duckdb:vortex-compact	36628018 / 36012059 / +1.7%	74972686 / 72392077 / +3.6%	0.49 / 0.50 / -1.8%
clickbench_q11/duckdb:vortex-compact	39898414 / 39582756 / +0.8%	78796348 / 76696012 / +2.7%	0.51 / 0.52 / -1.9%
clickbench_q12/duckdb:vortex-compact	82168876 / 80341185 / +2.3%	117921508 / 114311079 / +3.2%	0.70 / 0.70 / -0.9%
clickbench_q13/duckdb:vortex-compact	152771584 / 157212955 / -2.8%	197030409 / 195332959 / +0.9%	0.78 / 0.80 / -3.7%
clickbench_q14/duckdb:vortex-compact	90764914 / 87702130 / +3.5%	125916253 / 119588984 / +5.3%	0.72 / 0.73 / -1.7%
clickbench_q15/duckdb:vortex-compact	94248408 / 92245210 / +2.2%	132739455 / 132340046 / +0.3%	0.71 / 0.70 / +1.9%
clickbench_q16/duckdb:vortex-compact	171175453 / 178127766 / -3.9%	240560597 / 221109676 / +8.8%	0.71 / 0.81 / -11.7%
clickbench_q17/duckdb:vortex-compact	172788872 / 189823952 / -9.0%	254470742 / 226986282 / +12.1% 🔴	0.68 / 0.84 / -18.8%
clickbench_q18/duckdb:vortex-compact	318386492 / 328612168 / -3.1%	384382680 / 388456135 / -1.0%	0.83 / 0.85 / -2.1%
clickbench_q19/duckdb:vortex-compact	17749052 / 15628163 / +13.6% 🔴	41177064 / 41228835 / -0.1%	0.43 / 0.38 / +13.7%
clickbench_q20/duckdb:vortex-compact	108619058 / 104623126 / +3.8%	174820586 / 172786892 / +1.2%	0.62 / 0.61 / +2.6%
clickbench_q21/duckdb:vortex-compact	158180940 / 159777820 / -1.0%	304466061 / 302854546 / +0.5%	0.52 / 0.53 / -1.5%
clickbench_q22/duckdb:vortex-compact	315940062 / 317607304 / -0.5%	519675651 / 525444641 / -1.1%	0.61 / 0.60 / +0.6%
clickbench_q23/duckdb:vortex-compact	67135974 / 64988584 / +3.3%	98853651 / 102824278 / -3.9%	0.68 / 0.63 / +7.5%
clickbench_q24/duckdb:vortex-compact	29261169 / 30760675 / -4.9%	50495108 / 48814610 / +3.4%	0.58 / 0.63 / -8.0%
clickbench_q25/duckdb:vortex-compact	37896566 / 37460654 / +1.2%	62015534 / 60695119 / +2.2%	0.61 / 0.62 / -1.0%
clickbench_q26/duckdb:vortex-compact	23100475 / 23241336 / -0.6%	37026401 / 41566244 / -10.9% 🟢	0.62 / 0.56 / +11.6%
clickbench_q27/duckdb:vortex-compact	194906660 / 182369681 / +6.9%	324213398 / 307802518 / +5.3%	0.60 / 0.59 / +1.5%
clickbench_q28/duckdb:vortex-compact	575995939 / 580393494 / -0.8%	705265896 / 728493834 / -3.2%	0.82 / 0.80 / +2.5%
clickbench_q29/duckdb:vortex-compact	19938828 / 19829117 / +0.6%	37579320 / 40373829 / -6.9%	0.53 / 0.49 / +8.0%
clickbench_q30/duckdb:vortex-compact	87719836 / 88632480 / -1.0%	131304471 / 129809134 / +1.2%	0.67 / 0.68 / -2.2%
clickbench_q31/duckdb:vortex-compact	148661980 / 148351160 / +0.2%	225302748 / 219379482 / +2.7%	0.66 / 0.68 / -2.4%
clickbench_q32/duckdb:vortex-compact	441326748 / 466836974 / -5.5%	481838469 / 546867630 / -11.9% 🟢	0.92 / 0.85 / +7.3%
clickbench_q33/duckdb:vortex-compact	384266292 / 395516561 / -2.8%	514756679 / 501719026 / +2.6%	0.75 / 0.79 / -5.3%
clickbench_q34/duckdb:vortex-compact	402390732 / 421263800 / -4.5%	534202286 / 534608754 / -0.1%	0.75 / 0.79 / -4.4%
clickbench_q35/duckdb:vortex-compact	105496736 / 101756868 / +3.7%	136097256 / 136766065 / -0.5%	0.78 / 0.74 / +4.2%
clickbench_q36/duckdb:vortex-compact	17213446 / 17378882 / -1.0%	34083772 / 31621649 / +7.8%	0.51 / 0.55 / -8.1%
clickbench_q37/duckdb:vortex-compact	14175013 / 13954359 / +1.6%	30310615 / 29898636 / +1.4%	0.47 / 0.47 / +0.2%
clickbench_q38/duckdb:vortex-compact	12739539 / 12680686 / +0.5%	29101186 / 27634209 / +5.3%	0.44 / 0.46 / -4.6%
clickbench_q39/duckdb:vortex-compact	24442386 / 23933226 / +2.1%	43877662 / 42115208 / +4.2%	0.56 / 0.57 / -2.0%
clickbench_q40/duckdb:vortex-compact	12231694 / 12697101 / -3.7%	29882995 / 29271043 / +2.1%	0.41 / 0.43 / -5.6%
clickbench_q41/duckdb:vortex-compact	12319198 / 11623556 / +6.0%	27770869 / 28531474 / -2.7%	0.44 / 0.41 / +8.9%
clickbench_q42/duckdb:vortex-compact	12229788 / 11787360 / +3.8%	29100131 / 28124907 / +3.5%	0.42 / 0.42 / +0.3%

duckdb / parquet / ns (0.998x ➖, 1↑ 1↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
clickbench_q00/duckdb:parquet	8407723 / 8788338 / -4.3%	19287346 / 19196421 / +0.5%	0.44 / 0.46 / -4.8%
clickbench_q01/duckdb:parquet	9634736 / 12271570 / -21.5% 🟢	22204622 / 22742187 / -2.4%	0.43 / 0.54 / -19.6%
clickbench_q02/duckdb:parquet	15999958 / 14940406 / +7.1%	32317274 / 31626593 / +2.2%	0.50 / 0.47 / +4.8%
clickbench_q03/duckdb:parquet	15577076 / 16220149 / -4.0%	53015842 / 53497130 / -0.9%	0.29 / 0.30 / -3.1%
clickbench_q04/duckdb:parquet	69395854 / 68759181 / +0.9%	96353182 / 91406258 / +5.4%	0.72 / 0.75 / -4.3%
clickbench_q05/duckdb:parquet	88168227 / 81823179 / +7.8%	116149186 / 133343912 / -12.9% 🟢	0.76 / 0.61 / +23.7%
clickbench_q06/duckdb:parquet	15520672 / 15596926 / -0.5%	25131984 / 23818853 / +5.5%	0.62 / 0.65 / -5.7%
clickbench_q07/duckdb:parquet	10942882 / 11509832 / -4.9%	23616867 / 22598569 / +4.5%	0.46 / 0.51 / -9.0%
clickbench_q08/duckdb:parquet	87267742 / 85026255 / +2.6%	133320718 / 131271318 / +1.6%	0.65 / 0.65 / +1.1%
clickbench_q09/duckdb:parquet	117036957 / 116381658 / +0.6%	161044647 / 162829560 / -1.1%	0.73 / 0.71 / +1.7%
clickbench_q10/duckdb:parquet	32748988 / 33082279 / -1.0%	68611638 / 69192842 / -0.8%	0.48 / 0.48 / -0.2%
clickbench_q11/duckdb:parquet	36948485 / 36764834 / +0.5%	77408060 / 76438606 / +1.3%	0.48 / 0.48 / -0.8%
clickbench_q12/duckdb:parquet	96060017 / 91910760 / +4.5%	141040643 / 128746778 / +9.5%	0.68 / 0.71 / -4.6%
clickbench_q13/duckdb:parquet	147146531 / 145849566 / +0.9%	207315778 / 211374156 / -1.9%	0.71 / 0.69 / +2.9%
clickbench_q14/duckdb:parquet	96555669 / 95947022 / +0.6%	142796352 / 150947435 / -5.4%	0.68 / 0.64 / +6.4%
clickbench_q15/duckdb:parquet	91934848 / 92315872 / -0.4%	127863254 / 127404935 / +0.4%	0.72 / 0.72 / -0.8%
clickbench_q16/duckdb:parquet	172430360 / 177572043 / -2.9%	225421433 / 229444137 / -1.8%	0.76 / 0.77 / -1.2%
clickbench_q17/duckdb:parquet	174591630 / 182058172 / -4.1%	233313087 / 236581764 / -1.4%	0.75 / 0.77 / -2.8%
clickbench_q18/duckdb:parquet	338769600 / 323369048 / +4.8%	419337388 / 408717400 / +2.6%	0.81 / 0.79 / +2.1%
clickbench_q19/duckdb:parquet	13820720 / 13645756 / +1.3%	42952933 / 44682300 / -3.9%	0.32 / 0.31 / +5.4%
clickbench_q20/duckdb:parquet	143929048 / 139739044 / +3.0%	245145220 / 245912680 / -0.3%	0.59 / 0.57 / +3.3%
clickbench_q21/duckdb:parquet	178185258 / 183219102 / -2.7%	322769226 / 325277789 / -0.8%	0.55 / 0.56 / -2.0%
clickbench_q22/duckdb:parquet	242677217 / 233721690 / +3.8%	409645775 / 415457697 / -1.4%	0.59 / 0.56 / +5.3%
clickbench_q23/duckdb:parquet	145229913 / 147520087 / -1.6%	166003281 / 169133840 / -1.9%	0.87 / 0.87 / +0.3%
clickbench_q24/duckdb:parquet	44566588 / 43702851 / +2.0%	62430099 / 65628527 / -4.9%	0.71 / 0.67 / +7.2%
clickbench_q25/duckdb:parquet	39530492 / 40491660 / -2.4%	99702669 / 95289227 / +4.6%	0.40 / 0.42 / -6.7%
clickbench_q26/duckdb:parquet	30304946 / 32171688 / -5.8%	55056413 / 46211542 / +19.1% 🔴	0.55 / 0.70 / -20.9%
clickbench_q27/duckdb:parquet	146122298 / 150154098 / -2.7%	255959774 / 255591012 / +0.1%	0.57 / 0.59 / -2.8%
clickbench_q28/duckdb:parquet	909505921 / 898686642 / +1.2%	1004155497 / 994650285 / +1.0%	0.91 / 0.90 / +0.2%
clickbench_q29/duckdb:parquet	19814156 / 17520934 / +13.1% 🔴	33936777 / 33994510 / -0.2%	0.58 / 0.52 / +13.3%
clickbench_q30/duckdb:parquet	95225545 / 93104784 / +2.3%	175083057 / 177154962 / -1.2%	0.54 / 0.53 / +3.5%
clickbench_q31/duckdb:parquet	146480728 / 144450549 / +1.4%	291328866 / 297338929 / -2.0%	0.50 / 0.49 / +3.5%
clickbench_q32/duckdb:parquet	466720908 / 478916114 / -2.5%	493935833 / 526962876 / -6.3%	0.94 / 0.91 / +4.0%
clickbench_q33/duckdb:parquet	464303977 / 467100960 / -0.6%	488141580 / 486374963 / +0.4%	0.95 / 0.96 / -1.0%
clickbench_q34/duckdb:parquet	469669966 / 453459934 / +3.6%	505786940 / 487468686 / +3.8%	0.93 / 0.93 / -0.2%
clickbench_q35/duckdb:parquet	103478591 / 100604618 / +2.9%	128572385 / 124563125 / +3.2%	0.80 / 0.81 / -0.4%
clickbench_q36/duckdb:parquet	31276478 / 31721434 / -1.4%	41279445 / 42099406 / -1.9%	0.76 / 0.75 / +0.6%
clickbench_q37/duckdb:parquet	22731964 / 22913839 / -0.8%	31384187 / 33078605 / -5.1%	0.72 / 0.69 / +4.6%
clickbench_q38/duckdb:parquet	24236310 / 24539734 / -1.2%	33513713 / 33476484 / +0.1%	0.72 / 0.73 / -1.3%
clickbench_q39/duckdb:parquet	56529270 / 57472412 / -1.6%	68310517 / 66862423 / +2.2%	0.83 / 0.86 / -3.7%
clickbench_q40/duckdb:parquet	13482928 / 12737212 / +5.9%	21934675 / 22819321 / -3.9%	0.61 / 0.56 / +10.1%
clickbench_q41/duckdb:parquet	12761982 / 13330372 / -4.3%	22212807 / 22380555 / -0.7%	0.57 / 0.60 / -3.5%
clickbench_q42/duckdb:parquet	14686342 / 15056239 / -2.5%	23610897 / 23933319 / -1.3%	0.62 / 0.63 / -1.1%

No file size changes detected.

github-actions · 2026-10-14T13:34:00Z

Benchmarks: TPC-DS SF=1 on NVME 📖

Commits: PR 85e620b1 vs base 73192765
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.4%
Engines: DataFusion No clear signal (+0.0%, low confidence) · DuckDB No clear signal (+0.7%, low confidence)
Vortex (geomean): hot 1.000x ➖ · cold 1.003x ➖
Parquet (geomean): hot 0.996x ➖ · cold 1.001x ➖
Shifts: Parquet (control) -0.4% · Median polish -0.0%

How to read Verdict and Engines

Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.997x ➖, 0↑ 1↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpcds_q01/datafusion:vortex-file-compressed	24501304 / 24036886 / +1.9%	43680797 / 43856075 / -0.4%	0.56 / 0.55 / +2.3%
tpcds_q02/datafusion:vortex-file-compressed	45212608 / 44782346 / +1.0%	64300615 / 62611457 / +2.7%	0.70 / 0.72 / -1.7%
tpcds_q03/datafusion:vortex-file-compressed	11398702 / 11767377 / -3.1%	29500872 / 28150607 / +4.8%	0.39 / 0.42 / -7.6%
tpcds_q04/datafusion:vortex-file-compressed	112495296 / 112244366 / +0.2%	143725702 / 142479862 / +0.9%	0.78 / 0.79 / -0.6%
tpcds_q05/datafusion:vortex-file-compressed	60109615 / 60136439 / -0.0%	81548317 / 83143570 / -1.9%	0.74 / 0.72 / +1.9%
tpcds_q06/datafusion:vortex-file-compressed	24027692 / 23689249 / +1.4%	48052263 / 46344840 / +3.7%	0.50 / 0.51 / -2.2%
tpcds_q07/datafusion:vortex-file-compressed	32629338 / 33441092 / -2.4%	57315663 / 58225537 / -1.6%	0.57 / 0.57 / -0.9%
tpcds_q08/datafusion:vortex-file-compressed	25334596 / 25527870 / -0.8%	44347267 / 46196259 / -4.0%	0.57 / 0.55 / +3.4%
tpcds_q09/datafusion:vortex-file-compressed	17566440 / 17267154 / +1.7%	36652957 / 35445218 / +3.4%	0.48 / 0.49 / -1.6%
tpcds_q10/datafusion:vortex-file-compressed	28858064 / 28819902 / +0.1%	50724756 / 50324304 / +0.8%	0.57 / 0.57 / -0.7%
tpcds_q11/datafusion:vortex-file-compressed	62214680 / 61439864 / +1.3%	91632574 / 88462985 / +3.6%	0.68 / 0.69 / -2.2%
tpcds_q12/datafusion:vortex-file-compressed	16125465 / 16616866 / -3.0%	34229519 / 33645122 / +1.7%	0.47 / 0.49 / -4.6%
tpcds_q13/datafusion:vortex-file-compressed	34388870 / 35184566 / -2.3%	55051978 / 55413499 / -0.7%	0.62 / 0.63 / -1.6%
tpcds_q14/datafusion:vortex-file-compressed	92846742 / 92173873 / +0.7%	120163749 / 119574416 / +0.5%	0.77 / 0.77 / +0.2%
tpcds_q15/datafusion:vortex-file-compressed	23944506 / 24174362 / -1.0%	45247892 / 44182579 / +2.4%	0.53 / 0.55 / -3.3%
tpcds_q16/datafusion:vortex-file-compressed	20369526 / 20689001 / -1.5%	42379857 / 42970050 / -1.4%	0.48 / 0.48 / -0.2%
tpcds_q17/datafusion:vortex-file-compressed	57249601 / 62340244 / -8.2%	84680077 / 84121181 / +0.7%	0.68 / 0.74 / -8.8%
tpcds_q18/datafusion:vortex-file-compressed	69434221 / 68321376 / +1.6%	94539859 / 96020813 / -1.5%	0.73 / 0.71 / +3.2%
tpcds_q19/datafusion:vortex-file-compressed	18863300 / 18758038 / +0.6%	40130991 / 39268733 / +2.2%	0.47 / 0.48 / -1.6%
tpcds_q20/datafusion:vortex-file-compressed	18170852 / 17780692 / +2.2%	37182493 / 36296016 / +2.4%	0.49 / 0.49 / -0.2%
tpcds_q21/datafusion:vortex-file-compressed	16904990 / 18140167 / -6.8%	40515526 / 39277627 / +3.2%	0.42 / 0.46 / -9.7%
tpcds_q22/datafusion:vortex-file-compressed	49461232 / 49945568 / -1.0%	72343638 / 71791149 / +0.8%	0.68 / 0.70 / -1.7%
tpcds_q23/datafusion:vortex-file-compressed	71925143 / 73364104 / -2.0%	100784752 / 99858341 / +0.9%	0.71 / 0.73 / -2.9%
tpcds_q24/datafusion:vortex-file-compressed	70911364 / 70136836 / +1.1%	95777577 / 93862790 / +2.0%	0.74 / 0.75 / -0.9%
tpcds_q25/datafusion:vortex-file-compressed	53483276 / 57126758 / -6.4%	82021370 / 86520624 / -5.2%	0.65 / 0.66 / -1.2%
tpcds_q26/datafusion:vortex-file-compressed	30499844 / 30686860 / -0.6%	52018902 / 50887559 / +2.2%	0.59 / 0.60 / -2.8%
tpcds_q27/datafusion:vortex-file-compressed	62665477 / 62865187 / -0.3%	95439619 / 85241770 / +12.0% 🔴	0.66 / 0.74 / -11.0%
tpcds_q28/datafusion:vortex-file-compressed	18526486 / 18226518 / +1.6%	37769730 / 40200486 / -6.0%	0.49 / 0.45 / +8.2%
tpcds_q29/datafusion:vortex-file-compressed	60424327 / 54086604 / +11.7% 🔴	76745828 / 77896026 / -1.5%	0.79 / 0.69 / +13.4%
tpcds_q30/datafusion:vortex-file-compressed	27634830 / 27349854 / +1.0%	46925378 / 45850480 / +2.3%	0.59 / 0.60 / -1.3%
tpcds_q31/datafusion:vortex-file-compressed	64513242 / 64849940 / -0.5%	93294911 / 91132090 / +2.4%	0.69 / 0.71 / -2.8%
tpcds_q32/datafusion:vortex-file-compressed	13691436 / 13680980 / +0.1%	31687605 / 31570547 / +0.4%	0.43 / 0.43 / -0.3%
tpcds_q33/datafusion:vortex-file-compressed	27804371 / 27287963 / +1.9%	50595706 / 49043479 / +3.2%	0.55 / 0.56 / -1.2%
tpcds_q34/datafusion:vortex-file-compressed	18717419 / 19049715 / -1.7%	37451838 / 39007329 / -4.0%	0.50 / 0.49 / +2.3%
tpcds_q35/datafusion:vortex-file-compressed	35416471 / 35747150 / -0.9%	58787510 / 58370834 / +0.7%	0.60 / 0.61 / -1.6%
tpcds_q36/datafusion:vortex-file-compressed	48527154 / 48804262 / -0.6%	70922369 / 70794090 / +0.2%	0.68 / 0.69 / -0.7%
tpcds_q37/datafusion:vortex-file-compressed	13303742 / 14510826 / -8.3%	35981583 / 34760905 / +3.5%	0.37 / 0.42 / -11.4%
tpcds_q38/datafusion:vortex-file-compressed	30362972 / 30220856 / +0.5%	53000172 / 52664749 / +0.6%	0.57 / 0.57 / -0.2%
tpcds_q39/datafusion:vortex-file-compressed	66133844 / 65734139 / +0.6%	90961698 / 93938880 / -3.2%	0.73 / 0.70 / +3.9%
tpcds_q40/datafusion:vortex-file-compressed	24717847 / 25193289 / -1.9%	46600801 / 46566663 / +0.1%	0.53 / 0.54 / -2.0%
tpcds_q41/datafusion:vortex-file-compressed	16933830 / 16929711 / +0.0%	31848764 / 31546159 / +1.0%	0.53 / 0.54 / -0.9%
tpcds_q42/datafusion:vortex-file-compressed	11319904 / 11334468 / -0.1%	28055727 / 28961158 / -3.1%	0.40 / 0.39 / +3.1%
tpcds_q43/datafusion:vortex-file-compressed	13668325 / 13841110 / -1.2%	33109456 / 33119311 / -0.0%	0.41 / 0.42 / -1.2%
tpcds_q44/datafusion:vortex-file-compressed	26416819 / 26621594 / -0.8%	50933970 / 51819458 / -1.7%	0.52 / 0.51 / +1.0%
tpcds_q45/datafusion:vortex-file-compressed	27672976 / 27814933 / -0.5%	49540453 / 47340517 / +4.6%	0.56 / 0.59 / -4.9%
tpcds_q46/datafusion:vortex-file-compressed	24809724 / 25072276 / -1.0%	49927551 / 48203035 / +3.6%	0.50 / 0.52 / -4.5%
tpcds_q47/datafusion:vortex-file-compressed	78909610 / 78934154 / -0.0%	108657408 / 109336899 / -0.6%	0.73 / 0.72 / +0.6%
tpcds_q48/datafusion:vortex-file-compressed	32326150 / 31712340 / +1.9%	53762931 / 51886589 / +3.6%	0.60 / 0.61 / -1.6%
tpcds_q49/datafusion:vortex-file-compressed	59360398 / 59310108 / +0.1%	82417525 / 84450330 / -2.4%	0.72 / 0.70 / +2.6%
tpcds_q50/datafusion:vortex-file-compressed	34715956 / 33987556 / +2.1%	56602471 / 55175670 / +2.6%	0.61 / 0.62 / -0.4%
tpcds_q51/datafusion:vortex-file-compressed	61003054 / 60580130 / +0.7%	84915185 / 84467169 / +0.5%	0.72 / 0.72 / +0.2%
tpcds_q52/datafusion:vortex-file-compressed	11852324 / 11911980 / -0.5%	29486068 / 28710391 / +2.7%	0.40 / 0.41 / -3.1%
tpcds_q53/datafusion:vortex-file-compressed	18736024 / 18957412 / -1.2%	40918901 / 40510501 / +1.0%	0.46 / 0.47 / -2.2%
tpcds_q54/datafusion:vortex-file-compressed	33660688 / 34774764 / -3.2%	60949145 / 60261684 / +1.1%	0.55 / 0.58 / -4.3%
tpcds_q55/datafusion:vortex-file-compressed	11719422 / 11398825 / +2.8%	28937010 / 27744782 / +4.3%	0.40 / 0.41 / -1.4%
tpcds_q56/datafusion:vortex-file-compressed	26711423 / 26832202 / -0.5%	49597510 / 49548613 / +0.1%	0.54 / 0.54 / -0.5%
tpcds_q57/datafusion:vortex-file-compressed	73833304 / 73251800 / +0.8%	99432788 / 98795273 / +0.6%	0.74 / 0.74 / +0.1%
tpcds_q58/datafusion:vortex-file-compressed	40433687 / 40436294 / -0.0%	67087833 / 69529739 / -3.5%	0.60 / 0.58 / +3.6%
tpcds_q59/datafusion:vortex-file-compressed	32328385 / 32248820 / +0.2%	53302225 / 53347253 / -0.1%	0.61 / 0.60 / +0.3%
tpcds_q60/datafusion:vortex-file-compressed	26960094 / 26877634 / +0.3%	50722890 / 49559281 / +2.3%	0.53 / 0.54 / -2.0%
tpcds_q61/datafusion:vortex-file-compressed	25368117 / 24809994 / +2.2%	48516885 / 47109758 / +3.0%	0.52 / 0.53 / -0.7%
tpcds_q62/datafusion:vortex-file-compressed	17116704 / 17268876 / -0.9%	36598171 / 36037516 / +1.6%	0.47 / 0.48 / -2.4%
tpcds_q63/datafusion:vortex-file-compressed	18606020 / 18897132 / -1.5%	40992202 / 40753231 / +0.6%	0.45 / 0.46 / -2.1%
tpcds_q64/datafusion:vortex-file-compressed	317663047 / 328104382 / -3.2%	353988163 / 362110625 / -2.2%	0.90 / 0.91 / -1.0%
tpcds_q65/datafusion:vortex-file-compressed	75358801 / 75949268 / -0.8%	95271026 / 94791666 / +0.5%	0.79 / 0.80 / -1.3%
tpcds_q66/datafusion:vortex-file-compressed	53050232 / 52649601 / +0.8%	76699132 / 76043122 / +0.9%	0.69 / 0.69 / -0.1%
tpcds_q67/datafusion:vortex-file-compressed	55896190 / 55543936 / +0.6%	86528363 / 87490867 / -1.1%	0.65 / 0.63 / +1.8%
tpcds_q68/datafusion:vortex-file-compressed	24328151 / 24198535 / +0.5%	49460498 / 50500500 / -2.1%	0.49 / 0.48 / +2.6%
tpcds_q69/datafusion:vortex-file-compressed	28679307 / 28398726 / +1.0%	48624569 / 51201972 / -5.0%	0.59 / 0.55 / +6.3%
tpcds_q70/datafusion:vortex-file-compressed	71816042 / 71158950 / +0.9%	94072590 / 93092953 / +1.1%	0.76 / 0.76 / -0.1%
tpcds_q71/datafusion:vortex-file-compressed	20127166 / 19908217 / +1.1%	40465857 / 40699698 / -0.6%	0.50 / 0.49 / +1.7%
tpcds_q72/datafusion:vortex-file-compressed	463683367 / 456575822 / +1.6%	494298716 / 503892248 / -1.9%	0.94 / 0.91 / +3.5%
tpcds_q73/datafusion:vortex-file-compressed	17875824 / 17539448 / +1.9%	37996719 / 38604171 / -1.6%	0.47 / 0.45 / +3.5%
tpcds_q74/datafusion:vortex-file-compressed	45375485 / 45502597 / -0.3%	71312081 / 70600096 / +1.0%	0.64 / 0.64 / -1.3%
tpcds_q75/datafusion:vortex-file-compressed	131183795 / 130686829 / +0.4%	165442156 / 170304329 / -2.9%	0.79 / 0.77 / +3.3%
tpcds_q76/datafusion:vortex-file-compressed	42001504 / 42711866 / -1.7%	64840804 / 62683121 / +3.4%	0.65 / 0.68 / -4.9%
tpcds_q77/datafusion:vortex-file-compressed	35713656 / 35881277 / -0.5%	59638240 / 61700088 / -3.3%	0.60 / 0.58 / +3.0%
tpcds_q78/datafusion:vortex-file-compressed	79676104 / 79763034 / -0.1%	111801882 / 112774259 / -0.9%	0.71 / 0.71 / +0.8%
tpcds_q79/datafusion:vortex-file-compressed	22223818 / 21427481 / +3.7%	43550250 / 44644991 / -2.5%	0.51 / 0.48 / +6.3%
tpcds_q80/datafusion:vortex-file-compressed	77442093 / 78823956 / -1.8%	108736963 / 109100079 / -0.3%	0.71 / 0.72 / -1.4%
tpcds_q81/datafusion:vortex-file-compressed	27915921 / 27958933 / -0.2%	46374676 / 46178710 / +0.4%	0.60 / 0.61 / -0.6%
tpcds_q82/datafusion:vortex-file-compressed	13667208 / 14195082 / -3.7%	36447380 / 36180811 / +0.7%	0.37 / 0.39 / -4.4%
tpcds_q83/datafusion:vortex-file-compressed	37007348 / 36688943 / +0.9%	60231721 / 60117111 / +0.2%	0.61 / 0.61 / +0.7%
tpcds_q84/datafusion:vortex-file-compressed	12051986 / 12497494 / -3.6%	29141612 / 29522430 / -1.3%	0.41 / 0.42 / -2.3%
tpcds_q85/datafusion:vortex-file-compressed	59542816 / 60226538 / -1.1%	86279581 / 88326510 / -2.3%	0.69 / 0.68 / +1.2%
tpcds_q86/datafusion:vortex-file-compressed	16458478 / 16533467 / -0.5%	33943687 / 32595790 / +4.1%	0.48 / 0.51 / -4.4%
tpcds_q87/datafusion:vortex-file-compressed	29507432 / 29920028 / -1.4%	53392735 / 51943923 / +2.8%	0.55 / 0.58 / -4.1%
tpcds_q88/datafusion:vortex-file-compressed	34495290 / 34482722 / +0.0%	60458823 / 63176670 / -4.3%	0.57 / 0.55 / +4.5%
tpcds_q89/datafusion:vortex-file-compressed	21291309 / 21370606 / -0.4%	41431749 / 41167955 / +0.6%	0.51 / 0.52 / -1.0%
tpcds_q90/datafusion:vortex-file-compressed	10383342 / 10616718 / -2.2%	26846155 / 26553893 / +1.1%	0.39 / 0.40 / -3.3%
tpcds_q91/datafusion:vortex-file-compressed	16928740 / 16784542 / +0.9%	37083248 / 36153184 / +2.6%	0.46 / 0.46 / -1.7%
tpcds_q92/datafusion:vortex-file-compressed	13567314 / 13598996 / -0.2%	32410782 / 31841768 / +1.8%	0.42 / 0.43 / -2.0%
tpcds_q93/datafusion:vortex-file-compressed	23819454 / 23566924 / +1.1%	45931887 / 46182873 / -0.5%	0.52 / 0.51 / +1.6%
tpcds_q94/datafusion:vortex-file-compressed	19691250 / 19611700 / +0.4%	40792441 / 41083114 / -0.7%	0.48 / 0.48 / +1.1%
tpcds_q95/datafusion:vortex-file-compressed	45710785 / 46240312 / -1.1%	68766001 / 68439527 / +0.5%	0.66 / 0.68 / -1.6%
tpcds_q96/datafusion:vortex-file-compressed	9723124 / 9552176 / +1.8%	26057495 / 25856624 / +0.8%	0.37 / 0.37 / +1.0%
tpcds_q97/datafusion:vortex-file-compressed	21241389 / 21226587 / +0.1%	44397610 / 43312688 / +2.5%	0.48 / 0.49 / -2.4%
tpcds_q98/datafusion:vortex-file-compressed	16987358 / 16884472 / +0.6%	37502826 / 37216645 / +0.8%	0.45 / 0.45 / -0.2%
tpcds_q99/datafusion:vortex-file-compressed	19502489 / 19648656 / -0.7%	39367061 / 37913354 / +3.8%	0.50 / 0.52 / -4.4%

datafusion / vortex-compact / ns (0.999x ➖, 1↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpcds_q01/datafusion:vortex-compact	26268948 / 26285238 / -0.1%	44657042 / 45693879 / -2.3%	0.59 / 0.58 / +2.3%
tpcds_q02/datafusion:vortex-compact	45312738 / 45451704 / -0.3%	62484623 / 64059564 / -2.5%	0.73 / 0.71 / +2.2%
tpcds_q03/datafusion:vortex-compact	12771913 / 12320965 / +3.7%	33566402 / 33111028 / +1.4%	0.38 / 0.37 / +2.3%
tpcds_q04/datafusion:vortex-compact	120228576 / 121052896 / -0.7%	148566311 / 147261303 / +0.9%	0.81 / 0.82 / -1.6%
tpcds_q05/datafusion:vortex-compact	61237358 / 61417792 / -0.3%	83581625 / 84705834 / -1.3%	0.73 / 0.73 / +1.0%
tpcds_q06/datafusion:vortex-compact	24737588 / 24347934 / +1.6%	46587436 / 46476090 / +0.2%	0.53 / 0.52 / +1.4%
tpcds_q07/datafusion:vortex-compact	32661761 / 32299330 / +1.1%	54281370 / 53505337 / +1.5%	0.60 / 0.60 / -0.3%
tpcds_q08/datafusion:vortex-compact	28510929 / 28748718 / -0.8%	49257956 / 48743311 / +1.1%	0.58 / 0.59 / -1.9%
tpcds_q09/datafusion:vortex-compact	22391502 / 22341035 / +0.2%	40471074 / 40222881 / +0.6%	0.55 / 0.56 / -0.4%
tpcds_q10/datafusion:vortex-compact	32070796 / 32545858 / -1.5%	56944097 / 56036810 / +1.6%	0.56 / 0.58 / -3.0%
tpcds_q11/datafusion:vortex-compact	65371600 / 63459730 / +3.0%	92852305 / 88790745 / +4.6%	0.70 / 0.71 / -1.5%
tpcds_q12/datafusion:vortex-compact	20596374 / 20998772 / -1.9%	39919126 / 39388459 / +1.3%	0.52 / 0.53 / -3.2%
tpcds_q13/datafusion:vortex-compact	47871072 / 46995217 / +1.9%	67752390 / 68309477 / -0.8%	0.71 / 0.69 / +2.7%
tpcds_q14/datafusion:vortex-compact	94108178 / 95494294 / -1.5%	122663470 / 120802980 / +1.5%	0.77 / 0.79 / -2.9%
tpcds_q15/datafusion:vortex-compact	25943006 / 26760680 / -3.1%	46676977 / 45986689 / +1.5%	0.56 / 0.58 / -4.5%
tpcds_q16/datafusion:vortex-compact	21854174 / 22249596 / -1.8%	41633621 / 41450012 / +0.4%	0.52 / 0.54 / -2.2%
tpcds_q17/datafusion:vortex-compact	56723089 / 60761922 / -6.6%	78760714 / 81879889 / -3.8%	0.72 / 0.74 / -2.9%
tpcds_q18/datafusion:vortex-compact	66180409 / 66113808 / +0.1%	91121369 / 88879835 / +2.5%	0.73 / 0.74 / -2.4%
tpcds_q19/datafusion:vortex-compact	20935341 / 19829522 / +5.6%	43179875 / 41315262 / +4.5%	0.48 / 0.48 / +1.0%
tpcds_q20/datafusion:vortex-compact	21467346 / 22268879 / -3.6%	41724958 / 42283042 / -1.3%	0.51 / 0.53 / -2.3%
tpcds_q21/datafusion:vortex-compact	18286008 / 17910834 / +2.1%	42848749 / 43187840 / -0.8%	0.43 / 0.41 / +2.9%
tpcds_q22/datafusion:vortex-compact	50141288 / 50309306 / -0.3%	72562742 / 75321716 / -3.7%	0.69 / 0.67 / +3.5%
tpcds_q23/datafusion:vortex-compact	74688902 / 74190547 / +0.7%	101921030 / 106391412 / -4.2%	0.73 / 0.70 / +5.1%
tpcds_q24/datafusion:vortex-compact	73035226 / 73946849 / -1.2%	98857991 / 96553086 / +2.4%	0.74 / 0.77 / -3.5%
tpcds_q25/datafusion:vortex-compact	55079163 / 51777004 / +6.4%	84830383 / 86436007 / -1.9%	0.65 / 0.60 / +8.4%
tpcds_q26/datafusion:vortex-compact	30727554 / 30779783 / -0.2%	49678695 / 50602421 / -1.8%	0.62 / 0.61 / +1.7%
tpcds_q27/datafusion:vortex-compact	59105248 / 59598935 / -0.8%	90618338 / 83946811 / +7.9%	0.65 / 0.71 / -8.1%
tpcds_q28/datafusion:vortex-compact	29782496 / 28584918 / +4.2%	50981685 / 50007329 / +1.9%	0.58 / 0.57 / +2.2%
tpcds_q29/datafusion:vortex-compact	59581972 / 55814528 / +6.7%	81953835 / 82947691 / -1.2%	0.73 / 0.67 / +8.0%
tpcds_q30/datafusion:vortex-compact	30797216 / 30387726 / +1.3%	49314948 / 49437941 / -0.2%	0.62 / 0.61 / +1.6%
tpcds_q31/datafusion:vortex-compact	69698324 / 69254052 / +0.6%	99427328 / 101270092 / -1.8%	0.70 / 0.68 / +2.5%
tpcds_q32/datafusion:vortex-compact	15420508 / 15258333 / +1.1%	33711211 / 34299876 / -1.7%	0.46 / 0.44 / +2.8%
tpcds_q33/datafusion:vortex-compact	27425802 / 26470078 / +3.6%	50233166 / 49621563 / +1.2%	0.55 / 0.53 / +2.3%
tpcds_q34/datafusion:vortex-compact	19738804 / 18598597 / +6.1%	38114345 / 37605650 / +1.4%	0.52 / 0.49 / +4.7%
tpcds_q35/datafusion:vortex-compact	37563102 / 38543807 / -2.5%	63392905 / 63291120 / +0.2%	0.59 / 0.61 / -2.7%
tpcds_q36/datafusion:vortex-compact	50460315 / 49365422 / +2.2%	76468360 / 77641773 / -1.5%	0.66 / 0.64 / +3.8%
tpcds_q37/datafusion:vortex-compact	16377345 / 15507473 / +5.6%	41365058 / 38520499 / +7.4%	0.40 / 0.40 / -1.7%
tpcds_q38/datafusion:vortex-compact	29593572 / 30175090 / -1.9%	54633470 / 53294074 / +2.5%	0.54 / 0.57 / -4.3%
tpcds_q39/datafusion:vortex-compact	65724610 / 66163852 / -0.7%	89989708 / 90553752 / -0.6%	0.73 / 0.73 / -0.0%
tpcds_q40/datafusion:vortex-compact	26759484 / 27308790 / -2.0%	51311893 / 50840156 / +0.9%	0.52 / 0.54 / -2.9%
tpcds_q41/datafusion:vortex-compact	19196588 / 19074176 / +0.6%	33500642 / 33090210 / +1.2%	0.57 / 0.58 / -0.6%
tpcds_q42/datafusion:vortex-compact	11794512 / 11945520 / -1.3%	33218825 / 33027192 / +0.6%	0.36 / 0.36 / -1.8%
tpcds_q43/datafusion:vortex-compact	14172414 / 13861348 / +2.2%	33486726 / 32929110 / +1.7%	0.42 / 0.42 / +0.5%
tpcds_q44/datafusion:vortex-compact	27220662 / 27464482 / -0.9%	51329388 / 54543409 / -5.9%	0.53 / 0.50 / +5.3%
tpcds_q45/datafusion:vortex-compact	30774201 / 30851345 / -0.3%	51394874 / 50833391 / +1.1%	0.60 / 0.61 / -1.3%
tpcds_q46/datafusion:vortex-compact	26317824 / 25100433 / +4.9%	48891959 / 46864863 / +4.3%	0.54 / 0.54 / +0.5%
tpcds_q47/datafusion:vortex-compact	83558872 / 83479984 / +0.1%	114266487 / 111752449 / +2.2%	0.73 / 0.75 / -2.1%
tpcds_q48/datafusion:vortex-compact	43176148 / 49422300 / -12.6% 🟢	64733814 / 63628271 / +1.7%	0.67 / 0.78 / -14.1%
tpcds_q49/datafusion:vortex-compact	63896576 / 63850746 / +0.1%	92779310 / 88725201 / +4.6%	0.69 / 0.72 / -4.3%
tpcds_q50/datafusion:vortex-compact	34329438 / 34087679 / +0.7%	56160211 / 56061841 / +0.2%	0.61 / 0.61 / +0.5%
tpcds_q51/datafusion:vortex-compact	61836068 / 61991887 / -0.3%	85922623 / 86315237 / -0.5%	0.72 / 0.72 / +0.2%
tpcds_q52/datafusion:vortex-compact	11928754 / 12631636 / -5.6%	33240203 / 33498689 / -0.8%	0.36 / 0.38 / -4.8%
tpcds_q53/datafusion:vortex-compact	21618654 / 21373443 / +1.1%	43002668 / 42307114 / +1.6%	0.50 / 0.51 / -0.5%
tpcds_q54/datafusion:vortex-compact	36374384 / 35824063 / +1.5%	62454473 / 63285099 / -1.3%	0.58 / 0.57 / +2.9%
tpcds_q55/datafusion:vortex-compact	11941336 / 11727792 / +1.8%	32164092 / 31215120 / +3.0%	0.37 / 0.38 / -1.2%
tpcds_q56/datafusion:vortex-compact	27898568 / 27375534 / +1.9%	49483770 / 51963001 / -4.8%	0.56 / 0.53 / +7.0%
tpcds_q57/datafusion:vortex-compact	77056932 / 78272850 / -1.6%	105974372 / 105688843 / +0.3%	0.73 / 0.74 / -1.8%
tpcds_q58/datafusion:vortex-compact	44909526 / 45685705 / -1.7%	70221135 / 72063119 / -2.6%	0.64 / 0.63 / +0.9%
tpcds_q59/datafusion:vortex-compact	33264679 / 33548552 / -0.8%	55559765 / 53978641 / +2.9%	0.60 / 0.62 / -3.7%
tpcds_q60/datafusion:vortex-compact	26775648 / 27596265 / -3.0%	51503663 / 50700129 / +1.6%	0.52 / 0.54 / -4.5%
tpcds_q61/datafusion:vortex-compact	26075446 / 25170331 / +3.6%	47557082 / 47320517 / +0.5%	0.55 / 0.53 / +3.1%
tpcds_q62/datafusion:vortex-compact	17852802 / 18033794 / -1.0%	36589198 / 36502489 / +0.2%	0.49 / 0.49 / -1.2%
tpcds_q63/datafusion:vortex-compact	21315186 / 21590744 / -1.3%	42315433 / 41995263 / +0.8%	0.50 / 0.51 / -2.0%
tpcds_q64/datafusion:vortex-compact	413334044 / 446395062 / -7.4%	451060020 / 450056794 / +0.2%	0.92 / 0.99 / -7.6%
tpcds_q65/datafusion:vortex-compact	78456574 / 78642298 / -0.2%	99664770 / 97717931 / +2.0%	0.79 / 0.80 / -2.2%
tpcds_q66/datafusion:vortex-compact	53960468 / 53770539 / +0.4%	78064818 / 77040223 / +1.3%	0.69 / 0.70 / -1.0%
tpcds_q67/datafusion:vortex-compact	57480208 / 57431168 / +0.1%	89925219 / 88806967 / +1.3%	0.64 / 0.65 / -1.2%
tpcds_q68/datafusion:vortex-compact	24217561 / 24560240 / -1.4%	48581192 / 50558189 / -3.9%	0.50 / 0.49 / +2.6%
tpcds_q69/datafusion:vortex-compact	30949476 / 31589436 / -2.0%	55169745 / 55870912 / -1.3%	0.56 / 0.57 / -0.8%
tpcds_q70/datafusion:vortex-compact	72276246 / 71395034 / +1.2%	94767416 / 93470244 / +1.4%	0.76 / 0.76 / -0.2%
tpcds_q71/datafusion:vortex-compact	18297090 / 17856834 / +2.5%	40623508 / 41462409 / -2.0%	0.45 / 0.43 / +4.6%
tpcds_q72/datafusion:vortex-compact	465705382 / 481388286 / -3.3%	511428915 / 484823864 / +5.5%	0.91 / 0.99 / -8.3%
tpcds_q73/datafusion:vortex-compact	18354442 / 17930746 / +2.4%	37606650 / 38174882 / -1.5%	0.49 / 0.47 / +3.9%
tpcds_q74/datafusion:vortex-compact	46729188 / 46178406 / +1.2%	73075752 / 71197318 / +2.6%	0.64 / 0.65 / -1.4%
tpcds_q75/datafusion:vortex-compact	136522017 / 136603359 / -0.1%	160677983 / 159576782 / +0.7%	0.85 / 0.86 / -0.7%
tpcds_q76/datafusion:vortex-compact	41292432 / 43773600 / -5.7%	59742103 / 61197941 / -2.4%	0.69 / 0.72 / -3.4%
tpcds_q77/datafusion:vortex-compact	36138766 / 36606860 / -1.3%	61292875 / 60432391 / +1.4%	0.59 / 0.61 / -2.7%
tpcds_q78/datafusion:vortex-compact	82026587 / 81845472 / +0.2%	112062936 / 110445283 / +1.5%	0.73 / 0.74 / -1.2%
tpcds_q79/datafusion:vortex-compact	21973378 / 21640844 / +1.5%	45850155 / 42321402 / +8.3%	0.48 / 0.51 / -6.3%
tpcds_q80/datafusion:vortex-compact	77588308 / 78253857 / -0.9%	112410042 / 108898626 / +3.2%	0.69 / 0.72 / -3.9%
tpcds_q81/datafusion:vortex-compact	30227642 / 29996138 / +0.8%	47796140 / 47114352 / +1.4%	0.63 / 0.64 / -0.7%
tpcds_q82/datafusion:vortex-compact	15923775 / 16142262 / -1.4%	40498986 / 42761513 / -5.3%	0.39 / 0.38 / +4.2%
tpcds_q83/datafusion:vortex-compact	37003232 / 37088970 / -0.2%	61209191 / 60714943 / +0.8%	0.60 / 0.61 / -1.0%
tpcds_q84/datafusion:vortex-compact	13239031 / 13148798 / +0.7%	30097145 / 28919976 / +4.1%	0.44 / 0.45 / -3.3%
tpcds_q85/datafusion:vortex-compact	99287204 / 99912582 / -0.6%	128162000 / 125207008 / +2.4%	0.77 / 0.80 / -2.9%
tpcds_q86/datafusion:vortex-compact	17031403 / 16738255 / +1.8%	36792374 / 35040684 / +5.0%	0.46 / 0.48 / -3.1%
tpcds_q87/datafusion:vortex-compact	29779534 / 30443377 / -2.2%	54288777 / 52754692 / +2.9%	0.55 / 0.58 / -4.9%
tpcds_q88/datafusion:vortex-compact	34924553 / 35005772 / -0.2%	65561590 / 64343762 / +1.9%	0.53 / 0.54 / -2.1%
tpcds_q89/datafusion:vortex-compact	23693199 / 23222262 / +2.0%	45411229 / 46689190 / -2.7%	0.52 / 0.50 / +4.9%
tpcds_q90/datafusion:vortex-compact	10626212 / 10752511 / -1.2%	27002677 / 25973290 / +4.0%	0.39 / 0.41 / -4.9%
tpcds_q91/datafusion:vortex-compact	23489618 / 23626712 / -0.6%	43234051 / 43223167 / +0.0%	0.54 / 0.55 / -0.6%
tpcds_q92/datafusion:vortex-compact	15465220 / 15289639 / +1.1%	33497258 / 33928491 / -1.3%	0.46 / 0.45 / +2.5%
tpcds_q93/datafusion:vortex-compact	24166304 / 24904492 / -3.0%	46137915 / 44373017 / +4.0%	0.52 / 0.56 / -6.7%
tpcds_q94/datafusion:vortex-compact	20478063 / 21043800 / -2.7%	41010068 / 41303361 / -0.7%	0.50 / 0.51 / -2.0%
tpcds_q95/datafusion:vortex-compact	47189906 / 47515312 / -0.7%	68509603 / 70206131 / -2.4%	0.69 / 0.68 / +1.8%
tpcds_q96/datafusion:vortex-compact	9070014 / 8826450 / +2.8%	25979785 / 25868944 / +0.4%	0.35 / 0.34 / +2.3%
tpcds_q97/datafusion:vortex-compact	21593992 / 21575562 / +0.1%	43565893 / 44057346 / -1.1%	0.50 / 0.49 / +1.2%
tpcds_q98/datafusion:vortex-compact	21650226 / 21518337 / +0.6%	43521344 / 44642147 / -2.5%	0.50 / 0.48 / +3.2%
tpcds_q99/datafusion:vortex-compact	19782214 / 19820495 / -0.2%	39887550 / 38929800 / +2.5%	0.50 / 0.51 / -2.6%

datafusion / parquet / ns (0.998x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpcds_q01/datafusion:parquet	32199728 / 32115160 / +0.3%	51138080 / 48993598 / +4.4%	0.63 / 0.66 / -3.9%
tpcds_q02/datafusion:parquet	39753862 / 40582924 / -2.0%	57984279 / 59350820 / -2.3%	0.69 / 0.68 / +0.3%
tpcds_q03/datafusion:parquet	16413998 / 16581558 / -1.0%	31810163 / 32838606 / -3.1%	0.52 / 0.50 / +2.2%
tpcds_q04/datafusion:parquet	201574854 / 200377453 / +0.6%	227617729 / 227771574 / -0.1%	0.89 / 0.88 / +0.7%
tpcds_q05/datafusion:parquet	72357917 / 73972796 / -2.2%	93490860 / 96006743 / -2.6%	0.77 / 0.77 / +0.4%
tpcds_q06/datafusion:parquet	28493287 / 28794285 / -1.0%	51309844 / 49292983 / +4.1%	0.56 / 0.58 / -4.9%
tpcds_q07/datafusion:parquet	47397518 / 46859294 / +1.1%	66623679 / 70632182 / -5.7%	0.71 / 0.66 / +7.2%
tpcds_q08/datafusion:parquet	30378818 / 30846463 / -1.5%	48215415 / 50583996 / -4.7%	0.63 / 0.61 / +3.3%
tpcds_q09/datafusion:parquet	30581167 / 31914295 / -4.2%	45450390 / 50308734 / -9.7%	0.67 / 0.63 / +6.1%
tpcds_q10/datafusion:parquet	42271348 / 41969484 / +0.7%	60242753 / 63489475 / -5.1%	0.70 / 0.66 / +6.1%
tpcds_q11/datafusion:parquet	94862858 / 95714044 / -0.9%	118407750 / 118585878 / -0.2%	0.80 / 0.81 / -0.7%
tpcds_q12/datafusion:parquet	21155761 / 21509083 / -1.6%	36403763 / 37188102 / -2.1%	0.58 / 0.58 / +0.5%
tpcds_q13/datafusion:parquet	42555385 / 41587119 / +2.3%	68545904 / 69205871 / -1.0%	0.62 / 0.60 / +3.3%
tpcds_q14/datafusion:parquet	125592088 / 127580804 / -1.6%	149296353 / 151993806 / -1.8%	0.84 / 0.84 / +0.2%
tpcds_q15/datafusion:parquet	33047556 / 32966668 / +0.2%	51568492 / 52272846 / -1.3%	0.64 / 0.63 / +1.6%
tpcds_q16/datafusion:parquet	36849174 / 37458634 / -1.6%	54936025 / 54484122 / +0.8%	0.67 / 0.69 / -2.4%
tpcds_q17/datafusion:parquet	77290176 / 77519226 / -0.3%	104711213 / 106545116 / -1.7%	0.74 / 0.73 / +1.5%
tpcds_q18/datafusion:parquet	59799431 / 61016756 / -2.0%	83627934 / 85736243 / -2.5%	0.72 / 0.71 / +0.5%
tpcds_q19/datafusion:parquet	26420726 / 26531866 / -0.4%	47276727 / 49357184 / -4.2%	0.56 / 0.54 / +4.0%
tpcds_q20/datafusion:parquet	23140826 / 22970228 / +0.7%	37226211 / 36757213 / +1.3%	0.62 / 0.62 / -0.5%
tpcds_q21/datafusion:parquet	17791280 / 18130161 / -1.9%	32883142 / 35134651 / -6.4%	0.54 / 0.52 / +4.8%
tpcds_q22/datafusion:parquet	76004497 / 75454984 / +0.7%	91946981 / 92158214 / -0.2%	0.83 / 0.82 / +1.0%
tpcds_q23/datafusion:parquet	109460288 / 108679002 / +0.7%	139360745 / 137640070 / +1.3%	0.79 / 0.79 / -0.5%
tpcds_q24/datafusion:parquet	95814552 / 96038914 / -0.2%	123864410 / 126696700 / -2.2%	0.77 / 0.76 / +2.0%
tpcds_q25/datafusion:parquet	78979945 / 79049274 / -0.1%	108549163 / 108653674 / -0.1%	0.73 / 0.73 / +0.0%
tpcds_q26/datafusion:parquet	42912331 / 43258074 / -0.8%	64538037 / 63478185 / +1.7%	0.66 / 0.68 / -2.4%
tpcds_q27/datafusion:parquet	75627722 / 74404418 / +1.6%	97615166 / 102877089 / -5.1%	0.77 / 0.72 / +7.1%
tpcds_q28/datafusion:parquet	27448124 / 27492540 / -0.2%	46153965 / 45006026 / +2.6%	0.59 / 0.61 / -2.6%
tpcds_q29/datafusion:parquet	78668862 / 79126626 / -0.6%	106561303 / 107239523 / -0.6%	0.74 / 0.74 / +0.1%
tpcds_q30/datafusion:parquet	44014458 / 44184854 / -0.4%	67183730 / 64930318 / +3.5%	0.66 / 0.68 / -3.7%
tpcds_q31/datafusion:parquet	80522315 / 80520079 / +0.0%	104694095 / 103806707 / +0.9%	0.77 / 0.78 / -0.8%
tpcds_q32/datafusion:parquet	23478786 / 23405104 / +0.3%	39652562 / 41539137 / -4.5%	0.59 / 0.56 / +5.1%
tpcds_q33/datafusion:parquet	32791898 / 32481233 / +1.0%	51124261 / 51980210 / -1.6%	0.64 / 0.62 / +2.6%
tpcds_q34/datafusion:parquet	22021250 / 23141756 / -4.8%	39577971 / 41015061 / -3.5%	0.56 / 0.56 / -1.4%
tpcds_q35/datafusion:parquet	49121058 / 49312316 / -0.4%	69237408 / 70280003 / -1.5%	0.71 / 0.70 / +1.1%
tpcds_q36/datafusion:parquet	53143583 / 53909942 / -1.4%	77746464 / 75941861 / +2.4%	0.68 / 0.71 / -3.7%
tpcds_q37/datafusion:parquet	23118876 / 23354409 / -1.0%	38847255 / 39170279 / -0.8%	0.60 / 0.60 / -0.2%
tpcds_q38/datafusion:parquet	44168290 / 44006870 / +0.4%	64578851 / 66130457 / -2.3%	0.68 / 0.67 / +2.8%
tpcds_q39/datafusion:parquet	71487196 / 71675872 / -0.3%	90126104 / 90505237 / -0.4%	0.79 / 0.79 / +0.2%
tpcds_q40/datafusion:parquet	30001392 / 31147204 / -3.7%	49623465 / 51825048 / -4.2%	0.60 / 0.60 / +0.6%
tpcds_q41/datafusion:parquet	17443006 / 17470999 / -0.2%	29847094 / 30509534 / -2.2%	0.58 / 0.57 / +2.1%
tpcds_q42/datafusion:parquet	15745934 / 15637916 / +0.7%	29939684 / 32075081 / -6.7%	0.53 / 0.49 / +7.9%
tpcds_q43/datafusion:parquet	17740307 / 17465432 / +1.6%	32506967 / 33654234 / -3.4%	0.55 / 0.52 / +5.2%
tpcds_q44/datafusion:parquet	33585648 / 33169160 / +1.3%	52785764 / 55913912 / -5.6%	0.64 / 0.59 / +7.3%
tpcds_q45/datafusion:parquet	37223524 / 37290863 / -0.2%	56441003 / 57184933 / -1.3%	0.66 / 0.65 / +1.1%
tpcds_q46/datafusion:parquet	28735842 / 28682126 / +0.2%	51042851 / 51294149 / -0.5%	0.56 / 0.56 / +0.7%
tpcds_q47/datafusion:parquet	96158812 / 96402590 / -0.3%	124755310 / 124027120 / +0.6%	0.77 / 0.78 / -0.8%
tpcds_q48/datafusion:parquet	38830623 / 38673242 / +0.4%	59894006 / 58076915 / +3.1%	0.65 / 0.67 / -2.6%
tpcds_q49/datafusion:parquet	76113676 / 77590782 / -1.9%	99725371 / 102938327 / -3.1%	0.76 / 0.75 / +1.3%
tpcds_q50/datafusion:parquet	49404507 / 49181515 / +0.5%	72079821 / 73938412 / -2.5%	0.69 / 0.67 / +3.0%
tpcds_q51/datafusion:parquet	66139330 / 67314553 / -1.7%	90397710 / 93653253 / -3.5%	0.73 / 0.72 / +1.8%
tpcds_q52/datafusion:parquet	15954558 / 16010076 / -0.3%	31768766 / 32496247 / -2.2%	0.50 / 0.49 / +1.9%
tpcds_q53/datafusion:parquet	21599086 / 22030031 / -2.0%	40132395 / 40224968 / -0.2%	0.54 / 0.55 / -1.7%
tpcds_q54/datafusion:parquet	45885624 / 45292443 / +1.3%	68871521 / 68967455 / -0.1%	0.67 / 0.66 / +1.5%
tpcds_q55/datafusion:parquet	15470394 / 15565136 / -0.6%	30949386 / 31839219 / -2.8%	0.50 / 0.49 / +2.2%
tpcds_q56/datafusion:parquet	31897846 / 31942344 / -0.1%	55299962 / 55072284 / +0.4%	0.58 / 0.58 / -0.6%
tpcds_q57/datafusion:parquet	98448254 / 99487849 / -1.0%	122618826 / 124634824 / -1.6%	0.80 / 0.80 / +0.6%
tpcds_q58/datafusion:parquet	64854043 / 65124146 / -0.4%	87165692 / 89069680 / -2.1%	0.74 / 0.73 / +1.8%
tpcds_q59/datafusion:parquet	42783496 / 42761033 / +0.1%	63081544 / 65029616 / -3.0%	0.68 / 0.66 / +3.1%
tpcds_q60/datafusion:parquet	30752411 / 31980321 / -3.8%	53461002 / 55655879 / -3.9%	0.58 / 0.57 / +0.1%
tpcds_q61/datafusion:parquet	35042692 / 34317246 / +2.1%	55687128 / 58492439 / -4.8%	0.63 / 0.59 / +7.3%
tpcds_q62/datafusion:parquet	23760809 / 24077490 / -1.3%	39917616 / 39855268 / +0.2%	0.60 / 0.60 / -1.5%
tpcds_q63/datafusion:parquet	22018646 / 21730445 / +1.3%	40318144 / 39651987 / +1.7%	0.55 / 0.55 / -0.3%
tpcds_q64/datafusion:parquet	198659566 / 200945109 / -1.1%	232603504 / 234852571 / -1.0%	0.85 / 0.86 / -0.2%
tpcds_q65/datafusion:parquet	38751767 / 38828366 / -0.2%	60151779 / 59871767 / +0.5%	0.64 / 0.65 / -0.7%
tpcds_q66/datafusion:parquet	62491802 / 61260044 / +2.0%	79525644 / 79423731 / +0.1%	0.79 / 0.77 / +1.9%
tpcds_q67/datafusion:parquet	69970859 / 71132648 / -1.6%	96928942 / 97095071 / -0.2%	0.72 / 0.73 / -1.5%
tpcds_q68/datafusion:parquet	29047533 / 29171383 / -0.4%	52404359 / 52490833 / -0.2%	0.55 / 0.56 / -0.3%
tpcds_q69/datafusion:parquet	40616606 / 41754944 / -2.7%	61157134 / 60435778 / +1.2%	0.66 / 0.69 / -3.9%
tpcds_q70/datafusion:parquet	33780128 / 32967752 / +2.5%	56347515 / 55726522 / +1.1%	0.60 / 0.59 / +1.3%
tpcds_q71/datafusion:parquet	24683151 / 22949680 / +7.6%	40793222 / 41942824 / -2.7%	0.61 / 0.55 / +10.6%
tpcds_q72/datafusion:parquet	537310041 / 544486916 / -1.3%	579998078 / 574460341 / +1.0%	0.93 / 0.95 / -2.3%
tpcds_q73/datafusion:parquet	21811740 / 22844846 / -4.5%	39904578 / 38374680 / +4.0%	0.55 / 0.60 / -8.2%
tpcds_q74/datafusion:parquet	66790768 / 66577267 / +0.3%	87403054 / 87547029 / -0.2%	0.76 / 0.76 / +0.5%
tpcds_q75/datafusion:parquet	149746598 / 147484464 / +1.5%	181355219 / 179097375 / +1.3%	0.83 / 0.82 / +0.3%
tpcds_q76/datafusion:parquet	48569784 / 48444006 / +0.3%	66688127 / 67100522 / -0.6%	0.73 / 0.72 / +0.9%
tpcds_q77/datafusion:parquet	52918155 / 52292960 / +1.2%	77858542 / 74680280 / +4.3%	0.68 / 0.70 / -2.9%
tpcds_q78/datafusion:parquet	94972110 / 94595215 / +0.4%	126680302 / 125171788 / +1.2%	0.75 / 0.76 / -0.8%
tpcds_q79/datafusion:parquet	26219418 / 26235780 / -0.1%	46885041 / 46657579 / +0.5%	0.56 / 0.56 / -0.5%
tpcds_q80/datafusion:parquet	82710336 / 82727840 / -0.0%	112106791 / 114041149 / -1.7%	0.74 / 0.73 / +1.7%
tpcds_q81/datafusion:parquet	39577622 / 38173290 / +3.7%	59248135 / 58529254 / +1.2%	0.67 / 0.65 / +2.4%
tpcds_q82/datafusion:parquet	25567758 / 25401916 / +0.7%	40921913 / 41404575 / -1.2%	0.62 / 0.61 / +1.8%
tpcds_q83/datafusion:parquet	47652038 / 47415876 / +0.5%	69051775 / 69746267 / -1.0%	0.69 / 0.68 / +1.5%
tpcds_q84/datafusion:parquet	29200030 / 29461024 / -0.9%	45732750 / 45961417 / -0.5%	0.64 / 0.64 / -0.4%
tpcds_q85/datafusion:parquet	85574069 / 86641200 / -1.2%	112919565 / 107242517 / +5.3%	0.76 / 0.81 / -6.2%
tpcds_q86/datafusion:parquet	20976530 / 20739490 / +1.1%	35215607 / 35037219 / +0.5%	0.60 / 0.59 / +0.6%
tpcds_q87/datafusion:parquet	43685367 / 43132071 / +1.3%	62881866 / 61673708 / +2.0%	0.69 / 0.70 / -0.7%
tpcds_q88/datafusion:parquet	38507882 / 39024486 / -1.3%	62283044 / 59469579 / +4.7%	0.62 / 0.66 / -5.8%
tpcds_q89/datafusion:parquet	25306508 / 25395029 / -0.3%	43652381 / 43619176 / +0.1%	0.58 / 0.58 / -0.4%
tpcds_q90/datafusion:parquet	15976026 / 15678887 / +1.9%	30496176 / 30747573 / -0.8%	0.52 / 0.51 / +2.7%
tpcds_q91/datafusion:parquet	31821322 / 32407078 / -1.8%	49407176 / 49767736 / -0.7%	0.64 / 0.65 / -1.1%
tpcds_q92/datafusion:parquet	23537376 / 23718353 / -0.8%	41476068 / 41588423 / -0.3%	0.57 / 0.57 / -0.5%
tpcds_q93/datafusion:parquet	28011091 / 27818052 / +0.7%	51169078 / 47640727 / +7.4%	0.55 / 0.58 / -6.2%
tpcds_q94/datafusion:parquet	31981452 / 31666736 / +1.0%	49673440 / 49898700 / -0.5%	0.64 / 0.63 / +1.5%
tpcds_q95/datafusion:parquet	65096375 / 65693974 / -0.9%	80207757 / 82179017 / -2.4%	0.81 / 0.80 / +1.5%
tpcds_q96/datafusion:parquet	12991984 / 12746193 / +1.9%	29314755 / 27669255 / +5.9%	0.44 / 0.46 / -3.8%
tpcds_q97/datafusion:parquet	32118802 / 32124358 / -0.0%	53708218 / 52849413 / +1.6%	0.60 / 0.61 / -1.6%
tpcds_q98/datafusion:parquet	22532456 / 22251898 / +1.3%	39388298 / 38554193 / +2.2%	0.57 / 0.58 / -0.9%
tpcds_q99/datafusion:parquet	28424021 / 28822698 / -1.4%	44333984 / 41942188 / +5.7%	0.64 / 0.69 / -6.7%

duckdb / vortex-file-compressed / ns (1.004x ➖, 1↑ 4↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpcds_q01/duckdb:vortex-file-compressed	15274250 / 15179452 / +0.6%	22276196 / 22884008 / -2.7%	0.69 / 0.66 / +3.4%
tpcds_q02/duckdb:vortex-file-compressed	15217588 / 14939274 / +1.9%	20618620 / 20934878 / -1.5%	0.74 / 0.71 / +3.4%
tpcds_q03/duckdb:vortex-file-compressed	11124218 / 10894050 / +2.1%	19528628 / 27079512 / -27.9% 🟢	0.57 / 0.40 / +41.6%
tpcds_q04/duckdb:vortex-file-compressed	50211298 / 49753060 / +0.9%	62350032 / 59459033 / +4.9%	0.81 / 0.84 / -3.8%
tpcds_q05/duckdb:vortex-file-compressed	18679235 / 18941082 / -1.4%	25748972 / 25810487 / -0.2%	0.73 / 0.73 / -1.1%
tpcds_q06/duckdb:vortex-file-compressed	26652779 / 27429210 / -2.8%	44795472 / 41483708 / +8.0%	0.59 / 0.66 / -10.0%
tpcds_q07/duckdb:vortex-file-compressed	15454898 / 15690328 / -1.5%	33455000 / 30185574 / +10.8% 🔴	0.46 / 0.52 / -11.1%
tpcds_q08/duckdb:vortex-file-compressed	18766058 / 18952034 / -1.0%	28627681 / 26988514 / +6.1%	0.66 / 0.70 / -6.7%
tpcds_q09/duckdb:vortex-file-compressed	14931754 / 13749627 / +8.6%	22257222 / 22122556 / +0.6%	0.67 / 0.62 / +7.9%
tpcds_q10/duckdb:vortex-file-compressed	27845592 / 30909155 / -9.9%	43017118 / 42029107 / +2.4%	0.65 / 0.74 / -12.0%
tpcds_q11/duckdb:vortex-file-compressed	40254756 / 40213697 / +0.1%	50108733 / 50230243 / -0.2%	0.80 / 0.80 / +0.3%
tpcds_q12/duckdb:vortex-file-compressed	10440744 / 10799028 / -3.3%	16623680 / 16126599 / +3.1%	0.63 / 0.67 / -6.2%
tpcds_q13/duckdb:vortex-file-compressed	22689836 / 21328470 / +6.4%	34286764 / 36462717 / -6.0%	0.66 / 0.58 / +13.1%
tpcds_q14/duckdb:vortex-file-compressed	58294336 / 57849634 / +0.8%	77336573 / 76754941 / +0.8%	0.75 / 0.75 / +0.0%
tpcds_q15/duckdb:vortex-file-compressed	20708760 / 20616378 / +0.4%	24981165 / 26475260 / -5.6%	0.83 / 0.78 / +6.5%
tpcds_q16/duckdb:vortex-file-compressed	20414992 / 18744794 / +8.9%	30239689 / 30039876 / +0.7%	0.68 / 0.62 / +8.2%
tpcds_q17/duckdb:vortex-file-compressed	30229376 / 30034058 / +0.7%	44336115 / 46990875 / -5.6%	0.68 / 0.64 / +6.7%
tpcds_q18/duckdb:vortex-file-compressed	28279568 / 28139864 / +0.5%	38499425 / 38685290 / -0.5%	0.73 / 0.73 / +1.0%
tpcds_q19/duckdb:vortex-file-compressed	23791408 / 23754923 / +0.2%	37476651 / 34241565 / +9.4%	0.63 / 0.69 / -8.5%
tpcds_q20/duckdb:vortex-file-compressed	10763358 / 10651105 / +1.1%	17485839 / 16499573 / +6.0%	0.62 / 0.65 / -4.6%
tpcds_q21/duckdb:vortex-file-compressed	9662536 / 9528612 / +1.4%	19107511 / 18133139 / +5.4%	0.51 / 0.53 / -3.8%
tpcds_q22/duckdb:vortex-file-compressed	31831141 / 28921250 / +10.1% 🔴	40135555 / 39389390 / +1.9%	0.79 / 0.73 / +8.0%
tpcds_q23/duckdb:vortex-file-compressed	36401612 / 37240097 / -2.3%	48540954 / 47212003 / +2.8%	0.75 / 0.79 / -4.9%
tpcds_q24/duckdb:vortex-file-compressed	27809953 / 29819076 / -6.7%	39319936 / 40620553 / -3.2%	0.71 / 0.73 / -3.7%
tpcds_q25/duckdb:vortex-file-compressed	25019808 / 25135901 / -0.5%	39751442 / 40576444 / -2.0%	0.63 / 0.62 / +1.6%
tpcds_q26/duckdb:vortex-file-compressed	13468576 / 13539553 / -0.5%	21266812 / 20771409 / +2.4%	0.63 / 0.65 / -2.8%
tpcds_q27/duckdb:vortex-file-compressed	18529356 / 18568630 / -0.2%	31237403 / 33075445 / -5.6%	0.59 / 0.56 / +5.7%
tpcds_q28/duckdb:vortex-file-compressed	13032494 / 14122540 / -7.7%	19916209 / 24376280 / -18.3% 🟢	0.65 / 0.58 / +12.9%
tpcds_q29/duckdb:vortex-file-compressed	28800749 / 28713948 / +0.3%	43959867 / 44028587 / -0.2%	0.66 / 0.65 / +0.5%
tpcds_q30/duckdb:vortex-file-compressed	19370136 / 19340928 / +0.2%	27997397 / 30508591 / -8.2%	0.69 / 0.63 / +9.1%
tpcds_q31/duckdb:vortex-file-compressed	19268774 / 19369754 / -0.5%	30521088 / 28253469 / +8.0%	0.63 / 0.69 / -7.9%
tpcds_q32/duckdb:vortex-file-compressed	9941590 / 9946606 / -0.1%	15063039 / 16594460 / -9.2%	0.66 / 0.60 / +10.1%
tpcds_q33/duckdb:vortex-file-compressed	16524755 / 16819746 / -1.8%	29475286 / 27642736 / +6.6%	0.56 / 0.61 / -7.9%
tpcds_q34/duckdb:vortex-file-compressed	15796317 / 15745175 / +0.3%	22008511 / 23005785 / -4.3%	0.72 / 0.68 / +4.9%
tpcds_q35/duckdb:vortex-file-compressed	46058240 / 46044536 / +0.0%	59176364 / 58511159 / +1.1%	0.78 / 0.79 / -1.1%
tpcds_q36/duckdb:vortex-file-compressed	14708068 / 15277624 / -3.7%	31960198 / 26946856 / +18.6% 🔴	0.46 / 0.57 / -18.8%
tpcds_q37/duckdb:vortex-file-compressed	13776018 / 14041026 / -1.9%	22642992 / 23072455 / -1.9%	0.61 / 0.61 / -0.0%
tpcds_q38/duckdb:vortex-file-compressed	22154600 / 22338234 / -0.8%	28701645 / 29487309 / -2.7%	0.77 / 0.76 / +1.9%
tpcds_q39/duckdb:vortex-file-compressed	18175684 / 18086992 / +0.5%	31457978 / 30629055 / +2.7%	0.58 / 0.59 / -2.2%
tpcds_q40/duckdb:vortex-file-compressed	13202658 / 12925784 / +2.1%	18189695 / 20240318 / -10.1% 🟢	0.73 / 0.64 / +13.7%
tpcds_q41/duckdb:vortex-file-compressed	6506074 / 6193097 / +5.1%	8816434 / 9716523 / -9.3%	0.74 / 0.64 / +15.8%
tpcds_q42/duckdb:vortex-file-compressed	7869504 / 9292685 / -15.3% 🟢	18269640 / 20826105 / -12.3% 🟢	0.43 / 0.45 / -3.5%
tpcds_q43/duckdb:vortex-file-compressed	10215077 / 10449343 / -2.2%	18834520 / 18180188 / +3.6%	0.54 / 0.57 / -5.6%
tpcds_q44/duckdb:vortex-file-compressed	15189979 / 15460748 / -1.8%	25351012 / 27765101 / -8.7%	0.60 / 0.56 / +7.6%
tpcds_q45/duckdb:vortex-file-compressed	22101505 / 22087536 / +0.1%	29208550 / 29311167 / -0.4%	0.76 / 0.75 / +0.4%
tpcds_q46/duckdb:vortex-file-compressed	18555904 / 19013746 / -2.4%	28530785 / 28723332 / -0.7%	0.65 / 0.66 / -1.7%
tpcds_q47/duckdb:vortex-file-compressed	30807440 / 31302908 / -1.6%	43015462 / 44859845 / -4.1%	0.72 / 0.70 / +2.6%
tpcds_q48/duckdb:vortex-file-compressed	19677042 / 19535764 / +0.7%	31048798 / 30902027 / +0.5%	0.63 / 0.63 / +0.2%
tpcds_q49/duckdb:vortex-file-compressed	17335248 / 16644262 / +4.2%	32478842 / 31453405 / +3.3%	0.53 / 0.53 / +0.9%
tpcds_q50/duckdb:vortex-file-compressed	16684888 / 16331573 / +2.2%	28258194 / 26933452 / +4.9%	0.59 / 0.61 / -2.6%
tpcds_q51/duckdb:vortex-file-compressed	77117276 / 52814490 / +46.0% 🔴	89958816 / 62694895 / +43.5% 🔴	0.86 / 0.84 / +1.8%
tpcds_q52/duckdb:vortex-file-compressed	8290828 / 8640726 / -4.0%	18411764 / 17819889 / +3.3%	0.45 / 0.48 / -7.1%
tpcds_q53/duckdb:vortex-file-compressed	14302400 / 14276876 / +0.2%	24983466 / 25040605 / -0.2%	0.57 / 0.57 / +0.4%
tpcds_q54/duckdb:vortex-file-compressed	20640024 / 20461182 / +0.9%	31354104 / 29841906 / +5.1%	0.66 / 0.69 / -4.0%
tpcds_q55/duckdb:vortex-file-compressed	8682682 / 8306822 / +4.5%	18153826 / 18467871 / -1.7%	0.48 / 0.45 / +6.3%
tpcds_q56/duckdb:vortex-file-compressed	19773648 / 17311487 / +14.2% 🔴	30460780 / 30850924 / -1.3%	0.65 / 0.56 / +15.7%
tpcds_q57/duckdb:vortex-file-compressed	24157756 / 25757445 / -6.2%	31170331 / 30889273 / +0.9%	0.78 / 0.83 / -7.1%
tpcds_q58/duckdb:vortex-file-compressed	18083820 / 17905699 / +1.0%	31119459 / 27861667 / +11.7% 🔴	0.58 / 0.64 / -9.6%
tpcds_q59/duckdb:vortex-file-compressed	18757306 / 18717448 / +0.2%	24004711 / 25742882 / -6.8%	0.78 / 0.73 / +7.5%
tpcds_q60/duckdb:vortex-file-compressed	17708862 / 17951802 / -1.4%	30793020 / 28554711 / +7.8%	0.58 / 0.63 / -8.5%
tpcds_q61/duckdb:vortex-file-compressed	19722700 / 19929615 / -1.0%	32384433 / 34432224 / -5.9%	0.61 / 0.58 / +5.2%
tpcds_q62/duckdb:vortex-file-compressed	10126130 / 10368346 / -2.3%	15998944 / 18700440 / -14.4% 🟢	0.63 / 0.55 / +14.2%
tpcds_q63/duckdb:vortex-file-compressed	13227062 / 13064649 / +1.2%	26583809 / 23735243 / +12.0% 🔴	0.50 / 0.55 / -9.6%
tpcds_q64/duckdb:vortex-file-compressed	63051764 / 64305886 / -2.0%	85411345 / 82847715 / +3.1%	0.74 / 0.78 / -4.9%
tpcds_q65/duckdb:vortex-file-compressed	15432304 / 15739884 / -2.0%	28732272 / 25594634 / +12.3% 🔴	0.54 / 0.61 / -12.7%
tpcds_q66/duckdb:vortex-file-compressed	21245620 / 21728691 / -2.2%	34243411 / 29709457 / +15.3% 🔴	0.62 / 0.73 / -15.2%
tpcds_q67/duckdb:vortex-file-compressed	64979956 / 66149813 / -1.8%	92656705 / 82975189 / +11.7% 🔴	0.70 / 0.80 / -12.0%
tpcds_q68/duckdb:vortex-file-compressed	18460911 / 18349419 / +0.6%	33862846 / 30846447 / +9.8%	0.55 / 0.59 / -8.4%
tpcds_q69/duckdb:vortex-file-compressed	28491359 / 28984100 / -1.7%	43307148 / 41768307 / +3.7%	0.66 / 0.69 / -5.2%
tpcds_q70/duckdb:vortex-file-compressed	18738646 / 18457710 / +1.5%	31658757 / 35196782 / -10.1% 🟢	0.59 / 0.52 / +12.9%
tpcds_q71/duckdb:vortex-file-compressed	13279448 / 13060035 / +1.7%	23766368 / 22854759 / +4.0%	0.56 / 0.57 / -2.2%
tpcds_q72/duckdb:vortex-file-compressed	61515938 / 62480036 / -1.5%	77546510 / 77193390 / +0.5%	0.79 / 0.81 / -2.0%
tpcds_q73/duckdb:vortex-file-compressed	14862725 / 14889401 / -0.2%	20456058 / 20314761 / +0.7%	0.73 / 0.73 / -0.9%
tpcds_q74/duckdb:vortex-file-compressed	27428117 / 27513864 / -0.3%	38341317 / 36976708 / +3.7%	0.72 / 0.74 / -3.9%
tpcds_q75/duckdb:vortex-file-compressed	28816063 / 28711164 / +0.4%	42087947 / 43756956 / -3.8%	0.68 / 0.66 / +4.3%
tpcds_q76/duckdb:vortex-file-compressed	12555922 / 12492374 / +0.5%	23482217 / 25380786 / -7.5%	0.53 / 0.49 / +8.6%
tpcds_q77/duckdb:vortex-file-compressed	15835588 / 15508886 / +2.1%	25705336 / 26712686 / -3.8%	0.62 / 0.58 / +6.1%
tpcds_q78/duckdb:vortex-file-compressed	37532320 / 37190920 / +0.9%	49333472 / 45811419 / +7.7%	0.76 / 0.81 / -6.3%
tpcds_q79/duckdb:vortex-file-compressed	14125468 / 14399438 / -1.9%	26369451 / 24975746 / +5.6%	0.54 / 0.58 / -7.1%
tpcds_q80/duckdb:vortex-file-compressed	27767547 / 27900460 / -0.5%	44574415 / 42018062 / +6.1%	0.62 / 0.66 / -6.2%
tpcds_q81/duckdb:vortex-file-compressed	22553505 / 22157140 / +1.8%	30038774 / 32822752 / -8.5%	0.75 / 0.68 / +11.2%
tpcds_q82/duckdb:vortex-file-compressed	32589200 / 32403992 / +0.6%	40430113 / 39666820 / +1.9%	0.81 / 0.82 / -1.3%
tpcds_q83/duckdb:vortex-file-compressed	19487042 / 19372170 / +0.6%	25652214 / 25204819 / +1.8%	0.76 / 0.77 / -1.2%
tpcds_q84/duckdb:vortex-file-compressed	14227472 / 13604388 / +4.6%	20726942 / 24028865 / -13.7% 🟢	0.69 / 0.57 / +21.2%
tpcds_q85/duckdb:vortex-file-compressed	30999720 / 30666886 / +1.1%	40774735 / 39803568 / +2.4%	0.76 / 0.77 / -1.3%
tpcds_q86/duckdb:vortex-file-compressed	11488899 / 10963870 / +4.8%	17451962 / 17492021 / -0.2%	0.66 / 0.63 / +5.0%
tpcds_q87/duckdb:vortex-file-compressed	24167992 / 23856947 / +1.3%	29583707 / 30726460 / -3.7%	0.82 / 0.78 / +5.2%
tpcds_q88/duckdb:vortex-file-compressed	32128679 / 33084119 / -2.9%	47460517 / 46333044 / +2.4%	0.68 / 0.71 / -5.2%
tpcds_q89/duckdb:vortex-file-compressed	13893496 / 13835100 / +0.4%	25938685 / 26754194 / -3.0%	0.54 / 0.52 / +3.6%
tpcds_q90/duckdb:vortex-file-compressed	8489126 / 8748226 / -3.0%	14828520 / 14544548 / +2.0%	0.57 / 0.60 / -4.8%
tpcds_q91/duckdb:vortex-file-compressed	15506767 / 15268832 / +1.6%	21871571 / 25659483 / -14.8% 🟢	0.71 / 0.60 / +19.1%
tpcds_q92/duckdb:vortex-file-compressed	12771606 / 12625278 / +1.2%	19911401 / 21492309 / -7.4%	0.64 / 0.59 / +9.2%
tpcds_q93/duckdb:vortex-file-compressed	17024292 / 17363168 / -2.0%	27733434 / 24140510 / +14.9% 🔴	0.61 / 0.72 / -14.7%
tpcds_q94/duckdb:vortex-file-compressed	16141202 / 16277316 / -0.8%	27691631 / 27732149 / -0.1%	0.58 / 0.59 / -0.7%
tpcds_q95/duckdb:vortex-file-compressed	45444473 / 45432782 / +0.0%	59004230 / 53794795 / +9.7%	0.77 / 0.84 / -8.8%
tpcds_q96/duckdb:vortex-file-compressed	8536569 / 7312648 / +16.7% 🔴	15085768 / 15698290 / -3.9%	0.57 / 0.47 / +21.5%
tpcds_q97/duckdb:vortex-file-compressed	22248738 / 22519436 / -1.2%	29949626 / 28899288 / +3.6%	0.74 / 0.78 / -4.7%
tpcds_q98/duckdb:vortex-file-compressed	13177306 / 13855241 / -4.9%	22972929 / 22733728 / +1.1%	0.57 / 0.61 / -5.9%
tpcds_q99/duckdb:vortex-file-compressed	13461206 / 13908756 / -3.2%	21530924 / 22328219 / -3.6%	0.63 / 0.62 / +0.4%

duckdb / vortex-compact / ns (0.999x ➖, 3↑ 2↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpcds_q01/duckdb:vortex-compact	16863167 / 16691450 / +1.0%	23379056 / 24748407 / -5.5%	0.72 / 0.67 / +6.9%
tpcds_q02/duckdb:vortex-compact	14792935 / 15033553 / -1.6%	22906283 / 20418551 / +12.2% 🔴	0.65 / 0.74 / -12.3%
tpcds_q03/duckdb:vortex-compact	20859152 / 18811572 / +10.9% 🔴	28251945 / 30610753 / -7.7%	0.74 / 0.61 / +20.1%
tpcds_q04/duckdb:vortex-compact	52846923 / 53301700 / -0.9%	63190321 / 64102975 / -1.4%	0.84 / 0.83 / +0.6%
tpcds_q05/duckdb:vortex-compact	21515964 / 21572050 / -0.3%	32142229 / 28738628 / +11.8% 🔴	0.67 / 0.75 / -10.8%
tpcds_q06/duckdb:vortex-compact	28651369 / 28560104 / +0.3%	41657549 / 44584181 / -6.6%	0.69 / 0.64 / +7.4%
tpcds_q07/duckdb:vortex-compact	20405821 / 20433356 / -0.1%	30903781 / 31220950 / -1.0%	0.66 / 0.65 / +0.9%
tpcds_q08/duckdb:vortex-compact	29503557 / 29556378 / -0.2%	39237592 / 42473086 / -7.6%	0.75 / 0.70 / +8.1%
tpcds_q09/duckdb:vortex-compact	19031229 / 19237708 / -1.1%	31448206 / 27020184 / +16.4% 🔴	0.61 / 0.71 / -15.0%
tpcds_q10/duckdb:vortex-compact	33801812 / 33803718 / -0.0%	46114446 / 44739859 / +3.1%	0.73 / 0.76 / -3.0%
tpcds_q11/duckdb:vortex-compact	43248677 / 43024510 / +0.5%	53800518 / 54569920 / -1.4%	0.80 / 0.79 / +2.0%
tpcds_q12/duckdb:vortex-compact	13640192 / 13432778 / +1.5%	19230942 / 19184189 / +0.2%	0.71 / 0.70 / +1.3%
tpcds_q13/duckdb:vortex-compact	26160360 / 25757066 / +1.6%	40728400 / 39658290 / +2.7%	0.64 / 0.65 / -1.1%
tpcds_q14/duckdb:vortex-compact	61621538 / 61085072 / +0.9%	74737876 / 79897015 / -6.5%	0.82 / 0.76 / +7.8%
tpcds_q15/duckdb:vortex-compact	23278345 / 23406927 / -0.5%	28917339 / 28351766 / +2.0%	0.80 / 0.83 / -2.5%
tpcds_q16/duckdb:vortex-compact	20912592 / 19272018 / +8.5%	33197729 / 27838946 / +19.2% 🔴	0.63 / 0.69 / -9.0%
tpcds_q17/duckdb:vortex-compact	35100050 / 35099608 / +0.0%	47818228 / 49040234 / -2.5%	0.73 / 0.72 / +2.6%
tpcds_q18/duckdb:vortex-compact	31559842 / 31477896 / +0.3%	41241142 / 41873572 / -1.5%	0.77 / 0.75 / +1.8%
tpcds_q19/duckdb:vortex-compact	28305438 / 27894183 / +1.5%	39324959 / 39148625 / +0.5%	0.72 / 0.71 / +1.0%
tpcds_q20/duckdb:vortex-compact	13359018 / 13234958 / +0.9%	17720307 / 17373830 / +2.0%	0.75 / 0.76 / -1.0%
tpcds_q21/duckdb:vortex-compact	10278604 / 10301078 / -0.2%	20173918 / 18411319 / +9.6%	0.51 / 0.56 / -8.9%
tpcds_q22/duckdb:vortex-compact	30326731 / 30448345 / -0.4%	41817499 / 41290263 / +1.3%	0.73 / 0.74 / -1.7%
tpcds_q23/duckdb:vortex-compact	37567051 / 37914432 / -0.9%	47331895 / 50512815 / -6.3%	0.79 / 0.75 / +5.7%
tpcds_q24/duckdb:vortex-compact	34514626 / 31581468 / +9.3%	42815019 / 41801813 / +2.4%	0.81 / 0.76 / +6.7%
tpcds_q25/duckdb:vortex-compact	29579478 / 29749243 / -0.6%	42610534 / 42090222 / +1.2%	0.69 / 0.71 / -1.8%
tpcds_q26/duckdb:vortex-compact	17872858 / 18171092 / -1.6%	24482696 / 25046022 / -2.2%	0.73 / 0.73 / +0.6%
tpcds_q27/duckdb:vortex-compact	21887484 / 22084472 / -0.9%	32521636 / 33170884 / -2.0%	0.67 / 0.67 / +1.1%
tpcds_q28/duckdb:vortex-compact	22576906 / 23722640 / -4.8%	30989227 / 33930054 / -8.7%	0.73 / 0.70 / +4.2%
tpcds_q29/duckdb:vortex-compact	33998270 / 33759010 / +0.7%	48436836 / 48539921 / -0.2%	0.70 / 0.70 / +0.9%
tpcds_q30/duckdb:vortex-compact	22716713 / 22742170 / -0.1%	30781361 / 31119102 / -1.1%	0.74 / 0.73 / +1.0%
tpcds_q31/duckdb:vortex-compact	23303664 / 21227751 / +9.8%	34925742 / 30356096 / +15.1% 🔴	0.67 / 0.70 / -4.6%
tpcds_q32/duckdb:vortex-compact	12332066 / 12475634 / -1.2%	23193176 / 19231178 / +20.6% 🔴	0.53 / 0.65 / -18.0%
tpcds_q33/duckdb:vortex-compact	18178048 / 18963050 / -4.1%	32453163 / 28491719 / +13.9% 🔴	0.56 / 0.67 / -15.8%
tpcds_q34/duckdb:vortex-compact	16946599 / 17006534 / -0.4%	23903106 / 23836838 / +0.3%	0.71 / 0.71 / -0.6%
tpcds_q35/duckdb:vortex-compact	51288903 / 51193692 / +0.2%	63199346 / 64776273 / -2.4%	0.81 / 0.79 / +2.7%
tpcds_q36/duckdb:vortex-compact	17891250 / 17163622 / +4.2%	31523275 / 33575079 / -6.1%	0.57 / 0.51 / +11.0%
tpcds_q37/duckdb:vortex-compact	15498839 / 15106082 / +2.6%	25986776 / 24597726 / +5.6%	0.60 / 0.61 / -2.9%
tpcds_q38/duckdb:vortex-compact	23590156 / 23891129 / -1.3%	29703017 / 29957443 / -0.8%	0.79 / 0.80 / -0.4%
tpcds_q39/duckdb:vortex-compact	19178910 / 18894730 / +1.5%	30360372 / 27079999 / +12.1% 🔴	0.63 / 0.70 / -9.5%
tpcds_q40/duckdb:vortex-compact	14591710 / 15122242 / -3.5%	19129295 / 22053546 / -13.3% 🟢	0.76 / 0.69 / +11.2%
tpcds_q41/duckdb:vortex-compact	7299254 / 7350601 / -0.7%	10166293 / 10253154 / -0.8%	0.72 / 0.72 / +0.1%
tpcds_q42/duckdb:vortex-compact	9841210 / 10909456 / -9.8%	18862358 / 20840660 / -9.5%	0.52 / 0.52 / -0.3%
tpcds_q43/duckdb:vortex-compact	11674126 / 11766660 / -0.8%	21665221 / 22531757 / -3.8%	0.54 / 0.52 / +3.2%
tpcds_q44/duckdb:vortex-compact	19016417 / 19496174 / -2.5%	32636701 / 32792313 / -0.5%	0.58 / 0.59 / -2.0%
tpcds_q45/duckdb:vortex-compact	25650570 / 25465852 / +0.7%	32137201 / 32046378 / +0.3%	0.80 / 0.79 / +0.4%
tpcds_q46/duckdb:vortex-compact	19946722 / 19995276 / -0.2%	29355985 / 29881589 / -1.8%	0.68 / 0.67 / +1.5%
tpcds_q47/duckdb:vortex-compact	32463860 / 33437844 / -2.9%	41688688 / 42092359 / -1.0%	0.78 / 0.79 / -2.0%
tpcds_q48/duckdb:vortex-compact	23754718 / 23632788 / +0.5%	37393866 / 34867601 / +7.2%	0.64 / 0.68 / -6.3%
tpcds_q49/duckdb:vortex-compact	20723642 / 20966484 / -1.2%	33786399 / 33384673 / +1.2%	0.61 / 0.63 / -2.3%
tpcds_q50/duckdb:vortex-compact	19114450 / 19122702 / -0.0%	28778810 / 29396746 / -2.1%	0.66 / 0.65 / +2.1%
tpcds_q51/duckdb:vortex-compact	53266331 / 53710912 / -0.8%	63736423 / 61386916 / +3.8%	0.84 / 0.87 / -4.5%
tpcds_q52/duckdb:vortex-compact	10051308 / 13628550 / -26.2% 🟢	20571862 / 20610459 / -0.2%	0.49 / 0.66 / -26.1%
tpcds_q53/duckdb:vortex-compact	19058606 / 16408392 / +16.2% 🔴	26207304 / 26972573 / -2.8%	0.73 / 0.61 / +19.5%
tpcds_q54/duckdb:vortex-compact	23024147 / 22512448 / +2.3%	39240326 / 30901066 / +27.0% 🔴	0.59 / 0.73 / -19.5%
tpcds_q55/duckdb:vortex-compact	10422942 / 9937740 / +4.9%	18912959 / 19343688 / -2.2%	0.55 / 0.51 / +7.3%
tpcds_q56/duckdb:vortex-compact	18924852 / 19682610 / -3.8%	30194508 / 33424592 / -9.7%	0.63 / 0.59 / +6.4%
tpcds_q57/duckdb:vortex-compact	25646786 / 25672628 / -0.1%	31436645 / 36751668 / -14.5% 🟢	0.82 / 0.70 / +16.8%
tpcds_q58/duckdb:vortex-compact	19201784 / 19323203 / -0.6%	29038414 / 30420772 / -4.5%	0.66 / 0.64 / +4.1%
tpcds_q59/duckdb:vortex-compact	19077134 / 21608415 / -11.7% 🟢	25507672 / 27762793 / -8.1%	0.75 / 0.78 / -3.9%
tpcds_q60/duckdb:vortex-compact	19881958 / 19673684 / +1.1%	32990875 / 31134388 / +6.0%	0.60 / 0.63 / -4.6%
tpcds_q61/duckdb:vortex-compact	25115430 / 23819880 / +5.4%	36359066 / 36986831 / -1.7%	0.69 / 0.64 / +7.3%
tpcds_q62/duckdb:vortex-compact	11361085 / 11414592 / -0.5%	17049811 / 16830468 / +1.3%	0.67 / 0.68 / -1.7%
tpcds_q63/duckdb:vortex-compact	15299372 / 15245930 / +0.4%	23573931 / 24916983 / -5.4%	0.65 / 0.61 / +6.1%
tpcds_q64/duckdb:vortex-compact	72886620 / 70290018 / +3.7%	92537795 / 90098765 / +2.7%	0.79 / 0.78 / +1.0%
tpcds_q65/duckdb:vortex-compact	17834254 / 16855613 / +5.8%	30996515 / 30396767 / +2.0%	0.58 / 0.55 / +3.8%
tpcds_q66/duckdb:vortex-compact	22694418 / 23281151 / -2.5%	33896501 / 32961098 / +2.8%	0.67 / 0.71 / -5.2%
tpcds_q67/duckdb:vortex-compact	68338555 / 67781130 / +0.8%	82618526 / 82519760 / +0.1%	0.83 / 0.82 / +0.7%
tpcds_q68/duckdb:vortex-compact	19947465 / 20258598 / -1.5%	29319718 / 35647792 / -17.8% 🟢	0.68 / 0.57 / +19.7%
tpcds_q69/duckdb:vortex-compact	34983240 / 35215452 / -0.7%	46653736 / 49366268 / -5.5%	0.75 / 0.71 / +5.1%
tpcds_q70/duckdb:vortex-compact	21738300 / 21532417 / +1.0%	32498328 / 33194244 / -2.1%	0.67 / 0.65 / +3.1%
tpcds_q71/duckdb:vortex-compact	15571096 / 15231188 / +2.2%	28611651 / 28511659 / +0.4%	0.54 / 0.53 / +1.9%
tpcds_q72/duckdb:vortex-compact	65532470 / 64761473 / +1.2%	79043722 / 78529250 / +0.7%	0.83 / 0.82 / +0.5%
tpcds_q73/duckdb:vortex-compact	15999524 / 16226848 / -1.4%	22204839 / 22916761 / -3.1%	0.72 / 0.71 / +1.8%
tpcds_q74/duckdb:vortex-compact	29027992 / 28963992 / +0.2%	39178081 / 39713108 / -1.3%	0.74 / 0.73 / +1.6%
tpcds_q75/duckdb:vortex-compact	31237127 / 31003432 / +0.8%	47455655 / 43710044 / +8.6%	0.66 / 0.71 / -7.2%
tpcds_q76/duckdb:vortex-compact	13538892 / 15148239 / -10.6% 🟢	26969153 / 27410498 / -1.6%	0.50 / 0.55 / -9.2%
tpcds_q77/duckdb:vortex-compact	18627651 / 17602828 / +5.8%	27429701 / 29015825 / -5.5%	0.68 / 0.61 / +11.9%
tpcds_q78/duckdb:vortex-compact	39048997 / 38817646 / +0.6%	45890317 / 48541889 / -5.5%	0.85 / 0.80 / +6.4%
tpcds_q79/duckdb:vortex-compact	19963170 / 20122620 / -0.8%	29738214 / 29446594 / +1.0%	0.67 / 0.68 / -1.8%
tpcds_q80/duckdb:vortex-compact	30956410 / 32478682 / -4.7%	45949248 / 51033173 / -10.0%	0.67 / 0.64 / +5.9%
tpcds_q81/duckdb:vortex-compact	24532968 / 24516255 / +0.1%	31953588 / 31618307 / +1.1%	0.77 / 0.78 / -1.0%
tpcds_q82/duckdb:vortex-compact	36527576 / 35158843 / +3.9%	43662472 / 43011881 / +1.5%	0.84 / 0.82 / +2.3%
tpcds_q83/duckdb:vortex-compact	27743724 / 27660077 / +0.3%	36097411 / 32808994 / +10.0% 🔴	0.77 / 0.84 / -8.8%
tpcds_q84/duckdb:vortex-compact	17337671 / 18096113 / -4.2%	23830588 / 23048239 / +3.4%	0.73 / 0.79 / -7.3%
tpcds_q85/duckdb:vortex-compact	36702692 / 36587514 / +0.3%	45327870 / 48353206 / -6.3%	0.81 / 0.76 / +7.0%
tpcds_q86/duckdb:vortex-compact	12227818 / 12264853 / -0.3%	19046083 / 20975518 / -9.2%	0.64 / 0.58 / +9.8%
tpcds_q87/duckdb:vortex-compact	25422894 / 25033766 / +1.6%	31257325 / 32526012 / -3.9%	0.81 / 0.77 / +5.7%
tpcds_q88/duckdb:vortex-compact	40547013 / 41292002 / -1.8%	51905787 / 52573166 / -1.3%	0.78 / 0.79 / -0.5%
tpcds_q89/duckdb:vortex-compact	15801460 / 15721444 / +0.5%	26114566 / 24151441 / +8.1%	0.61 / 0.65 / -7.0%
tpcds_q90/duckdb:vortex-compact	9283452 / 9484372 / -2.1%	12844695 / 15584632 / -17.6% 🟢	0.72 / 0.61 / +18.8%
tpcds_q91/duckdb:vortex-compact	24867700 / 24659254 / +0.8%	32327765 / 31805665 / +1.6%	0.77 / 0.78 / -0.8%
tpcds_q92/duckdb:vortex-compact	19969570 / 20170768 / -1.0%	29135727 / 26802937 / +8.7%	0.69 / 0.75 / -8.9%
tpcds_q93/duckdb:vortex-compact	17653816 / 17794402 / -0.8%	24737187 / 24460235 / +1.1%	0.71 / 0.73 / -1.9%
tpcds_q94/duckdb:vortex-compact	18501654 / 18765463 / -1.4%	29876102 / 31653568 / -5.6%	0.62 / 0.59 / +4.5%
tpcds_q95/duckdb:vortex-compact	45251939 / 43703094 / +3.5%	57234784 / 55327678 / +3.4%	0.79 / 0.79 / +0.1%
tpcds_q96/duckdb:vortex-compact	8795018 / 8820376 / -0.3%	17111033 / 16172600 / +5.8%	0.51 / 0.55 / -5.8%
tpcds_q97/duckdb:vortex-compact	22555987 / 22903751 / -1.5%	29338712 / 29804432 / -1.6%	0.77 / 0.77 / +0.0%
tpcds_q98/duckdb:vortex-compact	16191392 / 16363742 / -1.1%	27109663 / 27323140 / -0.8%	0.60 / 0.60 / -0.3%
tpcds_q99/duckdb:vortex-compact	14498354 / 14432456 / +0.5%	20345529 / 21608991 / -5.8%	0.71 / 0.67 / +6.7%

duckdb / parquet / ns (0.994x ➖, 3↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpcds_q01/duckdb:parquet	24941062 / 28609780 / -12.8% 🟢	35451475 / 31764902 / +11.6% 🔴	0.70 / 0.90 / -21.9%
tpcds_q02/duckdb:parquet	16029673 / 16006295 / +0.1%	21071495 / 20854876 / +1.0%	0.76 / 0.77 / -0.9%
tpcds_q03/duckdb:parquet	9296197 / 9282562 / +0.1%	15787906 / 15744258 / +0.3%	0.59 / 0.59 / -0.1%
tpcds_q04/duckdb:parquet	129996188 / 130114771 / -0.1%	134792231 / 135259694 / -0.3%	0.96 / 0.96 / +0.3%
tpcds_q05/duckdb:parquet	22049510 / 22816386 / -3.4%	26292486 / 26684218 / -1.5%	0.84 / 0.86 / -1.9%
tpcds_q06/duckdb:parquet	26752682 / 27291715 / -2.0%	36753843 / 36501601 / +0.7%	0.73 / 0.75 / -2.6%
tpcds_q07/duckdb:parquet	15597030 / 15672698 / -0.5%	23377753 / 23071245 / +1.3%	0.67 / 0.68 / -1.8%
tpcds_q08/duckdb:parquet	26118395 / 26572819 / -1.7%	33774554 / 32533798 / +3.8%	0.77 / 0.82 / -5.3%
tpcds_q09/duckdb:parquet	18994571 / 19197100 / -1.1%	25609741 / 21882513 / +17.0% 🔴	0.74 / 0.88 / -15.5%
tpcds_q10/duckdb:parquet	29084925 / 29320667 / -0.8%	38374463 / 37390538 / +2.6%	0.76 / 0.78 / -3.3%
tpcds_q11/duckdb:parquet	73333678 / 75755391 / -3.2%	78092976 / 81326953 / -4.0%	0.94 / 0.93 / +0.8%
tpcds_q12/duckdb:parquet	13011782 / 12958462 / +0.4%	19024343 / 18117574 / +5.0%	0.68 / 0.72 / -4.4%
tpcds_q13/duckdb:parquet	24830083 / 24513988 / +1.3%	32717533 / 31001397 / +5.5%	0.76 / 0.79 / -4.0%
tpcds_q14/duckdb:parquet	61723442 / 61769348 / -0.1%	85202991 / 70484567 / +20.9% 🔴	0.72 / 0.88 / -17.3%
tpcds_q15/duckdb:parquet	25646610 / 25571370 / +0.3%	30104534 / 29915334 / +0.6%	0.85 / 0.85 / -0.3%
tpcds_q16/duckdb:parquet	21495029 / 21293638 / +0.9%	29281735 / 29015432 / +0.9%	0.73 / 0.73 / +0.0%
tpcds_q17/duckdb:parquet	33235043 / 33050028 / +0.6%	40265443 / 39978219 / +0.7%	0.83 / 0.83 / -0.2%
tpcds_q18/duckdb:parquet	40703640 / 40872451 / -0.4%	50483763 / 49992730 / +1.0%	0.81 / 0.82 / -1.4%
tpcds_q19/duckdb:parquet	25376302 / 25306624 / +0.3%	32546164 / 31889931 / +2.1%	0.78 / 0.79 / -1.7%
tpcds_q20/duckdb:parquet	14392698 / 14027422 / +2.6%	18643117 / 18426281 / +1.2%	0.77 / 0.76 / +1.4%
tpcds_q21/duckdb:parquet	9397392 / 9616860 / -2.3%	12421686 / 12412587 / +0.1%	0.76 / 0.77 / -2.4%
tpcds_q22/duckdb:parquet	35840750 / 37954339 / -5.6%	40069778 / 39315929 / +1.9%	0.89 / 0.97 / -7.3%
tpcds_q23/duckdb:parquet	41571326 / 41593550 / -0.1%	49440890 / 51818064 / -4.6%	0.84 / 0.80 / +4.8%
tpcds_q24/duckdb:parquet	34723576 / 34208314 / +1.5%	42380965 / 42251526 / +0.3%	0.82 / 0.81 / +1.2%
tpcds_q25/duckdb:parquet	31698194 / 31808900 / -0.3%	42183654 / 40815160 / +3.4%	0.75 / 0.78 / -3.6%
tpcds_q26/duckdb:parquet	31986947 / 31720603 / +0.8%	39439370 / 38403064 / +2.7%	0.81 / 0.83 / -1.8%
tpcds_q27/duckdb:parquet	33446412 / 32256468 / +3.7%	40597936 / 40350519 / +0.6%	0.82 / 0.80 / +3.1%
tpcds_q28/duckdb:parquet	17616664 / 17904110 / -1.6%	25083603 / 21987739 / +14.1% 🔴	0.70 / 0.81 / -13.7%
tpcds_q29/duckdb:parquet	31576804 / 31577782 / -0.0%	39664722 / 42906801 / -7.6%	0.80 / 0.74 / +8.2%
tpcds_q30/duckdb:parquet	34744572 / 34781625 / -0.1%	43240272 / 43879930 / -1.5%	0.80 / 0.79 / +1.4%
tpcds_q31/duckdb:parquet	21230134 / 20877202 / +1.7%	26911576 / 25384038 / +6.0%	0.79 / 0.82 / -4.1%
tpcds_q32/duckdb:parquet	12430136 / 12385528 / +0.4%	18454943 / 18374980 / +0.4%	0.67 / 0.67 / -0.1%
tpcds_q33/duckdb:parquet	16461004 / 16413376 / +0.3%	24823224 / 25252964 / -1.7%	0.66 / 0.65 / +2.0%
tpcds_q34/duckdb:parquet	16634946 / 16580116 / +0.3%	21750674 / 22178368 / -1.9%	0.76 / 0.75 / +2.3%
tpcds_q35/duckdb:parquet	47294826 / 47387705 / -0.2%	58577105 / 61129138 / -4.2%	0.81 / 0.78 / +4.2%
tpcds_q36/duckdb:parquet	17200940 / 16100452 / +6.8%	23830332 / 25504647 / -6.6%	0.72 / 0.63 / +14.3%
tpcds_q37/duckdb:parquet	11602224 / 11451912 / +1.3%	20001377 / 18988832 / +5.3%	0.58 / 0.60 / -3.8%
tpcds_q38/duckdb:parquet	26789582 / 27198282 / -1.5%	32825821 / 31447458 / +4.4%	0.82 / 0.86 / -5.6%
tpcds_q39/duckdb:parquet	24717212 / 24750494 / -0.1%	28441511 / 27663585 / +2.8%	0.87 / 0.89 / -2.9%
tpcds_q40/duckdb:parquet	16690328 / 16585532 / +0.6%	21308120 / 21812675 / -2.3%	0.78 / 0.76 / +3.0%
tpcds_q41/duckdb:parquet	7944668 / 7953441 / -0.1%	13384312 / 13141416 / +1.8%	0.59 / 0.61 / -1.9%
tpcds_q42/duckdb:parquet	8741066 / 8881729 / -1.6%	15393279 / 15375712 / +0.1%	0.57 / 0.58 / -1.7%
tpcds_q43/duckdb:parquet	10793198 / 10686250 / +1.0%	15204038 / 15040517 / +1.1%	0.71 / 0.71 / -0.1%
tpcds_q44/duckdb:parquet	16131890 / 16336733 / -1.3%	22662048 / 21568038 / +5.1%	0.71 / 0.76 / -6.0%
tpcds_q45/duckdb:parquet	23874692 / 23915798 / -0.2%	30671880 / 29777915 / +3.0%	0.78 / 0.80 / -3.1%
tpcds_q46/duckdb:parquet	36795008 / 37407487 / -1.6%	45909506 / 45903067 / +0.0%	0.80 / 0.81 / -1.7%
tpcds_q47/duckdb:parquet	31411707 / 31645874 / -0.7%	38304025 / 40904032 / -6.4%	0.82 / 0.77 / +6.0%
tpcds_q48/duckdb:parquet	21418192 / 21697006 / -1.3%	27819648 / 31055814 / -10.4% 🟢	0.77 / 0.70 / +10.2%
tpcds_q49/duckdb:parquet	20223762 / 20544156 / -1.6%	28540183 / 28882506 / -1.2%	0.71 / 0.71 / -0.4%
tpcds_q50/duckdb:parquet	17983993 / 18074436 / -0.5%	23447276 / 23864806 / -1.7%	0.77 / 0.76 / +1.3%
tpcds_q51/duckdb:parquet	54459062 / 53838013 / +1.2%	64900460 / 66207198 / -2.0%	0.84 / 0.81 / +3.2%
tpcds_q52/duckdb:parquet	9014946 / 9158370 / -1.6%	15675138 / 15554699 / +0.8%	0.58 / 0.59 / -2.3%
tpcds_q53/duckdb:parquet	11927326 / 12077147 / -1.2%	16831310 / 17417491 / -3.4%	0.71 / 0.69 / +2.2%
tpcds_q54/duckdb:parquet	21315144 / 21351876 / -0.2%	30476818 / 32947700 / -7.5%	0.70 / 0.65 / +7.9%
tpcds_q55/duckdb:parquet	8913513 / 9020750 / -1.2%	16124076 / 15649945 / +3.0%	0.55 / 0.58 / -4.1%
tpcds_q56/duckdb:parquet	17040232 / 17331106 / -1.7%	24398248 / 24301827 / +0.4%	0.70 / 0.71 / -2.1%
tpcds_q57/duckdb:parquet	29554722 / 29459767 / +0.3%	35386407 / 35530876 / -0.4%	0.84 / 0.83 / +0.7%
tpcds_q58/duckdb:parquet	19262984 / 19230307 / +0.2%	26135337 / 26632986 / -1.9%	0.74 / 0.72 / +2.1%
tpcds_q59/duckdb:parquet	20155953 / 20232335 / -0.4%	25292728 / 25335050 / -0.2%	0.80 / 0.80 / -0.2%
tpcds_q60/duckdb:parquet	17708472 / 17814096 / -0.6%	24995907 / 25173896 / -0.7%	0.71 / 0.71 / +0.1%
tpcds_q61/duckdb:parquet	22622236 / 22272159 / +1.6%	29098298 / 28911227 / +0.6%	0.78 / 0.77 / +0.9%
tpcds_q62/duckdb:parquet	10941810 / 10984585 / -0.4%	15517826 / 14790784 / +4.9%	0.71 / 0.74 / -5.1%
tpcds_q63/duckdb:parquet	11251043 / 11330792 / -0.7%	16014237 / 16594471 / -3.5%	0.70 / 0.68 / +2.9%
tpcds_q64/duckdb:parquet	54296682 / 54188276 / +0.2%	63664641 / 64939633 / -2.0%	0.85 / 0.83 / +2.2%
tpcds_q65/duckdb:parquet	14991065 / 14836324 / +1.0%	20575687 / 21459103 / -4.1%	0.73 / 0.69 / +5.4%
tpcds_q66/duckdb:parquet	25241398 / 25201980 / +0.2%	31993173 / 32003750 / -0.0%	0.79 / 0.79 / +0.2%
tpcds_q67/duckdb:parquet	77959460 / 77806234 / +0.2%	84222450 / 84999094 / -0.9%	0.93 / 0.92 / +1.1%
tpcds_q68/duckdb:parquet	30361625 / 30619401 / -0.8%	40096189 / 39583151 / +1.3%	0.76 / 0.77 / -2.1%
tpcds_q69/duckdb:parquet	30667427 / 29242928 / +4.9%	38938725 / 38375838 / +1.5%	0.79 / 0.76 / +3.4%
tpcds_q70/duckdb:parquet	16249138 / 18349106 / -11.4% 🟢	28147641 / 23040313 / +22.2% 🔴	0.58 / 0.80 / -27.5%
tpcds_q71/duckdb:parquet	15218178 / 15225652 / -0.0%	21694037 / 21268212 / +2.0%	0.70 / 0.72 / -2.0%
tpcds_q72/duckdb:parquet	81898154 / 81855654 / +0.1%	86239649 / 88935212 / -3.0%	0.95 / 0.92 / +3.2%
tpcds_q73/duckdb:parquet	13973795 / 13804393 / +1.2%	19155004 / 19606827 / -2.3%	0.73 / 0.70 / +3.6%
tpcds_q74/duckdb:parquet	100574550 / 100936950 / -0.4%	108076460 / 113869488 / -5.1%	0.93 / 0.89 / +5.0%
tpcds_q75/duckdb:parquet	41111102 / 41701056 / -1.4%	50653602 / 51688975 / -2.0%	0.81 / 0.81 / +0.6%
tpcds_q76/duckdb:parquet	13870920 / 14509374 / -4.4%	21707440 / 21518745 / +0.9%	0.64 / 0.67 / -5.2%
tpcds_q77/duckdb:parquet	17615480 / 17954662 / -1.9%	25507564 / 25635385 / -0.5%	0.69 / 0.70 / -1.4%
tpcds_q78/duckdb:parquet	48856148 / 49169586 / -0.6%	53747978 / 55502597 / -3.2%	0.91 / 0.89 / +2.6%
tpcds_q79/duckdb:parquet	21363744 / 21155404 / +1.0%	29271616 / 28616892 / +2.3%	0.73 / 0.74 / -1.3%
tpcds_q80/duckdb:parquet	33008536 / 32923727 / +0.3%	43060917 / 40650890 / +5.9%	0.77 / 0.81 / -5.4%
tpcds_q81/duckdb:parquet	31668792 / 31643012 / +0.1%	40901368 / 39612783 / +3.3%	0.77 / 0.80 / -3.1%
tpcds_q82/duckdb:parquet	12705004 / 12879631 / -1.4%	17732826 / 18528972 / -4.3%	0.72 / 0.70 / +3.1%
tpcds_q83/duckdb:parquet	18176514 / 16907942 / +7.5%	21171959 / 21731069 / -2.6%	0.86 / 0.78 / +10.3%
tpcds_q84/duckdb:parquet	18788426 / 18806368 / -0.1%	26940104 / 24333288 / +10.7% 🔴	0.70 / 0.77 / -9.8%
tpcds_q85/duckdb:parquet	35593630 / 35867938 / -0.8%	45011819 / 45088457 / -0.2%	0.79 / 0.80 / -0.6%
tpcds_q86/duckdb:parquet	11630942 / 11577638 / +0.5%	17237262 / 17172852 / +0.4%	0.67 / 0.67 / +0.1%
tpcds_q87/duckdb:parquet	29015886 / 28877938 / +0.5%	34163896 / 33424817 / +2.2%	0.85 / 0.86 / -1.7%
tpcds_q88/duckdb:parquet	27415444 / 28521062 / -3.9%	36228031 / 32005183 / +13.2% 🔴	0.76 / 0.89 / -15.1%
tpcds_q89/duckdb:parquet	13100074 / 13152210 / -0.4%	18873728 / 18475573 / +2.2%	0.69 / 0.71 / -2.5%
tpcds_q90/duckdb:parquet	7051189 / 8478552 / -16.8% 🟢	11520508 / 12244039 / -5.9%	0.61 / 0.69 / -11.6%
tpcds_q91/duckdb:parquet	21701384 / 21779128 / -0.4%	28857317 / 28951485 / -0.3%	0.75 / 0.75 / -0.0%
tpcds_q92/duckdb:parquet	12580508 / 12605537 / -0.2%	19738043 / 19904779 / -0.8%	0.64 / 0.63 / +0.6%
tpcds_q93/duckdb:parquet	21752070 / 21911203 / -0.7%	30910180 / 27319305 / +13.1% 🔴	0.70 / 0.80 / -12.3%
tpcds_q94/duckdb:parquet	17106200 / 17150832 / -0.3%	26072167 / 28272643 / -7.8%	0.66 / 0.61 / +8.2%
tpcds_q95/duckdb:parquet	91135092 / 94591250 / -3.7%	98777384 / 97963368 / +0.8%	0.92 / 0.97 / -4.4%
tpcds_q96/duckdb:parquet	7472278 / 7137060 / +4.7%	11660781 / 10954846 / +6.4%	0.64 / 0.65 / -1.6%
tpcds_q97/duckdb:parquet	26362956 / 26198002 / +0.6%	33125994 / 33667455 / -1.6%	0.80 / 0.78 / +2.3%
tpcds_q98/duckdb:parquet	15156493 / 15224786 / -0.4%	22143341 / 22399892 / -1.1%	0.68 / 0.68 / +0.7%
tpcds_q99/duckdb:parquet	17350118 / 17478820 / -0.7%	21621662 / 21458386 / +0.8%	0.80 / 0.81 / -1.5%

No file size changes detected.

github-actions · 2026-10-14T13:34:01Z

Benchmarks: TPC-H SF=10 on NVME 📖

Commits: PR 85e620b1 vs base 73192765
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.4%
Engines: DataFusion No clear signal (-0.1%, low confidence) · DuckDB No clear signal (-0.6%, low confidence)
Vortex (geomean): hot 0.991x ➖ · cold 1.036x ➖
Parquet (geomean): hot 0.995x ➖ · cold 1.013x ➖
Shifts: Parquet (control) -0.5% · Median polish -0.6%

How to read Verdict and Engines

Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.989x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed	90205996 / 91979948 / -1.9%	161364610 / 156047967 / +3.4%	0.56 / 0.59 / -5.2%
tpch_q02/datafusion:vortex-file-compressed	64550705 / 65182915 / -1.0%	98554638 / 102449068 / -3.8%	0.65 / 0.64 / +2.9%
tpch_q03/datafusion:vortex-file-compressed	64407678 / 64761091 / -0.5%	118331632 / 121644544 / -2.7%	0.54 / 0.53 / +2.2%
tpch_q04/datafusion:vortex-file-compressed	34790550 / 34672084 / +0.3%	80519327 / 78183702 / +3.0%	0.43 / 0.44 / -2.6%
tpch_q05/datafusion:vortex-file-compressed	116574325 / 117751071 / -1.0%	183888261 / 172650056 / +6.5%	0.63 / 0.68 / -7.0%
tpch_q06/datafusion:vortex-file-compressed	14262531 / 13982184 / +2.0%	74403273 / 70973659 / +4.8%	0.19 / 0.20 / -2.7%
tpch_q07/datafusion:vortex-file-compressed	138147445 / 138429118 / -0.2%	202511939 / 195700679 / +3.5%	0.68 / 0.71 / -3.6%
tpch_q08/datafusion:vortex-file-compressed	140734354 / 145393192 / -3.2%	207470755 / 205895718 / +0.8%	0.68 / 0.71 / -3.9%
tpch_q09/datafusion:vortex-file-compressed	180587547 / 184642043 / -2.2%	266960044 / 274446519 / -2.7%	0.68 / 0.67 / +0.5%
tpch_q10/datafusion:vortex-file-compressed	72478151 / 73365159 / -1.2%	138404162 / 139409227 / -0.7%	0.52 / 0.53 / -0.5%
tpch_q11/datafusion:vortex-file-compressed	42544699 / 42991586 / -1.0%	69959412 / 65295482 / +7.1%	0.61 / 0.66 / -7.6%
tpch_q12/datafusion:vortex-file-compressed	44045510 / 45601517 / -3.4%	92251496 / 90745357 / +1.7%	0.48 / 0.50 / -5.0%
tpch_q13/datafusion:vortex-file-compressed	43722013 / 43231779 / +1.1%	79958131 / 82534080 / -3.1%	0.55 / 0.52 / +4.4%
tpch_q14/datafusion:vortex-file-compressed	24412424 / 24872267 / -1.8%	103213322 / 101183380 / +2.0%	0.24 / 0.25 / -3.8%
tpch_q15/datafusion:vortex-file-compressed	36864142 / 36795142 / +0.2%	100729084 / 95887855 / +5.0%	0.37 / 0.38 / -4.6%
tpch_q16/datafusion:vortex-file-compressed	38282450 / 38507949 / -0.6%	71624531 / 68123532 / +5.1%	0.53 / 0.57 / -5.4%
tpch_q17/datafusion:vortex-file-compressed	171498298 / 178644453 / -4.0%	223155992 / 225061899 / -0.8%	0.77 / 0.79 / -3.2%
tpch_q18/datafusion:vortex-file-compressed	198861214 / 200091184 / -0.6%	257395197 / 259367540 / -0.8%	0.77 / 0.77 / +0.1%
tpch_q19/datafusion:vortex-file-compressed	35619457 / 36034413 / -1.2%	96856302 / 92589117 / +4.6%	0.37 / 0.39 / -5.5%
tpch_q20/datafusion:vortex-file-compressed	62826650 / 63466886 / -1.0%	124553116 / 119163233 / +4.5%	0.50 / 0.53 / -5.3%
tpch_q21/datafusion:vortex-file-compressed	178125867 / 180633083 / -1.4%	241207736 / 241849215 / -0.3%	0.74 / 0.75 / -1.1%
tpch_q22/datafusion:vortex-file-compressed	25441045 / 25654458 / -0.8%	53855671 / 51712577 / +4.1%	0.47 / 0.50 / -4.8%

datafusion / vortex-compact / ns (0.992x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-compact	94506550 / 95281743 / -0.8%	157410728 / 157021112 / +0.2%	0.60 / 0.61 / -1.1%
tpch_q02/datafusion:vortex-compact	65372130 / 65874708 / -0.8%	95409317 / 98806346 / -3.4%	0.69 / 0.67 / +2.8%
tpch_q03/datafusion:vortex-compact	65188277 / 65397337 / -0.3%	112273853 / 108909740 / +3.1%	0.58 / 0.60 / -3.3%
tpch_q04/datafusion:vortex-compact	39330265 / 39831038 / -1.3%	82749680 / 81206746 / +1.9%	0.48 / 0.49 / -3.1%
tpch_q05/datafusion:vortex-compact	116281673 / 117229766 / -0.8%	174318607 / 169503462 / +2.8%	0.67 / 0.69 / -3.5%
tpch_q06/datafusion:vortex-compact	18254239 / 18519477 / -1.4%	60009034 / 64691703 / -7.2%	0.30 / 0.29 / +6.3%
tpch_q07/datafusion:vortex-compact	139265843 / 140977356 / -1.2%	193486916 / 184765227 / +4.7%	0.72 / 0.76 / -5.7%
tpch_q08/datafusion:vortex-compact	141993874 / 142180163 / -0.1%	202482624 / 226425438 / -10.6% 🟢	0.70 / 0.63 / +11.7%
tpch_q09/datafusion:vortex-compact	183931015 / 183582897 / +0.2%	289966408 / 245805606 / +18.0% 🔴	0.63 / 0.75 / -15.1%
tpch_q10/datafusion:vortex-compact	76656943 / 77967812 / -1.7%	128534232 / 123802171 / +3.8%	0.60 / 0.63 / -5.3%
tpch_q11/datafusion:vortex-compact	42995339 / 43555702 / -1.3%	68693483 / 67130677 / +2.3%	0.63 / 0.65 / -3.5%
tpch_q12/datafusion:vortex-compact	55336956 / 55666581 / -0.6%	98524220 / 92491678 / +6.5%	0.56 / 0.60 / -6.7%
tpch_q13/datafusion:vortex-compact	49564752 / 49447233 / +0.2%	76308064 / 72941917 / +4.6%	0.65 / 0.68 / -4.2%
tpch_q14/datafusion:vortex-compact	27464628 / 27889997 / -1.5%	96866377 / 95432386 / +1.5%	0.28 / 0.29 / -3.0%
tpch_q15/datafusion:vortex-compact	46030961 / 46287789 / -0.6%	100249959 / 102429774 / -2.1%	0.46 / 0.45 / +1.6%
tpch_q16/datafusion:vortex-compact	40844104 / 41343328 / -1.2%	70571312 / 69354410 / +1.8%	0.58 / 0.60 / -2.9%
tpch_q17/datafusion:vortex-compact	170402419 / 174497703 / -2.3%	216355122 / 215519638 / +0.4%	0.79 / 0.81 / -2.7%
tpch_q18/datafusion:vortex-compact	198656548 / 201644629 / -1.5%	252723730 / 249570956 / +1.3%	0.79 / 0.81 / -2.7%
tpch_q19/datafusion:vortex-compact	42984063 / 42229723 / +1.8%	89835851 / 89652101 / +0.2%	0.48 / 0.47 / +1.6%
tpch_q20/datafusion:vortex-compact	65695880 / 66366097 / -1.0%	119675186 / 115506356 / +3.6%	0.55 / 0.57 / -4.5%
tpch_q21/datafusion:vortex-compact	182748913 / 185702454 / -1.6%	244709064 / 243719604 / +0.4%	0.75 / 0.76 / -2.0%
tpch_q22/datafusion:vortex-compact	28561264 / 28276821 / +1.0%	54475468 / 52315666 / +4.1%	0.52 / 0.54 / -3.0%

datafusion / parquet / ns (0.992x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet	86956641 / 87314844 / -0.4%	132687407 / 134642870 / -1.5%	0.66 / 0.65 / +1.1%
tpch_q02/datafusion:parquet	158655140 / 158332385 / +0.2%	187268403 / 187765065 / -0.3%	0.85 / 0.84 / +0.5%
tpch_q03/datafusion:parquet	142467560 / 142128683 / +0.2%	194465359 / 195953906 / -0.8%	0.73 / 0.73 / +1.0%
tpch_q04/datafusion:parquet	59443560 / 59769059 / -0.5%	101289740 / 98449295 / +2.9%	0.59 / 0.61 / -3.3%
tpch_q05/datafusion:parquet	179713768 / 180941767 / -0.7%	238665451 / 244141391 / -2.2%	0.75 / 0.74 / +1.6%
tpch_q06/datafusion:parquet	34914774 / 35257030 / -1.0%	80191527 / 84088336 / -4.6%	0.44 / 0.42 / +3.8%
tpch_q07/datafusion:parquet	226347676 / 229466627 / -1.4%	285786270 / 289002065 / -1.1%	0.79 / 0.79 / -0.2%
tpch_q08/datafusion:parquet	231145632 / 233143435 / -0.9%	301819000 / 297393832 / +1.5%	0.77 / 0.78 / -2.3%
tpch_q09/datafusion:parquet	308961263 / 314300806 / -1.7%	391949175 / 378374355 / +3.6%	0.79 / 0.83 / -5.1%
tpch_q10/datafusion:parquet	394859085 / 404861524 / -2.5%	457759746 / 454461515 / +0.7%	0.86 / 0.89 / -3.2%
tpch_q11/datafusion:parquet	104200455 / 104804178 / -0.6%	128943178 / 128700903 / +0.2%	0.81 / 0.81 / -0.8%
tpch_q12/datafusion:parquet	84513408 / 84802706 / -0.3%	124759229 / 126050732 / -1.0%	0.68 / 0.67 / +0.7%
tpch_q13/datafusion:parquet	227293721 / 227877066 / -0.3%	256970998 / 257211707 / -0.1%	0.88 / 0.89 / -0.2%
tpch_q14/datafusion:parquet	85830676 / 88780173 / -3.3%	196364455 / 193439120 / +1.5%	0.44 / 0.46 / -4.8%
tpch_q15/datafusion:parquet	90213783 / 90652216 / -0.5%	140505553 / 141800207 / -0.9%	0.64 / 0.64 / +0.4%
tpch_q16/datafusion:parquet	94903968 / 95305781 / -0.4%	123120284 / 122083838 / +0.8%	0.77 / 0.78 / -1.3%
tpch_q17/datafusion:parquet	215012744 / 213540001 / +0.7%	271220234 / 266269957 / +1.9%	0.79 / 0.80 / -1.1%
tpch_q18/datafusion:parquet	286398385 / 287728653 / -0.5%	336640297 / 326370546 / +3.1%	0.85 / 0.88 / -3.5%
tpch_q19/datafusion:parquet	109409800 / 109177490 / +0.2%	179176714 / 172071778 / +4.1%	0.61 / 0.63 / -3.8%
tpch_q20/datafusion:parquet	182567804 / 183720874 / -0.6%	250624779 / 237748739 / +5.4%	0.73 / 0.77 / -5.7%
tpch_q21/datafusion:parquet	237332659 / 245339492 / -3.3%	316987072 / 317398755 / -0.1%	0.75 / 0.77 / -3.1%
tpch_q22/datafusion:parquet	199438177 / 199178900 / +0.1%	224074481 / 223471712 / +0.3%	0.89 / 0.89 / -0.1%

duckdb / vortex-file-compressed / ns (0.989x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed	52420846 / 55387388 / -5.4%	97786357 / 97745340 / +0.0%	0.54 / 0.57 / -5.4%
tpch_q02/duckdb:vortex-file-compressed	31928493 / 31838596 / +0.3%	46500278 / 45704308 / +1.7%	0.69 / 0.70 / -1.4%
tpch_q03/duckdb:vortex-file-compressed	55908218 / 57335831 / -2.5%	111408186 / 104992032 / +6.1%	0.50 / 0.55 / -8.1%
tpch_q04/duckdb:vortex-file-compressed	81691983 / 80211755 / +1.8%	125375500 / 116879492 / +7.3%	0.65 / 0.69 / -5.1%
tpch_q05/duckdb:vortex-file-compressed	64725585 / 65173813 / -0.7%	135267817 / 125286312 / +8.0%	0.48 / 0.52 / -8.0%
tpch_q06/duckdb:vortex-file-compressed	20629590 / 21035567 / -1.9%	64244899 / 61453451 / +4.5%	0.32 / 0.34 / -6.2%
tpch_q07/duckdb:vortex-file-compressed	57128764 / 60702349 / -5.9%	130887216 / 126461398 / +3.5%	0.44 / 0.48 / -9.1%
tpch_q08/duckdb:vortex-file-compressed	83021113 / 85402769 / -2.8%	156992372 / 149537260 / +5.0%	0.53 / 0.57 / -7.4%
tpch_q09/duckdb:vortex-file-compressed	160298303 / 163156598 / -1.8%	230479942 / 222775454 / +3.5%	0.70 / 0.73 / -5.0%
tpch_q10/duckdb:vortex-file-compressed	111160760 / 110500041 / +0.6%	182562785 / 161958627 / +12.7% 🔴	0.61 / 0.68 / -10.8%
tpch_q11/duckdb:vortex-file-compressed	16921833 / 17044749 / -0.7%	28337855 / 29628005 / -4.4%	0.60 / 0.58 / +3.8%
tpch_q12/duckdb:vortex-file-compressed	54430657 / 57538851 / -5.4%	111485921 / 113992218 / -2.2%	0.49 / 0.50 / -3.3%
tpch_q13/duckdb:vortex-file-compressed	83351257 / 86197912 / -3.3%	134781771 / 140389073 / -4.0%	0.62 / 0.61 / +0.7%
tpch_q14/duckdb:vortex-file-compressed	30981801 / 30406963 / +1.9%	81788315 / 72716477 / +12.5% 🔴	0.38 / 0.42 / -9.4%
tpch_q15/duckdb:vortex-file-compressed	37528158 / 40167427 / -6.6%	96950230 / 90703806 / +6.9%	0.39 / 0.44 / -12.6%
tpch_q16/duckdb:vortex-file-compressed	42274160 / 42093051 / +0.4%	53888115 / 52776573 / +2.1%	0.78 / 0.80 / -1.6%
tpch_q17/duckdb:vortex-file-compressed	60784512 / 58507640 / +3.9%	144001353 / 112749787 / +27.7% 🔴	0.42 / 0.52 / -18.7%
tpch_q18/duckdb:vortex-file-compressed	121150475 / 127708988 / -5.1%	163301026 / 148630561 / +9.9%	0.74 / 0.86 / -13.7%
tpch_q19/duckdb:vortex-file-compressed	44986835 / 43064339 / +4.5%	105580841 / 100527535 / +5.0%	0.43 / 0.43 / -0.5%
tpch_q20/duckdb:vortex-file-compressed	59430313 / 58177190 / +2.2%	130805721 / 110039179 / +18.9% 🔴	0.45 / 0.53 / -14.1%
tpch_q21/duckdb:vortex-file-compressed	238849226 / 238626006 / +0.1%	295690328 / 281622971 / +5.0%	0.81 / 0.85 / -4.7%
tpch_q22/duckdb:vortex-file-compressed	38519755 / 37513902 / +2.7%	55822378 / 52220351 / +6.9%	0.69 / 0.72 / -3.9%

duckdb / vortex-compact / ns (0.992x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-compact	65147991 / 64377812 / +1.2%	113008277 / 104403566 / +8.2%	0.58 / 0.62 / -6.5%
tpch_q02/duckdb:vortex-compact	35946306 / 35748411 / +0.6%	52958605 / 49618177 / +6.7%	0.68 / 0.72 / -5.8%
tpch_q03/duckdb:vortex-compact	59961608 / 59897362 / +0.1%	106670172 / 98020946 / +8.8%	0.56 / 0.61 / -8.0%
tpch_q04/duckdb:vortex-compact	81405642 / 81603956 / -0.2%	114151878 / 109498327 / +4.2%	0.71 / 0.75 / -4.3%
tpch_q05/duckdb:vortex-compact	66030357 / 68530187 / -3.6%	114135299 / 110025179 / +3.7%	0.58 / 0.62 / -7.1%
tpch_q06/duckdb:vortex-compact	25648483 / 24789127 / +3.5%	65223028 / 57996914 / +12.5% 🔴	0.39 / 0.43 / -8.0%
tpch_q07/duckdb:vortex-compact	67856184 / 69638913 / -2.6%	131211534 / 128312362 / +2.3%	0.52 / 0.54 / -4.7%
tpch_q08/duckdb:vortex-compact	86377445 / 86972155 / -0.7%	147257852 / 134662330 / +9.4%	0.59 / 0.65 / -9.2%
tpch_q09/duckdb:vortex-compact	171551130 / 167202175 / +2.6%	228053872 / 228243074 / -0.1%	0.75 / 0.73 / +2.7%
tpch_q10/duckdb:vortex-compact	115294324 / 115299971 / -0.0%	165634893 / 157743810 / +5.0%	0.70 / 0.73 / -4.8%
tpch_q11/duckdb:vortex-compact	18628471 / 18982337 / -1.9%	36981490 / 35483301 / +4.2%	0.50 / 0.53 / -5.8%
tpch_q12/duckdb:vortex-compact	66376020 / 65774142 / +0.9%	107872781 / 103190159 / +4.5%	0.62 / 0.64 / -3.5%
tpch_q13/duckdb:vortex-compact	85631136 / 88490624 / -3.2%	123064939 / 140453263 / -12.4% 🟢	0.70 / 0.63 / +10.4%
tpch_q14/duckdb:vortex-compact	34260012 / 34900404 / -1.8%	78713482 / 75348021 / +4.5%	0.44 / 0.46 / -6.0%
tpch_q15/duckdb:vortex-compact	43756566 / 42504980 / +2.9%	99310079 / 92414054 / +7.5%	0.44 / 0.46 / -4.2%
tpch_q16/duckdb:vortex-compact	45090944 / 44851864 / +0.5%	63732785 / 54585990 / +16.8% 🔴	0.71 / 0.82 / -13.9%
tpch_q17/duckdb:vortex-compact	56002532 / 57266977 / -2.2%	107428468 / 100655020 / +6.7%	0.52 / 0.57 / -8.4%
tpch_q18/duckdb:vortex-compact	132858122 / 133946943 / -0.8%	155673882 / 145527888 / +7.0%	0.85 / 0.92 / -7.3%
tpch_q19/duckdb:vortex-compact	43322643 / 45255195 / -4.3%	91902619 / 85755105 / +7.2%	0.47 / 0.53 / -10.7%
tpch_q20/duckdb:vortex-compact	66711422 / 68274407 / -2.3%	128593474 / 126323368 / +1.8%	0.52 / 0.54 / -4.0%
tpch_q21/duckdb:vortex-compact	245377181 / 247490733 / -0.9%	283124980 / 278691026 / +1.6%	0.87 / 0.89 / -2.4%
tpch_q22/duckdb:vortex-compact	40574589 / 42197358 / -3.8%	58677972 / 56189608 / +4.4%	0.69 / 0.75 / -7.9%

duckdb / parquet / ns (0.997x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet	72764249 / 72462972 / +0.4%	106590222 / 86578994 / +23.1% 🔴	0.68 / 0.84 / -18.4%
tpch_q02/duckdb:parquet	80069331 / 80749881 / -0.8%	93893535 / 92921722 / +1.0%	0.85 / 0.87 / -1.9%
tpch_q03/duckdb:parquet	123071401 / 121075657 / +1.6%	149779293 / 148810046 / +0.7%	0.82 / 0.81 / +1.0%
tpch_q04/duckdb:parquet	75195258 / 75910303 / -0.9%	101528161 / 93401032 / +8.7%	0.74 / 0.81 / -8.9%
tpch_q05/duckdb:parquet	131933402 / 129218824 / +2.1%	187259949 / 159519922 / +17.4% 🔴	0.70 / 0.81 / -13.0%
tpch_q06/duckdb:parquet	34364044 / 35119800 / -2.2%	48058941 / 47026661 / +2.2%	0.72 / 0.75 / -4.3%
tpch_q07/duckdb:parquet	93107061 / 93657694 / -0.6%	130175345 / 148221038 / -12.2% 🟢	0.72 / 0.63 / +13.2%
tpch_q08/duckdb:parquet	149464979 / 152915790 / -2.3%	187059683 / 186061003 / +0.5%	0.80 / 0.82 / -2.8%
tpch_q09/duckdb:parquet	227716169 / 228234866 / -0.2%	262065463 / 263145554 / -0.4%	0.87 / 0.87 / +0.2%
tpch_q10/duckdb:parquet	512163551 / 514332101 / -0.4%	540763083 / 549866691 / -1.7%	0.95 / 0.94 / +1.3%
tpch_q11/duckdb:parquet	33477017 / 33820132 / -1.0%	39344013 / 39325782 / +0.0%	0.85 / 0.86 / -1.1%
tpch_q12/duckdb:parquet	75904167 / 77046959 / -1.5%	88877533 / 89746747 / -1.0%	0.85 / 0.86 / -0.5%
tpch_q13/duckdb:parquet	324152046 / 323899855 / +0.1%	336249280 / 337871096 / -0.5%	0.96 / 0.96 / +0.6%
tpch_q14/duckdb:parquet	109778269 / 112095609 / -2.1%	142748384 / 133701881 / +6.8%	0.77 / 0.84 / -8.3%
tpch_q15/duckdb:parquet	43441416 / 43200405 / +0.6%	84278898 / 75821652 / +11.2% 🔴	0.52 / 0.57 / -9.5%
tpch_q16/duckdb:parquet	118280890 / 119654178 / -1.1%	128552849 / 129097583 / -0.4%	0.92 / 0.93 / -0.7%
tpch_q17/duckdb:parquet	80000510 / 80254288 / -0.3%	105011249 / 106321499 / -1.2%	0.76 / 0.75 / +0.9%
tpch_q18/duckdb:parquet	216185140 / 210145244 / +2.9%	170986259 / 171686557 / -0.4%	1.26 / 1.22 / +3.3%
tpch_q19/duckdb:parquet	165513571 / 165107894 / +0.2%	193976734 / 195378889 / -0.7%	0.85 / 0.85 / +1.0%
tpch_q20/duckdb:parquet	134992703 / 135503459 / -0.4%	169343953 / 172452734 / -1.8%	0.80 / 0.79 / +1.5%
tpch_q21/duckdb:parquet	274571847 / 274071951 / +0.2%	288206987 / 284354135 / +1.4%	0.95 / 0.96 / -1.2%
tpch_q22/duckdb:parquet	267616407 / 269162542 / -0.6%	278695744 / 282051697 / -1.2%	0.96 / 0.95 / +0.6%

No file size changes detected.

github-actions · 2026-10-14T13:34:31Z

Benchmarks: Statistical and Population Genetics 📖

Commits: PR 85e620b1 vs base 73192765
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.0%
Engines: DataFusion No clear signal (+1.5%, low confidence) · DuckDB No clear signal (-1.5%, low confidence)
Vortex (geomean): hot 0.992x ➖ · cold 1.006x ➖
Parquet (geomean): hot 0.992x ➖ · cold 0.989x ➖
Shifts: Parquet (control) -0.8% · Median polish -1.2%

How to read Verdict and Engines

Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.011x ➖, 0↑ 1↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
statpopgen_q00/datafusion:vortex-file-compressed	1842890 / 1814204 / +1.6%	7929913 / 5844935 / +35.7% 🔴	0.23 / 0.31 / -25.1%
statpopgen_q01/datafusion:vortex-file-compressed	23887170 / 22674080 / +5.4%	22938767 / 21511873 / +6.6%	1.04 / 1.05 / -1.2%
statpopgen_q02/datafusion:vortex-file-compressed	109771456 / 112926160 / -2.8%	139189220 / 141301141 / -1.5%	0.79 / 0.80 / -1.3%
statpopgen_q03/datafusion:vortex-file-compressed	348686154 / 347689792 / +0.3%	391834022 / 556316277 / -29.6% 🟢	0.89 / 0.62 / +42.4%
statpopgen_q04/datafusion:vortex-file-compressed	343618225 / 343625230 / -0.0%	388948486 / 385835120 / +0.8%	0.88 / 0.89 / -0.8%
statpopgen_q05/datafusion:vortex-file-compressed	248776082 / 212261690 / +17.2% 🔴	386831014 / 259340491 / +49.2% 🔴	0.64 / 0.82 / -21.4%
statpopgen_q06/datafusion:vortex-file-compressed	761747042 / 757085248 / +0.6%	903375061 / 788769226 / +14.5% 🔴	0.84 / 0.96 / -12.1%
statpopgen_q07/datafusion:vortex-file-compressed	404868970 / 410740214 / -1.4%	425991830 / 421381995 / +1.1%	0.95 / 0.97 / -2.5%
statpopgen_q08/datafusion:vortex-file-compressed	406948353 / 409301342 / -0.6%	434378165 / 428198704 / +1.4%	0.94 / 0.96 / -2.0%
statpopgen_q09/datafusion:vortex-file-compressed	245272489 / 250762414 / -2.2%	286719046 / 293624535 / -2.4%	0.86 / 0.85 / +0.2%
statpopgen_q10/datafusion:vortex-file-compressed	659021566 / 685749628 / -3.9%	707286088 / 711933295 / -0.7%	0.93 / 0.96 / -3.3%

datafusion / vortex-compact / ns (0.981x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
statpopgen_q00/datafusion:vortex-compact	1779670 / 1858424 / -4.2%	6940501 / 5793907 / +19.8% 🔴	0.26 / 0.32 / -20.1%
statpopgen_q01/datafusion:vortex-compact	26048162 / 27426822 / -5.0%	23746948 / 26525871 / -10.5% 🟢	1.10 / 1.03 / +6.1%
statpopgen_q02/datafusion:vortex-compact	211415470 / 212788614 / -0.6%	230033923 / 227333850 / +1.2%	0.92 / 0.94 / -1.8%
statpopgen_q03/datafusion:vortex-compact	460379007 / 470838916 / -2.2%	488876048 / 488412321 / +0.1%	0.94 / 0.96 / -2.3%
statpopgen_q04/datafusion:vortex-compact	464344197 / 467636585 / -0.7%	487679634 / 492249652 / -0.9%	0.95 / 0.95 / +0.2%
statpopgen_q05/datafusion:vortex-compact	313850572 / 315310638 / -0.5%	335748743 / 333792813 / +0.6%	0.93 / 0.94 / -1.0%
statpopgen_q06/datafusion:vortex-compact	880438536 / 879550654 / +0.1%	898448678 / 900911827 / -0.3%	0.98 / 0.98 / +0.4%
statpopgen_q07/datafusion:vortex-compact	919373740 / 941134306 / -2.3%	951601599 / 946008472 / +0.6%	0.97 / 0.99 / -2.9%
statpopgen_q08/datafusion:vortex-compact	919262804 / 938133816 / -2.0%	947365834 / 958195802 / -1.1%	0.97 / 0.98 / -0.9%
statpopgen_q09/datafusion:vortex-compact	361199784 / 365402972 / -1.2%	380517278 / 384389028 / -1.0%	0.95 / 0.95 / -0.1%
statpopgen_q10/datafusion:vortex-compact	764373026 / 781007750 / -2.1%	797284033 / 932191613 / -14.5% 🟢	0.96 / 0.84 / +14.4%

datafusion / parquet / ns (0.981x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
statpopgen_q00/datafusion:parquet	1995562 / 1996449 / -0.0%	91775567 / 90792361 / +1.1%	0.02 / 0.02 / -1.1%
statpopgen_q01/datafusion:parquet	161895458 / 160651529 / +0.8%	173829306 / 175570957 / -1.0%	0.93 / 0.92 / +1.8%
statpopgen_q02/datafusion:parquet	278807182 / 291269298 / -4.3%	421246227 / 425632846 / -1.0%	0.66 / 0.68 / -3.3%
statpopgen_q03/datafusion:parquet	394167124 / 385948078 / +2.1%	536620935 / 522876334 / +2.6%	0.73 / 0.74 / -0.5%
statpopgen_q04/datafusion:parquet	390941728 / 402143242 / -2.8%	513729192 / 528188473 / -2.7%	0.76 / 0.76 / -0.0%
statpopgen_q05/datafusion:parquet	318581796 / 315732582 / +0.9%	439082726 / 458750316 / -4.3%	0.73 / 0.69 / +5.4%
statpopgen_q06/datafusion:parquet	467044931 / 487046139 / -4.1%	647208665 / 636560616 / +1.7%	0.72 / 0.77 / -5.7%
statpopgen_q07/datafusion:parquet	425713895 / 461152888 / -7.7%	569570053 / 570631173 / -0.2%	0.75 / 0.81 / -7.5%
statpopgen_q08/datafusion:parquet	426926628 / 441127123 / -3.2%	542564474 / 542006077 / +0.1%	0.79 / 0.81 / -3.3%
statpopgen_q09/datafusion:parquet	352873426 / 354316582 / -0.4%	475118317 / 480582497 / -1.1%	0.74 / 0.74 / +0.7%
statpopgen_q10/datafusion:parquet	550549603 / 559520554 / -1.6%	711560012 / 709867611 / +0.2%	0.77 / 0.79 / -1.8%

duckdb / vortex-file-compressed / ns (0.988x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
statpopgen_q00/duckdb:vortex-file-compressed	9108156 / 8973116 / +1.5%	9455132 / 9417448 / +0.4%	0.96 / 0.95 / +1.1%
statpopgen_q01/duckdb:vortex-file-compressed	10264056 / 10386115 / -1.2%	14096725 / 14243246 / -1.0%	0.73 / 0.73 / -0.1%
statpopgen_q02/duckdb:vortex-file-compressed	301212698 / 308214782 / -2.3%	335161133 / 358168067 / -6.4%	0.90 / 0.86 / +4.4%
statpopgen_q03/duckdb:vortex-file-compressed	811220174 / 815180614 / -0.5%	817088863 / 832745063 / -1.9%	0.99 / 0.98 / +1.4%
statpopgen_q04/duckdb:vortex-file-compressed	808032840 / 810050940 / -0.2%	813457817 / 834626755 / -2.5%	0.99 / 0.97 / +2.3%
statpopgen_q05/duckdb:vortex-file-compressed	317538574 / 322203206 / -1.4%	344327883 / 342957160 / +0.4%	0.92 / 0.94 / -1.8%
statpopgen_q06/duckdb:vortex-file-compressed	1128999522 / 1143339585 / -1.3%	1146509790 / 1149913865 / -0.3%	0.98 / 0.99 / -1.0%
statpopgen_q07/duckdb:vortex-file-compressed	371871064 / 381593312 / -2.5%	435212780 / 420138950 / +3.6%	0.85 / 0.91 / -5.9%
statpopgen_q08/duckdb:vortex-file-compressed	366768144 / 386197274 / -5.0%	389292196 / 427418199 / -8.9%	0.94 / 0.90 / +4.3%
statpopgen_q09/duckdb:vortex-file-compressed	612540630 / 615434639 / -0.5%	633640412 / 631474251 / +0.3%	0.97 / 0.97 / -0.8%
statpopgen_q10/duckdb:vortex-file-compressed	1923757006 / 1916076751 / +0.4%	1897179112 / 1898746654 / -0.1%	1.01 / 1.01 / +0.5%

duckdb / vortex-compact / ns (0.987x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
statpopgen_q00/duckdb:vortex-compact	9101274 / 9052308 / +0.5%	9395832 / 9521859 / -1.3%	0.97 / 0.95 / +1.9%
statpopgen_q01/duckdb:vortex-compact	10091940 / 10162199 / -0.7%	13352863 / 13292411 / +0.5%	0.76 / 0.76 / -1.1%
statpopgen_q02/duckdb:vortex-compact	380727124 / 385830430 / -1.3%	398952252 / 400040708 / -0.3%	0.95 / 0.96 / -1.1%
statpopgen_q03/duckdb:vortex-compact	899917467 / 902296728 / -0.3%	902227310 / 903280942 / -0.1%	1.00 / 1.00 / -0.1%
statpopgen_q04/duckdb:vortex-compact	887296040 / 898342619 / -1.2%	903676776 / 915757883 / -1.3%	0.98 / 0.98 / +0.1%
statpopgen_q05/duckdb:vortex-compact	427560248 / 429762501 / -0.5%	444268237 / 439111502 / +1.2%	0.96 / 0.98 / -1.7%
statpopgen_q06/duckdb:vortex-compact	1164356727 / 1178353709 / -1.2%	1173580952 / 1169095762 / +0.4%	0.99 / 1.01 / -1.6%
statpopgen_q07/duckdb:vortex-compact	893388595 / 916964735 / -2.6%	911978269 / 917386821 / -0.6%	0.98 / 1.00 / -2.0%
statpopgen_q08/duckdb:vortex-compact	900646149 / 924415402 / -2.6%	920280701 / 924364744 / -0.4%	0.98 / 1.00 / -2.1%
statpopgen_q09/duckdb:vortex-compact	703844563 / 716676513 / -1.8%	721734668 / 717642364 / +0.6%	0.98 / 1.00 / -2.3%
statpopgen_q10/duckdb:vortex-compact	1987317113 / 2030007927 / -2.1%	1972016324 / 1980189141 / -0.4%	1.01 / 1.03 / -1.7%

duckdb / parquet / ns (1.003x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
statpopgen_q00/duckdb:parquet	244455066 / 243467764 / +0.4%	244620756 / 244573830 / +0.0%	1.00 / 1.00 / +0.4%
statpopgen_q01/duckdb:parquet	303161748 / 300928467 / +0.7%	303804097 / 303579249 / +0.1%	1.00 / 0.99 / +0.7%
statpopgen_q02/duckdb:parquet	526476588 / 565400144 / -6.9%	546484042 / 578549716 / -5.5%	0.96 / 0.98 / -1.4%
statpopgen_q03/duckdb:parquet	879267248 / 865195835 / +1.6%	854879916 / 849229612 / +0.7%	1.03 / 1.02 / +1.0%
statpopgen_q04/duckdb:parquet	853518893 / 862525389 / -1.0%	840964546 / 858393999 / -2.0%	1.01 / 1.00 / +1.0%
statpopgen_q05/duckdb:parquet	581252542 / 568828521 / +2.2%	588633179 / 575161167 / +2.3%	0.99 / 0.99 / -0.2%
statpopgen_q06/duckdb:parquet	709578784 / 735676902 / -3.5%	699928318 / 716442824 / -2.3%	1.01 / 1.03 / -1.3%
statpopgen_q07/duckdb:parquet	622407628 / 611738993 / +1.7%	679019627 / 726785260 / -6.6%	0.92 / 0.84 / +8.9%
statpopgen_q08/duckdb:parquet	622186468 / 618976287 / +0.5%	743272582 / 729964268 / +1.8%	0.84 / 0.85 / -1.3%
statpopgen_q09/duckdb:parquet	792464616 / 773483730 / +2.5%	814892279 / 813772582 / +0.1%	0.97 / 0.95 / +2.3%
statpopgen_q10/duckdb:parquet	1516911722 / 1441177226 / +5.3%	1269390147 / 1371698511 / -7.5%	1.19 / 1.05 / +13.7%

No file size changes detected.

github-actions · 2026-10-14T13:35:47Z

Benchmarks: String Encoding 📖

Commits: PR 85e620b1 vs base 73192765

vortex / vortex-file-compressed / ms (0.992x ➖, 0↑ 0↓)

name	ms (PR / base / %diff)
read/clickbench/URL/shard-0/fsst	32.25674 / 32.360001 / -0.3%
read/clickbench/URL/shard-0/onpair-12	19.414602 / 19.645837 / -1.2%
read/tpch/l_comment/fsst	51.652129 / 51.58402 / +0.1%
read/tpch/l_comment/onpair-12	43.825475 / 43.833028 / -0.0%
write/clickbench/URL/shard-0/fsst	486.747225 / 491.060684 / -0.9%
write/clickbench/URL/shard-0/onpair-12	816.950637 / 820.82864 / -0.5%
write/tpch/l_comment/fsst	1109.49945 / 1135.71187 / -2.3%
write/tpch/l_comment/onpair-12	1397.85454 / 1421.57993 / -1.7%

vortex / vortex-file-compressed / % (1.000x ➖, 0↑ 0↓)

name	% (PR / base / %diff)
size/clickbench/URL/shard-0/fsst	47.3744121 / 47.3744121 / +0.0%
size/clickbench/URL/shard-0/onpair-12	28.3410988 / 28.3410988 / +0.0%
size/tpch/l_comment/fsst	30.1093362 / 30.1093362 / +0.0%
size/tpch/l_comment/onpair-12	23.0415004 / 23.0415004 / +0.0%

mimalloc v3 returns freed memory to the OS 1s after it is freed, and that purge work lands in the middle of measured queries. Add vortex_bench::configure_allocator(), which sets mimalloc's purge_delay to -1 (never purge), and call it first thing in every benchmark binary. Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk> Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_0122rGn9fTSV47KLv191MTHB

Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk> Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_0122rGn9fTSV47KLv191MTHB

github-actions · 2026-10-14T13:43:28Z

Benchmarks: Compression 📖

Commits: PR 85e620b1 vs base 73192765

vortex / vortex-file-compressed / ns (0.976x ➖, 0↑ 0↓)

name	ns (PR / base / %diff)
compress time/Arade	766769571 / 789688923 / -2.9%
compress time/Bimbo	3554049323 / 3676796404 / -3.3%
compress time/CMSprovider	2507782779 / 2547973217 / -1.6%
compress time/Euro2016	268326519 / 268096449 / +0.1%
compress time/Food	317009049 / 317886972 / -0.3%
compress time/HashTags	458190990 / 462986842 / -1.0%
compress time/TPC-H l_comment canonical	592095283 / 602305202 / -1.7%
compress time/TPC-H l_comment chunked	601341563 / 607523285 / -1.0%
compress time/taxi	386589982 / 389081955 / -0.6%
compress time/wide table cols=100 chunks=1 rows=1000	7150235 / 7136692 / +0.2%
compress time/wide table cols=100 chunks=50 rows=1000	7141013 / 7244845 / -1.4%
compress time/wide table cols=1000 chunks=1 rows=1000	70383273 / 71289650 / -1.3%
compress time/wide table cols=1000 chunks=50 rows=1000	70429159 / 70612403 / -0.3%
compress time/wide table cols=10000 chunks=1 rows=1000	755259307 / 790999150 / -4.5%
compress time/wide table cols=10000 chunks=50 rows=1000	760006712 / 784218242 / -3.1%
decompress time/Arade	8864592 / 9497790 / -6.7%
decompress time/Bimbo	36351516 / 38961035 / -6.7%
decompress time/CMSprovider	28116145 / 28783668 / -2.3%
decompress time/Euro2016	10045995 / 10202034 / -1.5%
decompress time/Food	2606876 / 2469588 / +5.6%
decompress time/HashTags	43947195 / 47987039 / -8.4%
decompress time/TPC-H l_comment canonical	10899300 / 11633766 / -6.3%
decompress time/TPC-H l_comment chunked	10719390 / 11360105 / -5.6%
decompress time/taxi	5276170 / 5567761 / -5.2%
decompress time/wide table cols=100 chunks=1 rows=1000	1899936 / 1960168 / -3.1%
decompress time/wide table cols=100 chunks=50 rows=1000	1909811 / 1971817 / -3.1%
decompress time/wide table cols=1000 chunks=1 rows=1000	18525691 / 18480784 / +0.2%
decompress time/wide table cols=1000 chunks=50 rows=1000	18255740 / 18641466 / -2.1%
decompress time/wide table cols=10000 chunks=1 rows=1000	215778307 / 218461672 / -1.2%
decompress time/wide table cols=10000 chunks=50 rows=1000	213177306 / 219587734 / -2.9%

vortex / vortex-file-compressed / bytes (1.000x ➖, 0↑ 0↓)

name	bytes (PR / base / %diff)
vortex-file-compressed size/Arade	142213756 / 142213756 / +0.0%
vortex-file-compressed size/Bimbo	458581260 / 458581260 / +0.0%
vortex-file-compressed size/CMSprovider	420794836 / 420794836 / +0.0%
vortex-file-compressed size/Euro2016	164130260 / 164125572 / +0.0%
vortex-file-compressed size/Food	38950752 / 38950752 / +0.0%
vortex-file-compressed size/HashTags	196170516 / 196170516 / +0.0%
vortex-file-compressed size/TPC-H l_comment canonical	178688232 / 178688232 / +0.0%
vortex-file-compressed size/TPC-H l_comment chunked	178688232 / 178688232 / +0.0%
vortex-file-compressed size/taxi	49998092 / 49998092 / +0.0%
vortex-file-compressed size/wide table cols=100 chunks=1 rows=1000	934080 / 934080 / +0.0%
vortex-file-compressed size/wide table cols=100 chunks=50 rows=1000	934080 / 934080 / +0.0%
vortex-file-compressed size/wide table cols=1000 chunks=1 rows=1000	9325680 / 9325680 / +0.0%
vortex-file-compressed size/wide table cols=1000 chunks=50 rows=1000	9325680 / 9325680 / +0.0%
vortex-file-compressed size/wide table cols=10000 chunks=1 rows=1000	93277680 / 93277680 / +0.0%
vortex-file-compressed size/wide table cols=10000 chunks=50 rows=1000	93277680 / 93277680 / +0.0%

vortex / vortex-file-compressed / ratio (0.989x ➖, 0↑ 0↓)

name	ratio (PR / base / %diff)
vortex:parquet-zstd ratio compress time/Arade	0.344619473 / 0.350516494 / -1.7%
vortex:parquet-zstd ratio compress time/Bimbo	0.303436722 / 0.311374151 / -2.5%
vortex:parquet-zstd ratio compress time/CMSprovider	0.397121339 / 0.398653396 / -0.4%
vortex:parquet-zstd ratio compress time/Euro2016	0.251978913 / 0.2484766 / +1.4%
vortex:parquet-zstd ratio compress time/Food	0.431726933 / 0.429094692 / +0.6%
vortex:parquet-zstd ratio compress time/HashTags	0.255287922 / 0.253899755 / +0.5%
vortex:parquet-zstd ratio compress time/TPC-H l_comment canonical	0.227895774 / 0.228503238 / -0.3%
vortex:parquet-zstd ratio compress time/TPC-H l_comment chunked	0.231133872 / 0.230212147 / +0.4%
vortex:parquet-zstd ratio compress time/taxi	0.357803512 / 0.356133164 / +0.5%
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=1 rows=1000	1.8162722 / 1.79450125 / +1.2%
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=50 rows=1000	1.8224527 / 1.82647188 / -0.2%
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=1 rows=1000	1.5944083 / 1.59999703 / -0.3%
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=50 rows=1000	1.59003089 / 1.58232389 / +0.5%
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=1 rows=1000	1.66655914 / 1.72000448 / -3.1%
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=50 rows=1000	1.69659663 / 1.70560526 / -0.5%
vortex:parquet-zstd ratio decompress time/Arade	0.0159968699 / 0.0170233732 / -6.0%
vortex:parquet-zstd ratio decompress time/Bimbo	0.0227145651 / 0.0242044661 / -6.2%
vortex:parquet-zstd ratio decompress time/CMSprovider	0.0207225806 / 0.0210912157 / -1.7%
vortex:parquet-zstd ratio decompress time/Euro2016	0.0302717769 / 0.0307023939 / -1.4%
vortex:parquet-zstd ratio decompress time/Food	0.0153588497 / 0.0144972086 / +5.9%
vortex:parquet-zstd ratio decompress time/HashTags	0.0861147066 / 0.092644059 / -7.0%
vortex:parquet-zstd ratio decompress time/TPC-H l_comment canonical	0.0220640951 / 0.0233371452 / -5.5%
vortex:parquet-zstd ratio decompress time/TPC-H l_comment chunked	0.0216422595 / 0.0227810942 / -5.0%
vortex:parquet-zstd ratio decompress time/taxi	0.0243707792 / 0.0255858182 / -4.7%
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=1 rows=1000	0.912560765 / 0.948065001 / -3.7%
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=50 rows=1000	0.920439638 / 0.964379688 / -4.6%
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=1 rows=1000	0.791249175 / 0.783564366 / +1.0%
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=50 rows=1000	0.79094576 / 0.797628167 / -0.8%
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=1 rows=1000	0.88214441 / 0.902895658 / -2.3%
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=50 rows=1000	0.879531334 / 0.899523949 / -2.2%
vortex:parquet-zstd size/Arade	0.551185597 / 0.551185597 / -0.0%
vortex:parquet-zstd size/Bimbo	1.19261544 / 1.19261544 / +0.0%
vortex:parquet-zstd size/CMSprovider	1.11649863 / 1.11649863 / -0.0%
vortex:parquet-zstd size/Euro2016	1.33461969 / 1.33458157 / +0.0%
vortex:parquet-zstd size/Food	1.09107276 / 1.09107276 / -0.0%
vortex:parquet-zstd size/HashTags	1.46946859 / 1.46946859 / -0.0%
vortex:parquet-zstd size/TPC-H l_comment canonical	1.12837977 / 1.12837977 / -0.0%
vortex:parquet-zstd size/TPC-H l_comment chunked	1.12837977 / 1.12837977 / -0.0%
vortex:parquet-zstd size/taxi	0.904392267 / 0.904392267 / -0.0%
vortex:parquet-zstd size/wide table cols=100 chunks=1 rows=1000	1.0017975 / 1.0017975 / -0.0%
vortex:parquet-zstd size/wide table cols=100 chunks=50 rows=1000	1.0017975 / 1.0017975 / -0.0%
vortex:parquet-zstd size/wide table cols=1000 chunks=1 rows=1000	1.00017975 / 1.00017975 / -0.0%
vortex:parquet-zstd size/wide table cols=1000 chunks=50 rows=1000	1.00017975 / 1.00017975 / -0.0%
vortex:parquet-zstd size/wide table cols=10000 chunks=1 rows=1000	1.00040408 / 1.00040408 / -0.0%
vortex:parquet-zstd size/wide table cols=10000 chunks=50 rows=1000	1.00040408 / 1.00040408 / -0.0%

vortex / parquet / ns (0.992x ➖, 0↑ 0↓)

name	ns (PR / base / %diff)
parquet_rs-zstd compress time/Arade	2224974593 / 2252929426 / -1.2%
parquet_rs-zstd compress time/Bimbo	11712653960 / 11808290414 / -0.8%
parquet_rs-zstd compress time/CMSprovider	6314903111 / 6391449922 / -1.2%
parquet_rs-zstd compress time/Euro2016	1064876882 / 1078960550 / -1.3%
parquet_rs-zstd compress time/Food	734281382 / 740831751 / -0.9%
parquet_rs-zstd compress time/HashTags	1794800894 / 1823502518 / -1.6%
parquet_rs-zstd compress time/TPC-H l_comment canonical	2598096808 / 2635871623 / -1.4%
parquet_rs-zstd compress time/TPC-H l_comment chunked	2601702460 / 2638971457 / -1.4%
parquet_rs-zstd compress time/taxi	1080453292 / 1092518178 / -1.1%
parquet_rs-zstd compress time/wide table cols=100 chunks=1 rows=1000	3936764 / 3976978 / -1.0%
parquet_rs-zstd compress time/wide table cols=100 chunks=50 rows=1000	3918353 / 3966579 / -1.2%
parquet_rs-zstd compress time/wide table cols=1000 chunks=1 rows=1000	44143820 / 44556114 / -0.9%
parquet_rs-zstd compress time/wide table cols=1000 chunks=50 rows=1000	44294208 / 44625758 / -0.7%
parquet_rs-zstd compress time/wide table cols=10000 chunks=1 rows=1000	453184821 / 459882028 / -1.5%
parquet_rs-zstd compress time/wide table cols=10000 chunks=50 rows=1000	447959578 / 459788827 / -2.6%
parquet_rs-zstd decompress time/Arade	554145407 / 557926440 / -0.7%
parquet_rs-zstd decompress time/Bimbo	1600361521 / 1609663062 / -0.6%
parquet_rs-zstd decompress time/CMSprovider	1356787822 / 1364723039 / -0.6%
parquet_rs-zstd decompress time/Euro2016	331860103 / 332287900 / -0.1%
parquet_rs-zstd decompress time/Food	169731201 / 170349208 / -0.4%
parquet_rs-zstd decompress time/HashTags	510333214 / 517972113 / -1.5%
parquet_rs-zstd decompress time/TPC-H l_comment canonical	493983549 / 498508533 / -0.9%
parquet_rs-zstd decompress time/TPC-H l_comment chunked	495299023 / 498663712 / -0.7%
parquet_rs-zstd decompress time/taxi	216495745 / 217611216 / -0.5%
parquet_rs-zstd decompress time/wide table cols=100 chunks=1 rows=1000	2081983 / 2067546 / +0.7%
parquet_rs-zstd decompress time/wide table cols=100 chunks=50 rows=1000	2074890 / 2044648 / +1.5%
parquet_rs-zstd decompress time/wide table cols=1000 chunks=1 rows=1000	23413220 / 23585534 / -0.7%
parquet_rs-zstd decompress time/wide table cols=1000 chunks=50 rows=1000	23080900 / 23371123 / -1.2%
parquet_rs-zstd decompress time/wide table cols=10000 chunks=1 rows=1000	244606557 / 241956720 / +1.1%
parquet_rs-zstd decompress time/wide table cols=10000 chunks=50 rows=1000	242376022 / 244115495 / -0.7%

vortex / parquet / bytes (1.000x ➖, 0↑ 0↓)

name	bytes (PR / base / %diff)
parquet size/Arade	258014282 / 258014282 / +0.0%
parquet size/Bimbo	384517292 / 384517292 / +0.0%
parquet size/CMSprovider	376887911 / 376887911 / +0.0%
parquet size/Euro2016	122979049 / 122979049 / +0.0%
parquet size/Food	35699500 / 35699500 / +0.0%
parquet size/HashTags	133497590 / 133497590 / +0.0%
parquet size/TPC-H l_comment canonical	158358238 / 158358238 / +0.0%
parquet size/TPC-H l_comment chunked	158358238 / 158358238 / +0.0%
parquet size/taxi	55283635 / 55283635 / +0.0%
parquet size/wide table cols=100 chunks=1 rows=1000	932404 / 932404 / +0.0%
parquet size/wide table cols=100 chunks=50 rows=1000	932404 / 932404 / +0.0%
parquet size/wide table cols=1000 chunks=1 rows=1000	9324004 / 9324004 / +0.0%
parquet size/wide table cols=1000 chunks=50 rows=1000	9324004 / 9324004 / +0.0%
parquet size/wide table cols=10000 chunks=1 rows=1000	93240004 / 93240004 / +0.0%
parquet size/wide table cols=10000 chunks=50 rows=1000	93240004 / 93240004 / +0.0%

vortex / arrow-ipc / ns (1.000x ➖, 0↑ 2↓)

name	ns (PR / base / %diff)
arrow-ipc compress time/Arade	99027204 / 99392422 / -0.4%
arrow-ipc compress time/Bimbo	612624684 / 628506998 / -2.5%
arrow-ipc compress time/CMSprovider	380980915 / 387079184 / -1.6%
arrow-ipc compress time/Euro2016	38432989 / 38803954 / -1.0%
arrow-ipc compress time/Food	33667479 / 34176003 / -1.5%
arrow-ipc compress time/HashTags	78455046 / 79384042 / -1.2%
arrow-ipc compress time/TPC-H l_comment canonical	514029648 / 518316410 / -0.8%
arrow-ipc compress time/TPC-H l_comment chunked	496130351 / 505986446 / -1.9%
arrow-ipc compress time/taxi	73875286 / 75551762 / -2.2%
arrow-ipc compress time/wide table cols=100 chunks=1 rows=1000	202367 / 214860 / -5.8%
arrow-ipc compress time/wide table cols=100 chunks=50 rows=1000	202977 / 206336 / -1.6%
arrow-ipc compress time/wide table cols=1000 chunks=1 rows=1000	2233509 / 2255567 / -1.0%
arrow-ipc compress time/wide table cols=1000 chunks=50 rows=1000	2240393 / 2249201 / -0.4%
arrow-ipc compress time/wide table cols=10000 chunks=1 rows=1000	25609126 / 25595394 / +0.1%
arrow-ipc compress time/wide table cols=10000 chunks=50 rows=1000	25410245 / 25874947 / -1.8%
arrow-ipc decompress time/Arade	181833688 / 182434588 / -0.3%
arrow-ipc decompress time/Bimbo	425871203 / 423222913 / +0.6%
arrow-ipc decompress time/CMSprovider	471274110 / 474802127 / -0.7%
arrow-ipc decompress time/Euro2016	74643489 / 64003863 / +16.6% 🔴
arrow-ipc decompress time/Food	58261402 / 58517874 / -0.4%
arrow-ipc decompress time/HashTags	142131306 / 121114976 / +17.4% 🔴
arrow-ipc decompress time/TPC-H l_comment canonical	538858233 / 545014989 / -1.1%
arrow-ipc decompress time/TPC-H l_comment chunked	528846901 / 540822510 / -2.2%
arrow-ipc decompress time/taxi	48154175 / 48600377 / -0.9%
arrow-ipc decompress time/wide table cols=100 chunks=1 rows=1000	321512 / 320084 / +0.4%
arrow-ipc decompress time/wide table cols=100 chunks=50 rows=1000	317623 / 318561 / -0.3%
arrow-ipc decompress time/wide table cols=1000 chunks=1 rows=1000	3506383 / 3523787 / -0.5%
arrow-ipc decompress time/wide table cols=1000 chunks=50 rows=1000	3587691 / 3612193 / -0.7%
arrow-ipc decompress time/wide table cols=10000 chunks=1 rows=1000	36787998 / 37145977 / -1.0%
arrow-ipc decompress time/wide table cols=10000 chunks=50 rows=1000	36504386 / 36668579 / -0.4%

vortex / arrow-ipc / bytes (1.000x ➖, 0↑ 0↓)

name	bytes (PR / base / %diff)
arrow-ipc size/Arade	691765162 / 691765162 / +0.0%
arrow-ipc size/Bimbo	3279590114 / 3279590114 / +0.0%
arrow-ipc size/CMSprovider	2422259682 / 2422259682 / +0.0%
arrow-ipc size/Euro2016	360582666 / 360582666 / +0.0%
arrow-ipc size/Food	255782338 / 255782338 / +0.0%
arrow-ipc size/HashTags	704785810 / 704785810 / +0.0%
arrow-ipc size/TPC-H l_comment canonical	4852929378 / 4852929378 / +0.0%
arrow-ipc size/TPC-H l_comment chunked	4852929378 / 4852929378 / +0.0%
arrow-ipc size/taxi	482329690 / 482329690 / +0.0%
arrow-ipc size/wide table cols=100 chunks=1 rows=1000	1257290 / 1257290 / +0.0%
arrow-ipc size/wide table cols=100 chunks=50 rows=1000	1257290 / 1257290 / +0.0%
arrow-ipc size/wide table cols=1000 chunks=1 rows=1000	12568506 / 12568506 / +0.0%
arrow-ipc size/wide table cols=1000 chunks=50 rows=1000	12568506 / 12568506 / +0.0%
arrow-ipc size/wide table cols=10000 chunks=1 rows=1000	125752506 / 125752506 / +0.0%
arrow-ipc size/wide table cols=10000 chunks=50 rows=1000	125752506 / 125752506 / +0.0%

github-actions · 2026-10-14T14:01:29Z

Benchmarks: Random Access 📖

Commits: PR 85e620b1 vs base 73192765
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -1.8%
Engines: random-access No clear signal (-1.8%, low confidence)
Vortex (geomean): hot 0.981x ➖
Parquet (geomean): hot 0.999x ➖
Shifts: Parquet (control) -0.1% · Median polish -1.0%

How to read Verdict and Engines

Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

vortex / arrow-ipc / ns (1.003x ➖, 3↑ 3↓)

name	ns (PR / base / %diff)
random-access/arrow-tokio-local-disk	73142 / 74429 / -1.7%
random-access/arrow-tokio-local-disk-footer	167170 / 167182 / -0.0%
random-access/feature-vectors/correlated/arrow-tokio-local-disk	2720107 / 2131374 / +27.6% 🔴
random-access/feature-vectors/correlated/arrow-tokio-local-disk-footer	3301534 / 2070859 / +59.4% 🔴
random-access/feature-vectors/uniform/arrow-tokio-local-disk	32135019 / 54566672 / -41.1% 🟢
random-access/feature-vectors/uniform/arrow-tokio-local-disk-footer	55935012 / 32350067 / +72.9% 🔴
random-access/nested-lists/correlated/arrow-tokio-local-disk	60037 / 62831 / -4.4%
random-access/nested-lists/correlated/arrow-tokio-local-disk-footer	105010 / 109016 / -3.7%
random-access/nested-lists/uniform/arrow-tokio-local-disk	1028161 / 1178154 / -12.7% 🟢
random-access/nested-lists/uniform/arrow-tokio-local-disk-footer	1150832 / 1256607 / -8.4%
random-access/nested-structs/correlated/arrow-tokio-local-disk	53081 / 57050 / -7.0%
random-access/nested-structs/correlated/arrow-tokio-local-disk-footer	96155 / 96455 / -0.3%
random-access/nested-structs/uniform/arrow-tokio-local-disk	855198 / 959358 / -10.9% 🟢
random-access/nested-structs/uniform/arrow-tokio-local-disk-footer	920197 / 1000864 / -8.1%
random-access/taxi/correlated/arrow-tokio-local-disk	123672 / 127488 / -3.0%
random-access/taxi/correlated/arrow-tokio-local-disk-footer	222866 / 224528 / -0.7%
random-access/taxi/uniform/arrow-tokio-local-disk	2819361 / 3004257 / -6.2%
random-access/taxi/uniform/arrow-tokio-local-disk-footer	2963973 / 2909285 / +1.9%

random-access / vortex-file-compressed / ns (0.981x ➖, 0↑ 0↓)

name	ns (PR / base / %diff)
random-access/feature-vectors/correlated/vortex-tokio-local-disk	243264 / 247383 / -1.7%
random-access/feature-vectors/correlated/vortex-tokio-local-disk-footer	1230843 / 1240936 / -0.8%
random-access/feature-vectors/uniform/vortex-tokio-local-disk	1490660 / 1412306 / +5.5%
random-access/feature-vectors/uniform/vortex-tokio-local-disk-footer	2596496 / 2658135 / -2.3%
random-access/nested-lists/correlated/vortex-tokio-local-disk	218374 / 216783 / +0.7%
random-access/nested-lists/correlated/vortex-tokio-local-disk-footer	348103 / 371123 / -6.2%
random-access/nested-lists/uniform/vortex-tokio-local-disk	714708 / 731660 / -2.3%
random-access/nested-lists/uniform/vortex-tokio-local-disk-footer	941268 / 921003 / +2.2%
random-access/nested-structs/correlated/vortex-tokio-local-disk	273043 / 280525 / -2.7%
random-access/nested-structs/correlated/vortex-tokio-local-disk-footer	527324 / 532395 / -1.0%
random-access/nested-structs/uniform/vortex-tokio-local-disk	636706 / 648384 / -1.8%
random-access/nested-structs/uniform/vortex-tokio-local-disk-footer	884785 / 950344 / -6.9%
random-access/taxi/correlated/vortex-tokio-local-disk	647786 / 682909 / -5.1%
random-access/taxi/correlated/vortex-tokio-local-disk-footer	1431498 / 1428938 / +0.2%
random-access/taxi/uniform/vortex-tokio-local-disk	2521654 / 2650399 / -4.9%
random-access/taxi/uniform/vortex-tokio-local-disk-footer	3778930 / 3838464 / -1.6%
random-access/vortex-tokio-local-disk	439872 / 465920 / -5.6%
random-access/vortex-tokio-local-disk-footer	1083174 / 1076825 / +0.6%

random-access / parquet / ns (0.999x ➖, 0↑ 0↓)

name	ns (PR / base / %diff)
random-access/feature-vectors/correlated/parquet-tokio-local-disk	106645370195 / 109036557058 / -2.2%
random-access/feature-vectors/correlated/parquet-tokio-local-disk-footer	107441421433 / 113854542343 / -5.6%
random-access/feature-vectors/uniform/parquet-tokio-local-disk	106651060359 / 107409596594 / -0.7%
random-access/feature-vectors/uniform/parquet-tokio-local-disk-footer	107949518172 / 107597536214 / +0.3%
random-access/nested-lists/correlated/parquet-tokio-local-disk	144369016 / 143954438 / +0.3%
random-access/nested-lists/correlated/parquet-tokio-local-disk-footer	144239007 / 144632383 / -0.3%
random-access/nested-lists/uniform/parquet-tokio-local-disk	145067421 / 143499080 / +1.1%
random-access/nested-lists/uniform/parquet-tokio-local-disk-footer	144301975 / 143173997 / +0.8%
random-access/nested-structs/correlated/parquet-tokio-local-disk	44480113 / 44135175 / +0.8%
random-access/nested-structs/correlated/parquet-tokio-local-disk-footer	44009812 / 44456501 / -1.0%
random-access/nested-structs/uniform/parquet-tokio-local-disk	44593694 / 44842550 / -0.6%
random-access/nested-structs/uniform/parquet-tokio-local-disk-footer	44035538 / 45499818 / -3.2%
random-access/parquet-tokio-local-disk	121105294 / 118811443 / +1.9%
random-access/parquet-tokio-local-disk-footer	119823084 / 119103978 / +0.6%
random-access/taxi/correlated/parquet-tokio-local-disk	181684910 / 178318238 / +1.9%
random-access/taxi/correlated/parquet-tokio-local-disk-footer	179537598 / 178954197 / +0.3%
random-access/taxi/uniform/parquet-tokio-local-disk	193328550 / 187516050 / +3.1%
random-access/taxi/uniform/parquet-tokio-local-disk-footer	192873242 / 192464188 / +0.2%

random-access / lance / ns (0.988x ➖, 0↑ 0↓)

name	ns (PR / base / %diff)
random-access/feature-vectors/correlated/lance-tokio-local-disk	212710 / 213399 / -0.3%
random-access/feature-vectors/correlated/lance-tokio-local-disk-footer	984209 / 990394 / -0.6%
random-access/feature-vectors/uniform/lance-tokio-local-disk	1076084 / 1081579 / -0.5%
random-access/feature-vectors/uniform/lance-tokio-local-disk-footer	1840876 / 1879907 / -2.1%
random-access/lance-tokio-local-disk	548357 / 557610 / -1.7%
random-access/lance-tokio-local-disk-footer	1304376 / 1331680 / -2.1%
random-access/nested-lists/correlated/lance-tokio-local-disk	160621 / 157494 / +2.0%
random-access/nested-lists/correlated/lance-tokio-local-disk-footer	491396 / 499722 / -1.7%
random-access/nested-lists/uniform/lance-tokio-local-disk	913576 / 914464 / -0.1%
random-access/nested-lists/uniform/lance-tokio-local-disk-footer	1388692 / 1420534 / -2.2%
random-access/nested-structs/correlated/lance-tokio-local-disk	274489 / 280039 / -2.0%
random-access/nested-structs/correlated/lance-tokio-local-disk-footer	561777 / 563973 / -0.4%
random-access/nested-structs/uniform/lance-tokio-local-disk	2319836 / 2374248 / -2.3%
random-access/nested-structs/uniform/lance-tokio-local-disk-footer	2658064 / 2703498 / -1.7%
random-access/taxi/correlated/lance-tokio-local-disk	785464 / 798004 / -1.6%
random-access/taxi/correlated/lance-tokio-local-disk-footer	1817047 / 1838829 / -1.2%
random-access/taxi/uniform/lance-tokio-local-disk	8091998 / 8153629 / -0.8%
random-access/taxi/uniform/lance-tokio-local-disk-footer	8713957 / 8907193 / -2.2%

github-actions · 2026-10-14T14:10:57Z

Benchmarks: Random Access (S3) 📖

Commits: PR 85e620b1 vs base 73192765
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +4.6%
Engines: random-access No clear signal (+4.6%, environment too noisy confidence)
Vortex (geomean): hot 1.020x ➖
Parquet (geomean): hot 0.975x ➖
Shifts: Parquet (control) -2.5% · Median polish -0.5%

How to read Verdict and Engines

Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

random-access / vortex-file-compressed / ns (1.020x ➖, 1↑ 1↓)

name	ns (PR / base / %diff)
random-access/feature-vectors/correlated/vortex-tokio-s3	60351854 / 57061785 / +5.8%
random-access/feature-vectors/correlated/vortex-tokio-s3-footer	132470798 / 123911231 / +6.9%
random-access/feature-vectors/uniform/vortex-tokio-s3	129729086 / 95627337 / +35.7% 🔴
random-access/feature-vectors/uniform/vortex-tokio-s3-footer	183650704 / 167512771 / +9.6%
random-access/nested-lists/correlated/vortex-tokio-s3	57324255 / 58579137 / -2.1%
random-access/nested-lists/correlated/vortex-tokio-s3-footer	110307293 / 111098762 / -0.7%
random-access/nested-lists/uniform/vortex-tokio-s3	175327752 / 164087858 / +6.8%
random-access/nested-lists/uniform/vortex-tokio-s3-footer	222638318 / 224179083 / -0.7%
random-access/nested-structs/correlated/vortex-tokio-s3	53559553 / 62858470 / -14.8%
random-access/nested-structs/correlated/vortex-tokio-s3-footer	117350579 / 108817819 / +7.8%
random-access/nested-structs/uniform/vortex-tokio-s3	179551789 / 169836711 / +5.7%
random-access/nested-structs/uniform/vortex-tokio-s3-footer	218131046 / 219296539 / -0.5%
random-access/taxi/correlated/vortex-tokio-s3	98112615 / 82914958 / +18.3%
random-access/taxi/correlated/vortex-tokio-s3-footer	158490769 / 152260523 / +4.1%
random-access/taxi/uniform/vortex-tokio-s3	180118996 / 184278913 / -2.3%
random-access/taxi/uniform/vortex-tokio-s3-footer	243658850 / 228834113 / +6.5%
random-access/vortex-tokio-s3	49722378 / 76441375 / -35.0% 🟢
random-access/vortex-tokio-s3-footer	107309593 / 105553815 / +1.7%

random-access / parquet / ns (0.975x ➖, 0↑ 0↓)

name	ns (PR / base / %diff)
random-access/feature-vectors/correlated/parquet-tokio-s3	187797238922 / 192753031803 / -2.6%
random-access/feature-vectors/correlated/parquet-tokio-s3-footer	190927511340 / 179254600923 / +6.5%
random-access/feature-vectors/uniform/parquet-tokio-s3	178626928278 / 173590988555 / +2.9%
random-access/feature-vectors/uniform/parquet-tokio-s3-footer	174424648040 / 173746636586 / +0.4%
random-access/nested-lists/correlated/parquet-tokio-s3	1016454053 / 1025340792 / -0.9%
random-access/nested-lists/correlated/parquet-tokio-s3-footer	1102538316 / 1149834799 / -4.1%
random-access/nested-lists/uniform/parquet-tokio-s3	1012858038 / 1023447401 / -1.0%
random-access/nested-lists/uniform/parquet-tokio-s3-footer	1103918994 / 1118702651 / -1.3%
random-access/nested-structs/correlated/parquet-tokio-s3	483820965 / 542461135 / -10.8%
random-access/nested-structs/correlated/parquet-tokio-s3-footer	560651538 / 642240557 / -12.7%
random-access/nested-structs/uniform/parquet-tokio-s3	452117845 / 576731127 / -21.6%
random-access/nested-structs/uniform/parquet-tokio-s3-footer	536859524 / 583737427 / -8.0%
random-access/parquet-tokio-s3	479743575 / 486627872 / -1.4%
random-access/parquet-tokio-s3-footer	539258933 / 544523036 / -1.0%
random-access/taxi/correlated/parquet-tokio-s3	716575213 / 722334110 / -0.8%
random-access/taxi/correlated/parquet-tokio-s3-footer	811278408 / 884396873 / -8.3%
random-access/taxi/uniform/parquet-tokio-s3	803107200 / 786037591 / +2.2%
random-access/taxi/uniform/parquet-tokio-s3-footer	1076404007 / 858625800 / +25.4%

random-access / lance / ns (0.819x ➖, 5↑ 0↓)

name	ns (PR / base / %diff)
random-access/feature-vectors/correlated/lance-tokio-s3	53943763 / 49619292 / +8.7%
random-access/feature-vectors/correlated/lance-tokio-s3-footer	223538261 / 199272404 / +12.2%
random-access/feature-vectors/uniform/lance-tokio-s3	90606752 / 94139364 / -3.8%
random-access/feature-vectors/uniform/lance-tokio-s3-footer	248833920 / 246267001 / +1.0%
random-access/lance-tokio-s3	66218983 / 72233669 / -8.3%
random-access/lance-tokio-s3-footer	264686554 / 419142404 / -36.9% 🟢
random-access/nested-lists/correlated/lance-tokio-s3	34918011 / 36520253 / -4.4%
random-access/nested-lists/correlated/lance-tokio-s3-footer	232852437 / 235091732 / -1.0%
random-access/nested-lists/uniform/lance-tokio-s3	90887426 / 85669280 / +6.1%
random-access/nested-lists/uniform/lance-tokio-s3-footer	286133713 / 297064676 / -3.7%
random-access/nested-structs/correlated/lance-tokio-s3	53744117 / 144585851 / -62.8% 🟢
random-access/nested-structs/correlated/lance-tokio-s3-footer	277148209 / 403078068 / -31.2% 🟢
random-access/nested-structs/uniform/lance-tokio-s3	131186780 / 284558930 / -53.9% 🟢
random-access/nested-structs/uniform/lance-tokio-s3-footer	290164588 / 568028029 / -48.9% 🟢
random-access/taxi/correlated/lance-tokio-s3	76847739 / 78182746 / -1.7%
random-access/taxi/correlated/lance-tokio-s3-footer	299424091 / 391749350 / -23.6%
random-access/taxi/uniform/lance-tokio-s3	319233780 / 308119284 / +3.6%
random-access/taxi/uniform/lance-tokio-s3-footer	496063850 / 566240900 / -12.4%

I, Claude <noreply@anthropic.com>, hereby add my Signed-off-by to this commit: 917b7f9 I, Claude <noreply@anthropic.com>, hereby add my Signed-off-by to this commit: 85e620b I, Claude <noreply@anthropic.com>, hereby add my Signed-off-by to this commit: 2089d24 Signed-off-by: Claude <noreply@anthropic.com> Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk> Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_0122rGn9fTSV47KLv191MTHB

joseph-isaacs · 2026-10-14T14:29:09Z

Rust tests (windows-x64) failed on infrastructure: AWS interrupted the Spot instance while it was still compiling, before any test ran. The head commit a209097 is an empty DCO sign-off commit on top of 2089d24, where this job passed. I'll re-run the failed job once this CI run finishes.

Generated by Claude Code

github-actions · 2026-10-14T15:15:10Z

Benchmarks: TPC-H SF=1 on S3 📖

Commits: PR 85e620b1 vs base 73192765
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +10.0%
Engines: DataFusion No clear signal (+11.1%, environment too noisy confidence) · DuckDB No clear signal (+8.8%, environment too noisy confidence)
Vortex (geomean): hot 1.066x ➖ · cold 1.054x ➖
Parquet (geomean): hot 0.969x ➖ · cold 1.007x ➖
Shifts: Parquet (control) -3.1% · Median polish +5.0%

How to read Verdict and Engines

Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.043x ➖, 0↑ 3↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed	212649580 / 242728471 / -12.4%	1007632540 / 1115318102 / -9.7%	0.21 / 0.22 / -3.0%
tpch_q02/datafusion:vortex-file-compressed	394366455 / 343412337 / +14.8%	822250218 / 924555536 / -11.1%	0.48 / 0.37 / +29.1%
tpch_q03/datafusion:vortex-file-compressed	491887783 / 460045753 / +6.9%	1106169475 / 1139495471 / -2.9%	0.44 / 0.40 / +10.1%
tpch_q04/datafusion:vortex-file-compressed	266387582 / 243488711 / +9.4%	498198767 / 404415928 / +23.2%	0.53 / 0.60 / -11.2%
tpch_q05/datafusion:vortex-file-compressed	430592371 / 515236947 / -16.4%	621643206 / 682263245 / -8.9%	0.69 / 0.76 / -8.3%
tpch_q06/datafusion:vortex-file-compressed	373132302 / 332747472 / +12.1%	474236721 / 668324159 / -29.0%	0.79 / 0.50 / +58.0%
tpch_q07/datafusion:vortex-file-compressed	392480366 / 455263046 / -13.8%	550755315 / 627039548 / -12.2%	0.71 / 0.73 / -1.8%
tpch_q08/datafusion:vortex-file-compressed	711904703 / 758455893 / -6.1%	782427779 / 841026117 / -7.0%	0.91 / 0.90 / +0.9%
tpch_q09/datafusion:vortex-file-compressed	353409851 / 419186018 / -15.7%	932850014 / 835691727 / +11.6%	0.38 / 0.50 / -24.5%
tpch_q10/datafusion:vortex-file-compressed	513739923 / 503616104 / +2.0%	612251397 / 625197830 / -2.1%	0.84 / 0.81 / +4.2%
tpch_q11/datafusion:vortex-file-compressed	375138126 / 502670881 / -25.4%	584539090 / 530956400 / +10.1%	0.64 / 0.95 / -32.2%
tpch_q12/datafusion:vortex-file-compressed	572551149 / 382532487 / +49.7% 🔴	606476067 / 648752725 / -6.5%	0.94 / 0.59 / +60.1%
tpch_q13/datafusion:vortex-file-compressed	162760498 / 149035259 / +9.2%	408926254 / 380880079 / +7.4%	0.40 / 0.39 / +1.7%
tpch_q14/datafusion:vortex-file-compressed	217662694 / 238478455 / -8.7%	446858536 / 813381782 / -45.1% 🟢	0.49 / 0.29 / +66.1%
tpch_q15/datafusion:vortex-file-compressed	486599825 / 344730164 / +41.2% 🔴	714036686 / 561925107 / +27.1%	0.68 / 0.61 / +11.1%
tpch_q16/datafusion:vortex-file-compressed	180050421 / 187260739 / -3.9%	375945707 / 585277679 / -35.8% 🟢	0.48 / 0.32 / +49.7%
tpch_q17/datafusion:vortex-file-compressed	437906853 / 373126943 / +17.4%	784081518 / 694506457 / +12.9%	0.56 / 0.54 / +4.0%
tpch_q18/datafusion:vortex-file-compressed	396979573 / 340055924 / +16.7%	617939777 / 504747093 / +22.4%	0.64 / 0.67 / -4.6%
tpch_q19/datafusion:vortex-file-compressed	684533093 / 465553524 / +47.0% 🔴	767851017 / 652269074 / +17.7%	0.89 / 0.71 / +24.9%
tpch_q20/datafusion:vortex-file-compressed	320299674 / 325411663 / -1.6%	614555224 / 595836018 / +3.1%	0.52 / 0.55 / -4.6%
tpch_q21/datafusion:vortex-file-compressed	745088195 / 721837137 / +3.2%	748040750 / 727426875 / +2.8%	1.00 / 0.99 / +0.4%
tpch_q22/datafusion:vortex-file-compressed	206479073 / 192894446 / +7.0%	384830940 / 367701758 / +4.7%	0.54 / 0.52 / +2.3%

datafusion / vortex-compact / ns (1.040x ➖, 1↑ 1↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-compact	225811987 / 219997935 / +2.6%	730329200 / 629730177 / +16.0%	0.31 / 0.35 / -11.5%
tpch_q02/datafusion:vortex-compact	338354605 / 356911587 / -5.2%	643213392 / 804474089 / -20.0%	0.53 / 0.44 / +18.6%
tpch_q03/datafusion:vortex-compact	395105388 / 380736098 / +3.8%	973284592 / 870348440 / +11.8%	0.41 / 0.44 / -7.2%
tpch_q04/datafusion:vortex-compact	214371574 / 176696990 / +21.3%	396188911 / 357507333 / +10.8%	0.54 / 0.49 / +9.5%
tpch_q05/datafusion:vortex-compact	861666495 / 394218450 / +118.6% 🔴	831174686 / 660746159 / +25.8%	1.04 / 0.60 / +73.8%
tpch_q06/datafusion:vortex-compact	301432668 / 365269602 / -17.5%	532782606 / 487952283 / +9.2%	0.57 / 0.75 / -24.4%
tpch_q07/datafusion:vortex-compact	481521845 / 412059636 / +16.9%	804412336 / 589804646 / +36.4% 🔴	0.60 / 0.70 / -14.3%
tpch_q08/datafusion:vortex-compact	489363824 / 525689344 / -6.9%	868031487 / 626355307 / +38.6% 🔴	0.56 / 0.84 / -32.8%
tpch_q09/datafusion:vortex-compact	396161250 / 364876192 / +8.6%	766640204 / 615284894 / +24.6%	0.52 / 0.59 / -12.9%
tpch_q10/datafusion:vortex-compact	399082042 / 516426447 / -22.7%	482722818 / 856656080 / -43.7% 🟢	0.83 / 0.60 / +37.1%
tpch_q11/datafusion:vortex-compact	312155594 / 339973781 / -8.2%	484072955 / 464026864 / +4.3%	0.64 / 0.73 / -12.0%
tpch_q12/datafusion:vortex-compact	523694652 / 457967503 / +14.4%	716136195 / 528270962 / +35.6% 🔴	0.73 / 0.87 / -15.6%
tpch_q13/datafusion:vortex-compact	142631072 / 118718942 / +20.1%	402219123 / 295936378 / +35.9% 🔴	0.35 / 0.40 / -11.6%
tpch_q14/datafusion:vortex-compact	228978175 / 220220988 / +4.0%	387667542 / 352802668 / +9.9%	0.59 / 0.62 / -5.4%
tpch_q15/datafusion:vortex-compact	359952296 / 405880381 / -11.3%	562751649 / 579218492 / -2.8%	0.64 / 0.70 / -8.7%
tpch_q16/datafusion:vortex-compact	185933991 / 204461008 / -9.1%	365556086 / 382844782 / -4.5%	0.51 / 0.53 / -4.8%
tpch_q17/datafusion:vortex-compact	506236986 / 530390850 / -4.6%	881789124 / 1093253435 / -19.3%	0.57 / 0.49 / +18.3%
tpch_q18/datafusion:vortex-compact	325867154 / 466804181 / -30.2% 🟢	531847661 / 788897221 / -32.6% 🟢	0.61 / 0.59 / +3.5%
tpch_q19/datafusion:vortex-compact	561835258 / 510374526 / +10.1%	617867546 / 676825682 / -8.7%	0.91 / 0.75 / +20.6%
tpch_q20/datafusion:vortex-compact	361354193 / 377559344 / -4.3%	531448988 / 936266342 / -43.2% 🟢	0.68 / 0.40 / +68.6%
tpch_q21/datafusion:vortex-compact	691186432 / 546326590 / +26.5%	978303104 / 690124565 / +41.8% 🔴	0.71 / 0.79 / -10.8%
tpch_q22/datafusion:vortex-compact	217406297 / 174783659 / +24.4%	398857336 / 369728405 / +7.9%	0.55 / 0.47 / +15.3%

datafusion / parquet / ns (0.937x ➖, 1↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet	217727089 / 185945527 / +17.1%	548813795 / 493219034 / +11.3%	0.40 / 0.38 / +5.2%
tpch_q02/datafusion:parquet	341643823 / 295501259 / +15.6%	525293536 / 538285782 / -2.4%	0.65 / 0.55 / +18.5%
tpch_q03/datafusion:parquet	280879262 / 259515452 / +8.2%	745824812 / 706569230 / +5.6%	0.38 / 0.37 / +2.5%
tpch_q04/datafusion:parquet	184200806 / 188035919 / -2.0%	543395410 / 399868545 / +35.9% 🔴	0.34 / 0.47 / -27.9%
tpch_q05/datafusion:parquet	391657126 / 571558236 / -31.5% 🟢	503755900 / 963148852 / -47.7% 🟢	0.78 / 0.59 / +31.0%
tpch_q06/datafusion:parquet	125238723 / 140229691 / -10.7%	227391510 / 244718448 / -7.1%	0.55 / 0.57 / -3.9%
tpch_q07/datafusion:parquet	372988241 / 436415714 / -14.5%	523375348 / 775041218 / -32.5% 🟢	0.71 / 0.56 / +26.6%
tpch_q08/datafusion:parquet	455974541 / 482036340 / -5.4%	568019187 / 572513303 / -0.8%	0.80 / 0.84 / -4.7%
tpch_q09/datafusion:parquet	425259528 / 492970562 / -13.7%	603168363 / 617627068 / -2.3%	0.71 / 0.80 / -11.7%
tpch_q10/datafusion:parquet	400888375 / 465201691 / -13.8%	536842690 / 611345417 / -12.2%	0.75 / 0.76 / -1.9%
tpch_q11/datafusion:parquet	262805586 / 252020171 / +4.3%	467461373 / 405969260 / +15.1%	0.56 / 0.62 / -9.4%
tpch_q12/datafusion:parquet	230003934 / 248044221 / -7.3%	509864151 / 360164225 / +41.6% 🔴	0.45 / 0.69 / -34.5%
tpch_q13/datafusion:parquet	366542250 / 380463779 / -3.7%	518625945 / 561261958 / -7.6%	0.71 / 0.68 / +4.3%
tpch_q14/datafusion:parquet	182384453 / 180854954 / +0.8%	332413785 / 294539015 / +12.9%	0.55 / 0.61 / -10.6%
tpch_q15/datafusion:parquet	298203278 / 365799074 / -18.5%	452057115 / 509785228 / -11.3%	0.66 / 0.72 / -8.1%
tpch_q16/datafusion:parquet	114320496 / 117834454 / -3.0%	382461712 / 294926801 / +29.7%	0.30 / 0.40 / -25.2%
tpch_q17/datafusion:parquet	345797315 / 339335262 / +1.9%	731589714 / 541051866 / +35.2% 🔴	0.47 / 0.63 / -24.6%
tpch_q18/datafusion:parquet	426656000 / 437341158 / -2.4%	598679080 / 588247504 / +1.8%	0.71 / 0.74 / -4.1%
tpch_q19/datafusion:parquet	198617333 / 206901991 / -4.0%	307390251 / 316760008 / -3.0%	0.65 / 0.65 / -1.1%
tpch_q20/datafusion:parquet	250487774 / 308889966 / -18.9%	570175482 / 500018008 / +14.0%	0.44 / 0.62 / -28.9%
tpch_q21/datafusion:parquet	462425123 / 498939793 / -7.3%	781428207 / 566207597 / +38.0% 🔴	0.59 / 0.88 / -32.8%
tpch_q22/datafusion:parquet	176867196 / 207288406 / -14.7%	386130891 / 684484397 / -43.6% 🟢	0.46 / 0.30 / +51.3%

duckdb / vortex-file-compressed / ns (1.148x ➖, 0↑ 5↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed	202953567 / 206117665 / -1.5%	424407884 / 420765395 / +0.9%	0.48 / 0.49 / -2.4%
tpch_q02/duckdb:vortex-file-compressed	661582534 / 466471654 / +41.8% 🔴	655820265 / 438734110 / +49.5% 🔴	1.01 / 1.06 / -5.1%
tpch_q03/duckdb:vortex-file-compressed	596000438 / 553831892 / +7.6%	916889915 / 669429510 / +37.0% 🔴	0.65 / 0.83 / -21.4%
tpch_q04/duckdb:vortex-file-compressed	368618591 / 380982626 / -3.2%	472892255 / 566942931 / -16.6%	0.78 / 0.67 / +16.0%
tpch_q05/duckdb:vortex-file-compressed	535789462 / 510468812 / +5.0%	619400545 / 530745296 / +16.7%	0.87 / 0.96 / -10.1%
tpch_q06/duckdb:vortex-file-compressed	429316216 / 348703077 / +23.1%	390716471 / 405515220 / -3.6%	1.10 / 0.86 / +27.8%
tpch_q07/duckdb:vortex-file-compressed	678449716 / 512084989 / +32.5% 🔴	651483079 / 602268484 / +8.2%	1.04 / 0.85 / +22.5%
tpch_q08/duckdb:vortex-file-compressed	761696116 / 659936189 / +15.4%	814810246 / 683360840 / +19.2%	0.93 / 0.97 / -3.2%
tpch_q09/duckdb:vortex-file-compressed	582568301 / 553774830 / +5.2%	562705497 / 559917217 / +0.5%	1.04 / 0.99 / +4.7%
tpch_q10/duckdb:vortex-file-compressed	707215419 / 516900078 / +36.8% 🔴	544600609 / 779766765 / -30.2% 🟢	1.30 / 0.66 / +95.9%
tpch_q11/duckdb:vortex-file-compressed	252186251 / 200833899 / +25.6%	310289544 / 213702709 / +45.2% 🔴	0.81 / 0.94 / -13.5%
tpch_q12/duckdb:vortex-file-compressed	768028117 / 616646358 / +24.5%	731410105 / 504517600 / +45.0% 🔴	1.05 / 1.22 / -14.1%
tpch_q13/duckdb:vortex-file-compressed	319771526 / 323128510 / -1.0%	506507785 / 444709082 / +13.9%	0.63 / 0.73 / -13.1%
tpch_q14/duckdb:vortex-file-compressed	266359253 / 310740076 / -14.3%	331462682 / 346368456 / -4.3%	0.80 / 0.90 / -10.4%
tpch_q15/duckdb:vortex-file-compressed	242878986 / 207259248 / +17.2%	248215301 / 211990229 / +17.1%	0.98 / 0.98 / +0.1%
tpch_q16/duckdb:vortex-file-compressed	230270502 / 176696520 / +30.3% 🔴	213709017 / 175695941 / +21.6%	1.08 / 1.01 / +7.1%
tpch_q17/duckdb:vortex-file-compressed	524732125 / 515535225 / +1.8%	1005129854 / 511294015 / +96.6% 🔴	0.52 / 1.01 / -48.2%
tpch_q18/duckdb:vortex-file-compressed	435083344 / 361207325 / +20.5%	523720085 / 514201862 / +1.9%	0.83 / 0.70 / +18.3%
tpch_q19/duckdb:vortex-file-compressed	446567529 / 388420391 / +15.0%	525547817 / 402437242 / +30.6% 🔴	0.85 / 0.97 / -12.0%
tpch_q20/duckdb:vortex-file-compressed	470665256 / 402022093 / +17.1%	505795788 / 472291800 / +7.1%	0.93 / 0.85 / +9.3%
tpch_q21/duckdb:vortex-file-compressed	1063100080 / 765505185 / +38.9% 🔴	1168478325 / 736290020 / +58.7% 🔴	0.91 / 1.04 / -12.5%
tpch_q22/duckdb:vortex-file-compressed	216703622 / 199102455 / +8.8%	321539818 / 241535568 / +33.1% 🔴	0.67 / 0.82 / -18.2%

duckdb / vortex-compact / ns (1.037x ➖, 0↑ 1↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-compact	231285531 / 223539907 / +3.5%	335318137 / 242201525 / +38.4% 🔴	0.69 / 0.92 / -25.3%
tpch_q02/duckdb:vortex-compact	440573043 / 441411761 / -0.2%	408167795 / 443824923 / -8.0%	1.08 / 0.99 / +8.5%
tpch_q03/duckdb:vortex-compact	463998663 / 483009846 / -3.9%	564796101 / 717707104 / -21.3%	0.82 / 0.67 / +22.1%
tpch_q04/duckdb:vortex-compact	255349318 / 253244950 / +0.8%	304319369 / 270250366 / +12.6%	0.84 / 0.94 / -10.5%
tpch_q05/duckdb:vortex-compact	422763138 / 491748573 / -14.0%	492789665 / 699876811 / -29.6%	0.86 / 0.70 / +22.1%
tpch_q06/duckdb:vortex-compact	330681787 / 316140746 / +4.6%	300750032 / 341397917 / -11.9%	1.10 / 0.93 / +18.7%
tpch_q07/duckdb:vortex-compact	575152235 / 456557977 / +26.0%	642557299 / 516604885 / +24.4%	0.90 / 0.88 / +1.3%
tpch_q08/duckdb:vortex-compact	669571071 / 597810959 / +12.0%	638263637 / 612592949 / +4.2%	1.05 / 0.98 / +7.5%
tpch_q09/duckdb:vortex-compact	655812873 / 491685307 / +33.4% 🔴	691106915 / 557013354 / +24.1%	0.95 / 0.88 / +7.5%
tpch_q10/duckdb:vortex-compact	493031224 / 467221273 / +5.5%	515436612 / 569011153 / -9.4%	0.96 / 0.82 / +16.5%
tpch_q11/duckdb:vortex-compact	220389189 / 197297001 / +11.7%	311837505 / 267919366 / +16.4%	0.71 / 0.74 / -4.0%
tpch_q12/duckdb:vortex-compact	490400216 / 595549348 / -17.7%	504509485 / 541349550 / -6.8%	0.97 / 1.10 / -11.6%
tpch_q13/duckdb:vortex-compact	184399917 / 198531904 / -7.1%	320617387 / 295794765 / +8.4%	0.58 / 0.67 / -14.3%
tpch_q14/duckdb:vortex-compact	259658203 / 290635447 / -10.7%	328223591 / 297683534 / +10.3%	0.79 / 0.98 / -19.0%
tpch_q15/duckdb:vortex-compact	181549348 / 160270548 / +13.3%	223307208 / 187716803 / +19.0%	0.81 / 0.85 / -4.8%
tpch_q16/duckdb:vortex-compact	183312293 / 182312393 / +0.5%	224797604 / 196228430 / +14.6%	0.82 / 0.93 / -12.2%
tpch_q17/duckdb:vortex-compact	456883911 / 405976097 / +12.5%	506285174 / 448267809 / +12.9%	0.90 / 0.91 / -0.4%
tpch_q18/duckdb:vortex-compact	308412106 / 285077881 / +8.2%	329425396 / 336754643 / -2.2%	0.94 / 0.85 / +10.6%
tpch_q19/duckdb:vortex-compact	384950688 / 360512666 / +6.8%	605761105 / 383638925 / +57.9% 🔴	0.64 / 0.94 / -32.4%
tpch_q20/duckdb:vortex-compact	374289031 / 381260133 / -1.8%	415631599 / 565196173 / -26.5%	0.90 / 0.67 / +33.5%
tpch_q21/duckdb:vortex-compact	721732410 / 670439238 / +7.7%	742397468 / 705278455 / +5.3%	0.97 / 0.95 / +2.3%
tpch_q22/duckdb:vortex-compact	190994798 / 181405502 / +5.3%	251763759 / 181616007 / +38.6% 🔴	0.76 / 1.00 / -24.0%

duckdb / parquet / ns (1.003x ➖, 1↑ 1↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet	368809019 / 373789881 / -1.3%	498311560 / 454461177 / +9.6%	0.74 / 0.82 / -10.0%
tpch_q02/duckdb:parquet	729318489 / 670285051 / +8.8%	763842898 / 803017967 / -4.9%	0.95 / 0.83 / +14.4%
tpch_q03/duckdb:parquet	956428422 / 843010731 / +13.5%	1090252782 / 1168689167 / -6.7%	0.88 / 0.72 / +21.6%
tpch_q04/duckdb:parquet	556651185 / 504880351 / +10.3%	830997636 / 587241403 / +41.5% 🔴	0.67 / 0.86 / -22.1%
tpch_q05/duckdb:parquet	971906660 / 1081698705 / -10.1%	1164383180 / 1261795143 / -7.7%	0.83 / 0.86 / -2.6%
tpch_q06/duckdb:parquet	340725807 / 428443779 / -20.5%	352305674 / 492516822 / -28.5%	0.97 / 0.87 / +11.2%
tpch_q07/duckdb:parquet	1089044179 / 1088291060 / +0.1%	1418777421 / 846447565 / +67.6% 🔴	0.77 / 1.29 / -40.3%
tpch_q08/duckdb:parquet	1290824685 / 1205767504 / +7.1%	1200388192 / 1233557573 / -2.7%	1.08 / 0.98 / +10.0%
tpch_q09/duckdb:parquet	1108510203 / 1152104092 / -3.8%	1224239478 / 1244941261 / -1.7%	0.91 / 0.93 / -2.2%
tpch_q10/duckdb:parquet	1035362724 / 1092753231 / -5.3%	1271625550 / 1112527593 / +14.3%	0.81 / 0.98 / -17.1%
tpch_q11/duckdb:parquet	496385968 / 465485889 / +6.6%	348734719 / 485751857 / -28.2%	1.42 / 0.96 / +48.5%
tpch_q12/duckdb:parquet	814730770 / 611883938 / +33.2% 🔴	1051995744 / 735119039 / +43.1% 🔴	0.77 / 0.83 / -7.0%
tpch_q13/duckdb:parquet	766743598 / 703047291 / +9.1%	921471764 / 1001439460 / -8.0%	0.83 / 0.70 / +18.5%
tpch_q14/duckdb:parquet	551158623 / 556842781 / -1.0%	583269060 / 935353191 / -37.6% 🟢	0.94 / 0.60 / +58.7%
tpch_q15/duckdb:parquet	396013157 / 625999436 / -36.7% 🟢	516604160 / 595029375 / -13.2%	0.77 / 1.05 / -27.1%
tpch_q16/duckdb:parquet	510076324 / 518572597 / -1.6%	814422435 / 483020873 / +68.6% 🔴	0.63 / 1.07 / -41.7%
tpch_q17/duckdb:parquet	497959441 / 543680584 / -8.4%	538287883 / 759663791 / -29.1%	0.93 / 0.72 / +29.3%
tpch_q18/duckdb:parquet	717045877 / 717271095 / -0.0%	669427322 / 785577231 / -14.8%	1.07 / 0.91 / +17.3%
tpch_q19/duckdb:parquet	694822716 / 650189156 / +6.9%	652519452 / 792300769 / -17.6%	1.06 / 0.82 / +29.8%
tpch_q20/duckdb:parquet	873801783 / 919267485 / -4.9%	1133489928 / 1000809378 / +13.3%	0.77 / 0.92 / -16.1%
tpch_q21/duckdb:parquet	854061592 / 746393180 / +14.4%	915480926 / 818733695 / +11.8%	0.93 / 0.91 / +2.3%
tpch_q22/duckdb:parquet	519530084 / 464172355 / +11.9%	593583108 / 402142024 / +47.6% 🔴	0.88 / 1.15 / -24.2%

github-actions · 2026-10-14T15:20:35Z

Benchmarks: TPC-H SF=10 on S3 📖

Commits: PR 85e620b1 vs base 73192765
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +13.2%
Engines: DataFusion No clear signal (+19.0%, environment too noisy confidence) · DuckDB No clear signal (+7.6%, environment too noisy confidence)
Vortex (geomean): hot 1.048x ➖ · cold 1.080x ➖
Parquet (geomean): hot 0.926x ➖ · cold 0.973x ➖
Shifts: Parquet (control) -7.4% · Median polish -0.3%

How to read Verdict and Engines

Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-compact / ns (1.015x ➖, 2↑ 3↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-compact	456190316 / 425687846 / +7.2%	1464658965 / 1647527962 / -11.1%	0.31 / 0.26 / +20.5%
tpch_q02/datafusion:vortex-compact	856705607 / 873487401 / -1.9%	1280450882 / 1583080329 / -19.1%	0.67 / 0.55 / +21.3%
tpch_q03/datafusion:vortex-compact	922045886 / 786996198 / +17.2%	2000836441 / 1783492170 / +12.2%	0.46 / 0.44 / +4.4%
tpch_q04/datafusion:vortex-compact	435369025 / 433189235 / +0.5%	716732495 / 794331584 / -9.8%	0.61 / 0.55 / +11.4%
tpch_q05/datafusion:vortex-compact	792163840 / 691850985 / +14.5%	967590934 / 859943066 / +12.5%	0.82 / 0.80 / +1.8%
tpch_q06/datafusion:vortex-compact	558172652 / 372738320 / +49.7% 🔴	811475080 / 529308567 / +53.3% 🔴	0.69 / 0.70 / -2.3%
tpch_q07/datafusion:vortex-compact	696532504 / 773891274 / -10.0%	1061792949 / 1019318419 / +4.2%	0.66 / 0.76 / -13.6%
tpch_q08/datafusion:vortex-compact	1129061459 / 1771024436 / -36.2% 🟢	1556533364 / 1483580238 / +4.9%	0.73 / 1.19 / -39.2%
tpch_q09/datafusion:vortex-compact	953149464 / 956544656 / -0.4%	1157591671 / 1369342586 / -15.5%	0.82 / 0.70 / +17.9%
tpch_q10/datafusion:vortex-compact	933358885 / 947233403 / -1.5%	1782329329 / 1306957111 / +36.4% 🔴	0.52 / 0.72 / -27.7%
tpch_q11/datafusion:vortex-compact	456320756 / 383452967 / +19.0%	774615070 / 591800598 / +30.9% 🔴	0.59 / 0.65 / -9.1%
tpch_q12/datafusion:vortex-compact	656739876 / 858166782 / -23.5%	1578039891 / 1123721247 / +40.4% 🔴	0.42 / 0.76 / -45.5%
tpch_q13/datafusion:vortex-compact	446411284 / 329025390 / +35.7% 🔴	707707445 / 537420698 / +31.7% 🔴	0.63 / 0.61 / +3.0%
tpch_q14/datafusion:vortex-compact	476188116 / 697676250 / -31.7% 🟢	842361368 / 899825597 / -6.4%	0.57 / 0.78 / -27.1%
tpch_q15/datafusion:vortex-compact	651048143 / 724477423 / -10.1%	965910920 / 885436225 / +9.1%	0.67 / 0.82 / -17.6%
tpch_q16/datafusion:vortex-compact	331955452 / 337921911 / -1.8%	557193963 / 469957999 / +18.6%	0.60 / 0.72 / -17.1%
tpch_q17/datafusion:vortex-compact	814261389 / 788854867 / +3.2%	1249861875 / 900908988 / +38.7% 🔴	0.65 / 0.88 / -25.6%
tpch_q18/datafusion:vortex-compact	737434171 / 580080863 / +27.1%	1241428980 / 694848966 / +78.7% 🔴	0.59 / 0.83 / -28.8%
tpch_q19/datafusion:vortex-compact	658240537 / 735927629 / -10.6%	993508092 / 826663386 / +20.2%	0.66 / 0.89 / -25.6%
tpch_q20/datafusion:vortex-compact	664647536 / 756865970 / -12.2%	938349769 / 1085836139 / -13.6%	0.71 / 0.70 / +1.6%
tpch_q21/datafusion:vortex-compact	846987242 / 881874214 / -4.0%	1006550764 / 1012746484 / -0.6%	0.84 / 0.87 / -3.4%
tpch_q22/datafusion:vortex-compact	615083498 / 394559632 / +55.9% 🔴	900353001 / 642563438 / +40.1% 🔴	0.68 / 0.61 / +11.3%

datafusion / parquet / ns (0.852x ➖, 2↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet	285831620 / 366962889 / -22.1%	1173816937 / 967167958 / +21.4%	0.24 / 0.38 / -35.8%
tpch_q02/datafusion:parquet	515450269 / 761546247 / -32.3% 🟢	1311839105 / 1544543568 / -15.1%	0.39 / 0.49 / -20.3%
tpch_q03/datafusion:parquet	624289535 / 800289035 / -22.0%	1177454671 / 1395574257 / -15.6%	0.53 / 0.57 / -7.5%
tpch_q04/datafusion:parquet	459719473 / 529135335 / -13.1%	636267674 / 672054277 / -5.3%	0.72 / 0.79 / -8.2%
tpch_q05/datafusion:parquet	888377817 / 894006587 / -0.6%	1238748582 / 1161360797 / +6.7%	0.72 / 0.77 / -6.8%
tpch_q06/datafusion:parquet	306309360 / 344449877 / -11.1%	411618396 / 540559369 / -23.9%	0.74 / 0.64 / +16.8%
tpch_q07/datafusion:parquet	678644202 / 763243027 / -11.1%	1087331622 / 934490662 / +16.4%	0.62 / 0.82 / -23.6%
tpch_q08/datafusion:parquet	910297753 / 1257297474 / -27.6%	1343723817 / 1529721365 / -12.2%	0.68 / 0.82 / -17.6%
tpch_q09/datafusion:parquet	1112081305 / 1529903194 / -27.3%	1305802742 / 1638546352 / -20.3%	0.85 / 0.93 / -8.8%
tpch_q10/datafusion:parquet	1456745794 / 1569078313 / -7.2%	2120797874 / 2358300458 / -10.1%	0.69 / 0.67 / +3.2%
tpch_q11/datafusion:parquet	482206665 / 743403247 / -35.1% 🟢	837346813 / 1073691406 / -22.0%	0.58 / 0.69 / -16.8%
tpch_q12/datafusion:parquet	479858625 / 582496352 / -17.6%	895318061 / 757159930 / +18.2%	0.54 / 0.77 / -30.3%
tpch_q13/datafusion:parquet	813293734 / 742244191 / +9.6%	1133883018 / 870882332 / +30.2% 🔴	0.72 / 0.85 / -15.8%
tpch_q14/datafusion:parquet	428269655 / 606761772 / -29.4%	667761353 / 732272079 / -8.8%	0.64 / 0.83 / -22.6%
tpch_q15/datafusion:parquet	573117555 / 655956829 / -12.6%	950580044 / 851370757 / +11.7%	0.60 / 0.77 / -21.7%
tpch_q16/datafusion:parquet	311369660 / 343525665 / -9.4%	674480002 / 698340568 / -3.4%	0.46 / 0.49 / -6.2%
tpch_q17/datafusion:parquet	630145886 / 650017519 / -3.1%	810714836 / 735813065 / +10.2%	0.78 / 0.88 / -12.0%
tpch_q18/datafusion:parquet	842325504 / 1195897404 / -29.6%	1419480540 / 1262652817 / +12.4%	0.59 / 0.95 / -37.3%
tpch_q19/datafusion:parquet	467761892 / 461350227 / +1.4%	588767992 / 803845001 / -26.8%	0.79 / 0.57 / +38.4%
tpch_q20/datafusion:parquet	945431117 / 885814318 / +6.7%	1103416342 / 1125696217 / -2.0%	0.86 / 0.79 / +8.9%
tpch_q21/datafusion:parquet	1111243785 / 1188553240 / -6.5%	1143056194 / 1716016845 / -33.4% 🟢	0.97 / 0.69 / +40.4%
tpch_q22/datafusion:parquet	613020652 / 640166142 / -4.2%	1194674784 / 1022002373 / +16.9%	0.51 / 0.63 / -18.1%

duckdb / vortex-compact / ns (1.083x ➖, 0↑ 1↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-compact	1212641820 / 1092097518 / +11.0%	1898542704 / 2809098789 / -32.4% 🟢	0.64 / 0.39 / +64.3%
tpch_q02/duckdb:vortex-compact	672555522 / 594875477 / +13.1%	832386501 / 1289107919 / -35.4% 🟢	0.81 / 0.46 / +75.1%
tpch_q03/duckdb:vortex-compact	1385595796 / 1217581206 / +13.8%	1690195456 / 1957133735 / -13.6%	0.82 / 0.62 / +31.8%
tpch_q04/duckdb:vortex-compact	786669952 / 967104865 / -18.7%	1156584847 / 1084430203 / +6.7%	0.68 / 0.89 / -23.7%
tpch_q05/duckdb:vortex-compact	1415950733 / 1433148112 / -1.2%	1925781608 / 1856672275 / +3.7%	0.74 / 0.77 / -4.7%
tpch_q06/duckdb:vortex-compact	1379389243 / 1409885245 / -2.2%	1323732412 / 1358918293 / -2.6%	1.04 / 1.04 / +0.4%
tpch_q07/duckdb:vortex-compact	1748146230 / 1653839313 / +5.7%	1719594749 / 1703211660 / +1.0%	1.02 / 0.97 / +4.7%
tpch_q08/duckdb:vortex-compact	1714608939 / 1624628698 / +5.5%	1940200743 / 1908354683 / +1.7%	0.88 / 0.85 / +3.8%
tpch_q09/duckdb:vortex-compact	2145892494 / 1798822783 / +19.3%	2158690681 / 1974467531 / +9.3%	0.99 / 0.91 / +9.1%
tpch_q10/duckdb:vortex-compact	2057968081 / 1727251547 / +19.1%	3007228299 / 2024364257 / +48.6% 🔴	0.68 / 0.85 / -19.8%
tpch_q11/duckdb:vortex-compact	599178662 / 509738455 / +17.5%	816871681 / 798085579 / +2.4%	0.73 / 0.64 / +14.8%
tpch_q12/duckdb:vortex-compact	2290959027 / 2294889840 / -0.2%	2687502801 / 2823099627 / -4.8%	0.85 / 0.81 / +4.9%
tpch_q13/duckdb:vortex-compact	770239287 / 725072148 / +6.2%	1160798853 / 1025879400 / +13.2%	0.66 / 0.71 / -6.1%
tpch_q14/duckdb:vortex-compact	1054901535 / 985838076 / +7.0%	1111723675 / 1054291327 / +5.4%	0.95 / 0.94 / +1.5%
tpch_q15/duckdb:vortex-compact	1119016949 / 959059374 / +16.7%	1231502624 / 1003863215 / +22.7%	0.91 / 0.96 / -4.9%
tpch_q16/duckdb:vortex-compact	284956481 / 370418765 / -23.1%	321460467 / 367286484 / -12.5%	0.89 / 1.01 / -12.1%
tpch_q17/duckdb:vortex-compact	1769851476 / 1609609689 / +10.0%	2038102036 / 2129049474 / -4.3%	0.87 / 0.76 / +14.9%
tpch_q18/duckdb:vortex-compact	1425656793 / 1125988879 / +26.6%	1315150990 / 1301183841 / +1.1%	1.08 / 0.87 / +25.3%
tpch_q19/duckdb:vortex-compact	1381047074 / 1314564207 / +5.1%	1618427387 / 1332960852 / +21.4%	0.85 / 0.99 / -13.5%
tpch_q20/duckdb:vortex-compact	1950648464 / 1791137008 / +8.9%	2148488026 / 2046139766 / +5.0%	0.91 / 0.88 / +3.7%
tpch_q21/duckdb:vortex-compact	2881003918 / 2706931406 / +6.4%	3092423624 / 2569880207 / +20.3%	0.93 / 1.05 / -11.6%
tpch_q22/duckdb:vortex-compact	734471906 / 458875676 / +60.1% 🔴	955651472 / 665261630 / +43.7% 🔴	0.77 / 0.69 / +11.4%

duckdb / parquet / ns (1.006x ➖, 1↑ 1↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet	556064181 / 485946569 / +14.4%	793908516 / 1036332864 / -23.4%	0.70 / 0.47 / +49.4%
tpch_q02/duckdb:parquet	922900442 / 948980927 / -2.7%	1680013618 / 1439428520 / +16.7%	0.55 / 0.66 / -16.7%
tpch_q03/duckdb:parquet	1159520802 / 1339979564 / -13.5%	1645177387 / 1819797446 / -9.6%	0.70 / 0.74 / -4.3%
tpch_q04/duckdb:parquet	868301966 / 1137217245 / -23.6%	933086303 / 1107275024 / -15.7%	0.93 / 1.03 / -9.4%
tpch_q05/duckdb:parquet	1314271255 / 1622565547 / -19.0%	1770649721 / 1712008093 / +3.4%	0.74 / 0.95 / -21.7%
tpch_q06/duckdb:parquet	580539674 / 478674565 / +21.3%	729902255 / 634072081 / +15.1%	0.80 / 0.75 / +5.4%
tpch_q07/duckdb:parquet	1378237758 / 1264935971 / +9.0%	1425949635 / 1286327656 / +10.9%	0.97 / 0.98 / -1.7%
tpch_q08/duckdb:parquet	1886166046 / 1639079362 / +15.1%	3142619583 / 1704396273 / +84.4% 🔴	0.60 / 0.96 / -37.6%
tpch_q09/duckdb:parquet	1675805070 / 1658273671 / +1.1%	1961778847 / 1867128350 / +5.1%	0.85 / 0.89 / -3.8%
tpch_q10/duckdb:parquet	2006660268 / 2134836706 / -6.0%	2454465415 / 2438868536 / +0.6%	0.82 / 0.88 / -6.6%
tpch_q11/duckdb:parquet	612687358 / 909378878 / -32.6% 🟢	744641310 / 1353657684 / -45.0% 🟢	0.82 / 0.67 / +22.5%
tpch_q12/duckdb:parquet	905614031 / 1046300921 / -13.4%	1366676505 / 1045276639 / +30.7% 🔴	0.66 / 1.00 / -33.8%
tpch_q13/duckdb:parquet	1028600728 / 1057017548 / -2.7%	1327738998 / 1852626452 / -28.3%	0.77 / 0.57 / +35.8%
tpch_q14/duckdb:parquet	884488306 / 743610203 / +18.9%	871573244 / 874671739 / -0.4%	1.01 / 0.85 / +19.4%
tpch_q15/duckdb:parquet	722422418 / 514236130 / +40.5% 🔴	651082408 / 729299168 / -10.7%	1.11 / 0.71 / +57.4%
tpch_q16/duckdb:parquet	717169448 / 773006131 / -7.2%	766221986 / 879787335 / -12.9%	0.94 / 0.88 / +6.5%
tpch_q17/duckdb:parquet	736887802 / 683457801 / +7.8%	795192508 / 710172877 / +12.0%	0.93 / 0.96 / -3.7%
tpch_q18/duckdb:parquet	1018194419 / 953801712 / +6.8%	815349259 / 1204178341 / -32.3% 🟢	1.25 / 0.79 / +57.7%
tpch_q19/duckdb:parquet	949345042 / 851835690 / +11.4%	1047854674 / 967368554 / +8.3%	0.91 / 0.88 / +2.9%
tpch_q20/duckdb:parquet	1383494399 / 1275499779 / +8.5%	1402497771 / 1210769745 / +15.8%	0.99 / 1.05 / -6.4%
tpch_q21/duckdb:parquet	1061730860 / 1109810798 / -4.3%	1013238551 / 1001426355 / +1.2%	1.05 / 1.11 / -5.4%
tpch_q22/duckdb:parquet	848980930 / 745927769 / +13.8%	987701639 / 878973713 / +12.4%	0.86 / 0.85 / +1.3%

joseph-isaacs added changelog/chore A trivial change action/bench-all Runs all CPU benchmarks. Do not combine with other benchmark labels; GPU is the only exception. labels Oct 14, 2026 — with Claude

github-actions Bot removed the action/bench-all Runs all CPU benchmarks. Do not combine with other benchmark labels; GPU is the only exception. label Oct 14, 2026

joseph-isaacs added the action/bench-all Runs all CPU benchmarks. Do not combine with other benchmark labels; GPU is the only exception. label Oct 14, 2026 — with Claude

joseph-isaacs changed the title ~~Set mimalloc as the global allocator in each e2e benchmark binary~~ Use mimalloc with purging disabled in each e2e benchmark binary Oct 14, 2026

github-actions Bot removed the action/bench-all Runs all CPU benchmarks. Do not combine with other benchmark labels; GPU is the only exception. label Oct 14, 2026

Sort libmimalloc-sys workspace dependency for taplo

2089d24

Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk> Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_0122rGn9fTSV47KLv191MTHB

joseph-isaacs marked this pull request as ready for review October 14, 2026 16:01

Conversation

joseph-isaacs commented Oct 14, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Summary

Changes

Uh oh!

codspeed Bot commented Oct 14, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Merging this PR will degrade performance by 23.15%

Performance Changes

Uh oh!

github-actions Bot commented Oct 14, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Polar Signals Profiling Results

Latest Run

Uh oh!

github-actions Bot commented Oct 14, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks: PolarSignals Profiling 📖

Uh oh!

github-actions Bot commented Oct 14, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks: FineWeb NVMe 📖

Uh oh!

github-actions Bot commented Oct 14, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks: TPC-H SF=1 on NVME 📖

Uh oh!

github-actions Bot commented Oct 14, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks: Clickbench Sorted on NVME 📖

Uh oh!

github-actions Bot commented Oct 14, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks: FineWeb S3 📖

Uh oh!

github-actions Bot commented Oct 14, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks: Appian on NVME 📖

Uh oh!

github-actions Bot commented Oct 14, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks: Clickbench on NVME 📖

Uh oh!

github-actions Bot commented Oct 14, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks: TPC-DS SF=1 on NVME 📖

Uh oh!

github-actions Bot commented Oct 14, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks: TPC-H SF=10 on NVME 📖

Uh oh!

github-actions Bot commented Oct 14, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks: Statistical and Population Genetics 📖

Uh oh!

github-actions Bot commented Oct 14, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks: String Encoding 📖

Uh oh!

github-actions Bot commented Oct 14, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks: Compression 📖

Uh oh!

github-actions Bot commented Oct 14, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks: Random Access 📖

Uh oh!

github-actions Bot commented Oct 14, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks: Random Access (S3) 📖

Uh oh!

joseph-isaacs commented Oct 14, 2026

Uh oh!

github-actions Bot commented Oct 14, 2026

Benchmarks: TPC-H SF=1 on S3 📖

Uh oh!

github-actions Bot commented Oct 14, 2026

Benchmarks: TPC-H SF=10 on S3 📖

Uh oh!

joseph-isaacs commented Oct 14, 2026 •

edited

Loading

codspeed Bot commented Oct 14, 2026 •

edited

Loading

github-actions Bot commented Oct 14, 2026 •

edited

Loading

github-actions Bot commented Oct 14, 2026 •

edited

Loading

github-actions Bot commented Oct 14, 2026 •

edited

Loading

github-actions Bot commented Oct 14, 2026 •

edited

Loading

github-actions Bot commented Oct 14, 2026 •

edited

Loading

github-actions Bot commented Oct 14, 2026 •

edited

Loading

github-actions Bot commented Oct 14, 2026 •

edited

Loading

github-actions Bot commented Oct 14, 2026 •

edited

Loading

github-actions Bot commented Oct 14, 2026 •

edited

Loading

github-actions Bot commented Oct 14, 2026 •

edited

Loading

github-actions Bot commented Oct 14, 2026 •

edited

Loading

github-actions Bot commented Oct 14, 2026 •

edited

Loading

github-actions Bot commented Oct 14, 2026 •

edited

Loading

github-actions Bot commented Oct 14, 2026 •

edited

Loading

github-actions Bot commented Oct 14, 2026 •

edited

Loading