Skip to content

Prototype separate pruning, filter, and projection scan splits - #9661

Draft
mhk197 wants to merge 2 commits into
developfrom
mk/filter-projection-splits-prototype
Draft

Prototype separate pruning, filter, and projection scan splits#9661
mhk197 wants to merge 2 commits into
developfrom
mk/filter-projection-splits-prototype

Conversation

@mhk197

@mhk197 mhk197 commented Aug 27, 2026

Copy link
Copy Markdown
Contributor

Summary

  • compute filter-native and projection-native scan splits independently behind VORTEX_EXPERIMENTAL_SEPARATE_SCAN_SPLITS=1
  • stage metadata pruning, exact filtering, and projection so pruning can reject ranges before projection I/O is registered
  • repartition shared unresolved filter masks onto projection ranges and register surviving projections in a bounded window
  • add a synthetic benchmark for skewed filter/projection chunk boundaries

Results

The synthetic skew benchmark was 26–37% faster and reduced segment requests from 512 to 268.

PolarSignals with the experimental list layout on local NVMe showed neutral wall time but a better I/O shape:

Query Wall time Physical reads Bytes read
Q1 +0.3% 277 → 234 352.4 → 348.7 MB
Q2 +1.7% 38 → 36 4.75 → 3.90 MB
Q3 −1.0% 339 → 252 363.4 → 352.8 MB

The request and byte reductions do not currently translate into a meaningful local PolarSignals speedup. This remains a draft while evaluating whether the scheduling complexity is justified, particularly for remote object storage.

Validation

  • cargo +nightly fmt --all
  • cargo nextest run -p vortex-layout — 248 passed
  • cargo clippy -p vortex-layout --all-targets --all-features
  • git diff --check

Benchmark configuration

  • DataFusion with Vortex format
  • VORTEX_EXPERIMENTAL_SEPARATE_SCAN_SPLITS=1
  • list-layout runs additionally used VORTEX_EXPERIMENTAL_LIST_LAYOUT=1

mhk197 added 2 commits August 26, 2026 16:06
Signed-off-by: "Matt Katz" <mhkatz97@gmail.com>
Signed-off-by: Matt Katz <mhkatz97@gmail.com>
@codspeed-hq

codspeed-hq Bot commented Aug 27, 2026

Copy link
Copy Markdown

Merging this PR will regress 8 benchmarks

⚠️ Unknown Walltime execution environment detected

Using the Walltime instrument on standard Hosted Runners will lead to inconsistent data.

For the most accurate results, we recommend using CodSpeed Macro Runners: bare-metal machines fine-tuned for performance measurement consistency.

⚠️ Different runtime environments detected

Some benchmarks with significant performance changes were compared across different runtime environments,
which may affect the accuracy of the results.

Open the report in CodSpeed to investigate

⚡ 14 improved benchmarks
❌ 8 regressed benchmarks
✅ 2108 untouched benchmarks
🆕 13 new benchmarks
⏩ 106 skipped benchmarks1
🗄️ 4 archived benchmarks run2

Warning

Please fix the performance issues or acknowledge them on CodSpeed.

Performance Changes

Mode Benchmark BASE HEAD Efficiency
Simulation cached_indices_i32[0.01] 37.6 µs 51.5 µs -26.98%
Simulation random_i256[0.01] 44.9 µs 56.1 µs -19.87%
Simulation cached_indices_i32[0.1] 54.9 µs 66.6 µs -17.6%
Simulation random_i16[0.95] 66.1 µs 77.6 µs -14.78%
WallTime mul_u32_nonnull_avx512 5.6 µs 6.4 µs -12.68%
WallTime mul_i8_nonnull_avx2 11.2 µs 12.9 µs -12.63%
Simulation cached_indices_i128[0.1] 68.3 µs 77.8 µs -12.21%
Simulation cold_misaligned[(16, 64)] 347.6 µs 392.4 µs -11.42%
Simulation patterns_i128[Contiguous] 141.6 µs 35.1 µs ×4
Simulation random_i64[0.8] 217.2 µs 118.1 µs +83.94%
Simulation random_i128[0.8] 267 µs 171.6 µs +55.61%
Simulation patterns_i128[Runs] 149 µs 107.6 µs +38.42%
Simulation random_i256[0.8] 368 µs 273.5 µs +34.55%
Simulation random_i256[0.5] 232.8 µs 192.7 µs +20.82%
WallTime arrow_checked_add_u32_avx2[16384] 21.3 µs 17.7 µs +20.32%
Simulation random_i16[0.5] 68.8 µs 57.8 µs +19.13%
Simulation patterns_i128[Random] 172.4 µs 145.4 µs +18.52%
Simulation random_i128[0.5] 172 µs 146.1 µs +17.74%
Simulation random_i8[0.95] 58.1 µs 51 µs +14.1%
Simulation random_i64[0.5] 130.8 µs 116.3 µs +12.45%
... ... ... ... ... ...

ℹ️ Only the first 20 benchmarks are displayed. Go to the app to view all benchmarks.

Tip

Investigate this regression by commenting @codspeedbot fix this regression on this PR, or directly use the CodSpeed MCP with your agent.


Comparing mk/filter-projection-splits-prototype (4182f55) with develop (59a056d)3

Open in CodSpeed

Footnotes

  1. 106 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports.

  2. 4 benchmarks were run, but are now archived. If they were deleted in another branch, consider rebasing to remove them from the report. Instead if they were added back, click here to restore them.

  3. No successful run was found on develop (d0a59fe) during the generation of this report, so 59a056d was used instead as the comparison base. There might be some changes unrelated to this pull request in this report.

@joseph-isaacs joseph-isaacs added the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Aug 27, 2026
@github-actions github-actions Bot removed the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Aug 27, 2026
@github-actions

github-actions Bot commented Aug 27, 2026

Copy link
Copy Markdown
Contributor

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done 4182f55 statpopgen 1 Explore Profiling Data
🟢 Done 4182f55 clickbench-sorted-nvme 1 Explore Profiling Data
🟢 Done 4182f55 fineweb 1 Explore Profiling Data
🟢 Done 4182f55 tpch-nvme-10 1 Explore Profiling Data
🟢 Done 4182f55 fineweb-s3 1 Explore Profiling Data
🟢 Done 4182f55 clickbench-nvme 1 Explore Profiling Data
🟢 Done 4182f55 tpcds-nvme 1 Explore Profiling Data
🟢 Done 4182f55 polarsignals 1 Explore Profiling Data
🟢 Done 4182f55 tpch-s3 1 Explore Profiling Data
🟢 Done 4182f55 tpch-nvme 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions

Copy link
Copy Markdown
Contributor

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟡 In Progress 4182f55 tpch-s3 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: PolarSignals Profiling 📖

Commits: PR 4182f555 vs base 8aeeac3a
Vortex (geomean): hot 1.022x ➖ · cold 1.006x ➖


datafusion / vortex-file-compressed / ns (1.022x ➖, 1↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
polarsignals_q00/datafusion:vortex-file-compressed 112286934 / 94278866 / +19.1% 🔴 208450780 / 203158373 / +2.6% 0.54 / 0.46 / +16.1%
polarsignals_q01/datafusion:vortex-file-compressed 157905375 / 156104572 / +1.2% 279208733 / 272091486 / +2.6% 0.57 / 0.57 / -1.4%
polarsignals_q02/datafusion:vortex-file-compressed 22722735 / 22587247 / +0.6% 95571635 / 93752026 / +1.9% 0.24 / 0.24 / -1.3%
polarsignals_q03/datafusion:vortex-file-compressed 158346152 / 159630634 / -0.8% 278880470 / 277800386 / +0.4% 0.57 / 0.57 / -1.2%
polarsignals_q04/datafusion:vortex-file-compressed 9871238 / 10327934 / -4.4% 78618972 / 82689348 / -4.9% 0.13 / 0.12 / +0.5%
polarsignals_q05/datafusion:vortex-file-compressed 13395824 / 12727952 / +5.2% 91047774 / 89853639 / +1.3% 0.15 / 0.14 / +3.9%
polarsignals_q06/datafusion:vortex-file-compressed 28443948 / 26943260 / +5.6% 104068294 / 104657082 / -0.6% 0.27 / 0.26 / +6.2%
polarsignals_q07/datafusion:vortex-file-compressed 11275124 / 12799978 / -11.9% 🟢 86617214 / 85023823 / +1.9% 0.13 / 0.15 / -13.5%
polarsignals_q08/datafusion:vortex-file-compressed 290726582 / 285981563 / +1.7% 407131080 / 397212679 / +2.5% 0.71 / 0.72 / -0.8%
polarsignals_q09/datafusion:vortex-file-compressed 11913782 / 10974374 / +8.6% 79125636 / 80048939 / -1.2% 0.15 / 0.14 / +9.8%

No file size changes detected.

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on NVME 📖

Commits: PR 4182f555 vs base 42a5d3b5
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.2%
Engines: DataFusion No clear signal (-0.7%, environment too noisy confidence) · DuckDB No clear signal (+0.2%, low confidence)
Vortex (geomean): hot 1.000x ➖ · cold 1.000x ➖
Parquet (geomean): hot 1.003x ➖ · cold 0.997x ➖
Shifts: Parquet (control) +0.3% · Median polish +0.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.997x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 41696995 / 41286483 / +1.0% 101861827 / 109343738 / -6.8% 0.41 / 0.38 / +8.4%
tpch_q02/datafusion:vortex-file-compressed 23757936 / 24022889 / -1.1% 67544390 / 71225253 / -5.2% 0.35 / 0.34 / +4.3%
tpch_q03/datafusion:vortex-file-compressed 28328256 / 28676623 / -1.2% 93763747 / 96258157 / -2.6% 0.30 / 0.30 / +1.4%
tpch_q04/datafusion:vortex-file-compressed 15705139 / 14987182 / +4.8% 67485734 / 65783049 / +2.6% 0.23 / 0.23 / +2.1%
tpch_q05/datafusion:vortex-file-compressed 46937067 / 47113843 / -0.4% 118637075 / 123201931 / -3.7% 0.40 / 0.38 / +3.5%
tpch_q06/datafusion:vortex-file-compressed 7975574 / 8259895 / -3.4% 56002133 / 57703898 / -2.9% 0.14 / 0.14 / -0.5%
tpch_q07/datafusion:vortex-file-compressed 56627982 / 54855607 / +3.2% 131157468 / 130379761 / +0.6% 0.43 / 0.42 / +2.6%
tpch_q08/datafusion:vortex-file-compressed 46368121 / 46568608 / -0.4% 120068250 / 115594200 / +3.9% 0.39 / 0.40 / -4.1%
tpch_q09/datafusion:vortex-file-compressed 54185259 / 54191667 / -0.0% 128457912 / 132977458 / -3.4% 0.42 / 0.41 / +3.5%
tpch_q10/datafusion:vortex-file-compressed 27984764 / 28781776 / -2.8% 99865480 / 100268955 / -0.4% 0.28 / 0.29 / -2.4%
tpch_q11/datafusion:vortex-file-compressed 17487164 / 17870302 / -2.1% 64386760 / 67975751 / -5.3% 0.27 / 0.26 / +3.3%
tpch_q12/datafusion:vortex-file-compressed 23954373 / 24304269 / -1.4% 75923300 / 74182011 / +2.3% 0.32 / 0.33 / -3.7%
tpch_q13/datafusion:vortex-file-compressed 23222023 / 23431114 / -0.9% 80504937 / 75646436 / +6.4% 0.29 / 0.31 / -6.9%
tpch_q14/datafusion:vortex-file-compressed 15448714 / 16019182 / -3.6% 75866446 / 77389569 / -2.0% 0.20 / 0.21 / -1.6%
tpch_q15/datafusion:vortex-file-compressed 21969448 / 21511865 / +2.1% 77660892 / 79607376 / -2.4% 0.28 / 0.27 / +4.7%
tpch_q16/datafusion:vortex-file-compressed 22364531 / 22928612 / -2.5% 74452786 / 76634910 / -2.8% 0.30 / 0.30 / +0.4%
tpch_q17/datafusion:vortex-file-compressed 55832251 / 54862295 / +1.8% 118837851 / 122894150 / -3.3% 0.47 / 0.45 / +5.2%
tpch_q18/datafusion:vortex-file-compressed 65127653 / 62911983 / +3.5% 118324965 / 120070504 / -1.5% 0.55 / 0.52 / +5.0%
tpch_q19/datafusion:vortex-file-compressed 15635567 / 15510718 / +0.8% 70081331 / 74094797 / -5.4% 0.22 / 0.21 / +6.6%
tpch_q20/datafusion:vortex-file-compressed 26738882 / 27280647 / -2.0% 86997021 / 90682152 / -4.1% 0.31 / 0.30 / +2.2%
tpch_q21/datafusion:vortex-file-compressed 61268098 / 61400695 / -0.2% 134879273 / 141749208 / -4.8% 0.45 / 0.43 / +4.9%
tpch_q22/datafusion:vortex-file-compressed 14007130 / 14068625 / -0.4% 60479195 / 61789565 / -2.1% 0.23 / 0.23 / +1.7%
datafusion / parquet / ns (1.005x ➖, 1↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 111648357 / 111679007 / -0.0% 148085655 / 147491082 / +0.4% 0.75 / 0.76 / -0.4%
tpch_q02/datafusion:parquet 69959205 / 69222794 / +1.1% 117220630 / 117867232 / -0.5% 0.60 / 0.59 / +1.6%
tpch_q03/datafusion:parquet 86932314 / 87376000 / -0.5% 154438527 / 144629235 / +6.8% 0.56 / 0.60 / -6.8%
tpch_q04/datafusion:parquet 49746111 / 50061821 / -0.6% 97847923 / 104993866 / -6.8% 0.51 / 0.48 / +6.6%
tpch_q05/datafusion:parquet 109685727 / 102438433 / +7.1% 187743646 / 171735081 / +9.3% 0.58 / 0.60 / -2.1%
tpch_q06/datafusion:parquet 47966576 / 38905457 / +23.3% 🔴 84779310 / 89726700 / -5.5% 0.57 / 0.43 / +30.5%
tpch_q07/datafusion:parquet 109723094 / 112659698 / -2.6% 200284863 / 180835703 / +10.8% 🔴 0.55 / 0.62 / -12.1%
tpch_q08/datafusion:parquet 112820401 / 105119068 / +7.3% 172167387 / 172109602 / +0.0% 0.66 / 0.61 / +7.3%
tpch_q09/datafusion:parquet 145074921 / 145655424 / -0.4% 206185986 / 208914517 / -1.3% 0.70 / 0.70 / +0.9%
tpch_q10/datafusion:parquet 116660044 / 122981537 / -5.1% 181987089 / 198177476 / -8.2% 0.64 / 0.62 / +3.3%
tpch_q11/datafusion:parquet 51260709 / 50418740 / +1.7% 103498933 / 110702386 / -6.5% 0.50 / 0.46 / +8.7%
tpch_q12/datafusion:parquet 93712545 / 92392303 / +1.4% 151576077 / 156993790 / -3.5% 0.62 / 0.59 / +5.1%
tpch_q13/datafusion:parquet 210170292 / 212161518 / -0.9% 295889717 / 268010492 / +10.4% 🔴 0.71 / 0.79 / -10.3%
tpch_q14/datafusion:parquet 48487654 / 52491505 / -7.6% 111565200 / 112181713 / -0.5% 0.43 / 0.47 / -7.1%
tpch_q15/datafusion:parquet 61873261 / 70819059 / -12.6% 🟢 119427648 / 120813068 / -1.1% 0.52 / 0.59 / -11.6%
tpch_q16/datafusion:parquet 51358030 / 52450253 / -2.1% 101785160 / 103002858 / -1.2% 0.50 / 0.51 / -0.9%
tpch_q17/datafusion:parquet 151131855 / 144419266 / +4.6% 205719241 / 224516591 / -8.4% 0.73 / 0.64 / +14.2%
tpch_q18/datafusion:parquet 163696458 / 165218855 / -0.9% 220648945 / 219056813 / +0.7% 0.74 / 0.75 / -1.6%
tpch_q19/datafusion:parquet 73584221 / 74181697 / -0.8% 150477745 / 150998164 / -0.3% 0.49 / 0.49 / -0.5%
tpch_q20/datafusion:parquet 74057680 / 73821393 / +0.3% 138189849 / 137464558 / +0.5% 0.54 / 0.54 / -0.2%
tpch_q21/datafusion:parquet 136625484 / 136357886 / +0.2% 203249250 / 230525774 / -11.8% 🟢 0.67 / 0.59 / +13.6%
tpch_q22/datafusion:parquet 55676919 / 54658749 / +1.9% 97959100 / 100309966 / -2.3% 0.57 / 0.54 / +4.3%
duckdb / vortex-file-compressed / ns (1.003x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 24065029 / 21986146 / +9.5% 60761314 / 63721887 / -4.6% 0.40 / 0.35 / +14.8%
tpch_q02/duckdb:vortex-file-compressed 31032667 / 30575125 / +1.5% 54257053 / 53956594 / +0.6% 0.57 / 0.57 / +0.9%
tpch_q03/duckdb:vortex-file-compressed 36516503 / 36374635 / +0.4% 83176115 / 86335341 / -3.7% 0.44 / 0.42 / +4.2%
tpch_q04/duckdb:vortex-file-compressed 32450583 / 32268229 / +0.6% 72324938 / 67543425 / +7.1% 0.45 / 0.48 / -6.1%
tpch_q05/duckdb:vortex-file-compressed 41377434 / 41195938 / +0.4% 85738611 / 86338394 / -0.7% 0.48 / 0.48 / +1.1%
tpch_q06/duckdb:vortex-file-compressed 9686231 / 9122508 / +6.2% 40943167 / 34597956 / +18.3% 🔴 0.24 / 0.26 / -10.3%
tpch_q07/duckdb:vortex-file-compressed 38774016 / 39488936 / -1.8% 81518478 / 88152843 / -7.5% 0.48 / 0.45 / +6.2%
tpch_q08/duckdb:vortex-file-compressed 48808884 / 46643978 / +4.6% 95620523 / 96638787 / -1.1% 0.51 / 0.48 / +5.8%
tpch_q09/duckdb:vortex-file-compressed 57083908 / 59872030 / -4.7% 107608399 / 104332272 / +3.1% 0.53 / 0.57 / -7.6%
tpch_q10/duckdb:vortex-file-compressed 50848899 / 48001561 / +5.9% 96599452 / 90252446 / +7.0% 0.53 / 0.53 / -1.0%
tpch_q11/duckdb:vortex-file-compressed 15511218 / 17710937 / -12.4% 🟢 38057436 / 37347149 / +1.9% 0.41 / 0.47 / -14.1%
tpch_q12/duckdb:vortex-file-compressed 27527575 / 26739130 / +2.9% 59199754 / 59157157 / +0.1% 0.46 / 0.45 / +2.9%
tpch_q13/duckdb:vortex-file-compressed 43280580 / 45504339 / -4.9% 127548269 / 114169100 / +11.7% 🔴 0.34 / 0.40 / -14.9%
tpch_q14/duckdb:vortex-file-compressed 21600337 / 21204430 / +1.9% 60685800 / 55258965 / +9.8% 0.36 / 0.38 / -7.2%
tpch_q15/duckdb:vortex-file-compressed 18921791 / 18482009 / +2.4% 55601347 / 53537502 / +3.9% 0.34 / 0.35 / -1.4%
tpch_q16/duckdb:vortex-file-compressed 31263255 / 29835215 / +4.8% 47361656 / 48094580 / -1.5% 0.66 / 0.62 / +6.4%
tpch_q17/duckdb:vortex-file-compressed 33027506 / 32121647 / +2.8% 82010682 / 90815294 / -9.7% 0.40 / 0.35 / +13.9%
tpch_q18/duckdb:vortex-file-compressed 52027021 / 52652516 / -1.2% 85553236 / 87369422 / -2.1% 0.61 / 0.60 / +0.9%
tpch_q19/duckdb:vortex-file-compressed 34218486 / 36791239 / -7.0% 80653970 / 76546490 / +5.4% 0.42 / 0.48 / -11.7%
tpch_q20/duckdb:vortex-file-compressed 34149665 / 34950991 / -2.3% 85918400 / 87239310 / -1.5% 0.40 / 0.40 / -0.8%
tpch_q21/duckdb:vortex-file-compressed 116370249 / 118011824 / -1.4% 169206941 / 167824112 / +0.8% 0.69 / 0.70 / -2.2%
tpch_q22/duckdb:vortex-file-compressed 21089922 / 20879250 / +1.0% 43651917 / 38773075 / +12.6% 🔴 0.48 / 0.54 / -10.3%
duckdb / parquet / ns (1.001x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 82047792 / 81857449 / +0.2% 93284092 / 93282492 / +0.0% 0.88 / 0.88 / +0.2%
tpch_q02/duckdb:parquet 46309203 / 45454992 / +1.9% 63996969 / 62764906 / +2.0% 0.72 / 0.72 / -0.1%
tpch_q03/duckdb:parquet 80629813 / 81271694 / -0.8% 102493078 / 101856888 / +0.6% 0.79 / 0.80 / -1.4%
tpch_q04/duckdb:parquet 58352107 / 57697184 / +1.1% 78971223 / 80051665 / -1.3% 0.74 / 0.72 / +2.5%
tpch_q05/duckdb:parquet 79062464 / 79208173 / -0.2% 101339781 / 101193810 / +0.1% 0.78 / 0.78 / -0.3%
tpch_q06/duckdb:parquet 24638291 / 25053208 / -1.7% 34524886 / 33914283 / +1.8% 0.71 / 0.74 / -3.4%
tpch_q07/duckdb:parquet 80911541 / 80381017 / +0.7% 100507890 / 99659489 / +0.9% 0.81 / 0.81 / -0.2%
tpch_q08/duckdb:parquet 96563239 / 97405348 / -0.9% 120553427 / 120412656 / +0.1% 0.80 / 0.81 / -1.0%
tpch_q09/duckdb:parquet 148788828 / 148465255 / +0.2% 172061318 / 170636476 / +0.8% 0.86 / 0.87 / -0.6%
tpch_q10/duckdb:parquet 142697737 / 142619872 / +0.1% 168092141 / 165108411 / +1.8% 0.85 / 0.86 / -1.7%
tpch_q11/duckdb:parquet 25608479 / 25798450 / -0.7% 36068773 / 35450983 / +1.7% 0.71 / 0.73 / -2.4%
tpch_q12/duckdb:parquet 53715669 / 53039363 / +1.3% 69139259 / 68719648 / +0.6% 0.78 / 0.77 / +0.7%
tpch_q13/duckdb:parquet 289600476 / 287844903 / +0.6% 308903815 / 307677881 / +0.4% 0.94 / 0.94 / +0.2%
tpch_q14/duckdb:parquet 56346095 / 56464346 / -0.2% 71099734 / 72027310 / -1.3% 0.79 / 0.78 / +1.1%
tpch_q15/duckdb:parquet 30956002 / 31212660 / -0.8% 44320722 / 43937663 / +0.9% 0.70 / 0.71 / -1.7%
tpch_q16/duckdb:parquet 66926516 / 66101947 / +1.2% 82757510 / 83408986 / -0.8% 0.81 / 0.79 / +2.0%
tpch_q17/duckdb:parquet 58589721 / 58760009 / -0.3% 75925805 / 77215294 / -1.7% 0.77 / 0.76 / +1.4%
tpch_q18/duckdb:parquet 127157024 / 125575589 / +1.3% 146638816 / 146209322 / +0.3% 0.87 / 0.86 / +1.0%
tpch_q19/duckdb:parquet 78105563 / 77874896 / +0.3% 95944048 / 96755737 / -0.8% 0.81 / 0.80 / +1.1%
tpch_q20/duckdb:parquet 77627503 / 79036173 / -1.8% 102766172 / 102756544 / +0.0% 0.76 / 0.77 / -1.8%
tpch_q21/duckdb:parquet 190729237 / 189255331 / +0.8% 211599834 / 212043244 / -0.2% 0.90 / 0.89 / +1.0%
tpch_q22/duckdb:parquet 64154259 / 64653066 / -0.8% 82336641 / 78669257 / +4.7% 0.78 / 0.82 / -5.2%

No file size changes detected.

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb NVMe 📖

Commits: PR 4182f555 vs base 42a5d3b5
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +1.1%
Engines: DataFusion No clear signal (-0.1%, low confidence) · DuckDB No clear signal (+2.2%, low confidence)
Vortex (geomean): hot 1.010x ➖ · cold 1.064x ➖
Parquet (geomean): hot 0.999x ➖ · cold 1.006x ➖
Shifts: Parquet (control) -0.1% · Median polish +0.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.995x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-file-compressed 8583318 / 8110594 / +5.8% 38409456 / 36974023 / +3.9% 0.22 / 0.22 / +1.9%
fineweb_q01/datafusion:vortex-file-compressed 30392675 / 31912606 / -4.8% 94805686 / 101302602 / -6.4% 0.32 / 0.32 / +1.8%
fineweb_q02/datafusion:vortex-file-compressed 32080669 / 35416736 / -9.4% 107017105 / 99371795 / +7.7% 0.30 / 0.36 / -15.9%
fineweb_q03/datafusion:vortex-file-compressed 43124836 / 43668266 / -1.2% 176792268 / 184768206 / -4.3% 0.24 / 0.24 / +3.2%
fineweb_q04/datafusion:vortex-file-compressed 206124481 / 208216768 / -1.0% 348303217 / 321305540 / +8.4% 0.59 / 0.65 / -8.7%
fineweb_q05/datafusion:vortex-file-compressed 153104736 / 153605616 / -0.3% 271893414 / 289744050 / -6.2% 0.56 / 0.53 / +6.2%
fineweb_q06/datafusion:vortex-file-compressed 40637262 / 39847786 / +2.0% 191464672 / 185817252 / +3.0% 0.21 / 0.21 / -1.0%
fineweb_q07/datafusion:vortex-file-compressed 38508130 / 38842526 / -0.9% 184143309 / 182899732 / +0.7% 0.21 / 0.21 / -1.5%
fineweb_q08/datafusion:vortex-file-compressed 20554378 / 19326164 / +6.4% 84543311 / 78518062 / +7.7% 0.24 / 0.25 / -1.2%
datafusion / parquet / ns (0.996x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:parquet 9011404 / 9442565 / -4.6% 53432417 / 53672365 / -0.4% 0.17 / 0.18 / -4.1%
fineweb_q01/datafusion:parquet 188528637 / 187904383 / +0.3% 284790724 / 280975925 / +1.4% 0.66 / 0.67 / -1.0%
fineweb_q02/datafusion:parquet 189393975 / 188740556 / +0.3% 279863723 / 280787234 / -0.3% 0.68 / 0.67 / +0.7%
fineweb_q03/datafusion:parquet 189049656 / 192872588 / -2.0% 282383396 / 286644757 / -1.5% 0.67 / 0.67 / -0.5%
fineweb_q04/datafusion:parquet 209290576 / 207784494 / +0.7% 299998396 / 302194790 / -0.7% 0.70 / 0.69 / +1.5%
fineweb_q05/datafusion:parquet 206179485 / 204741936 / +0.7% 292194095 / 297884742 / -1.9% 0.71 / 0.69 / +2.7%
fineweb_q06/datafusion:parquet 191817465 / 190436079 / +0.7% 285433072 / 286400690 / -0.3% 0.67 / 0.66 / +1.1%
fineweb_q07/datafusion:parquet 191127168 / 189200562 / +1.0% 285759826 / 286701877 / -0.3% 0.67 / 0.66 / +1.4%
fineweb_q08/datafusion:parquet 187886071 / 189385426 / -0.8% 278477522 / 277984423 / +0.2% 0.67 / 0.68 / -1.0%
duckdb / vortex-file-compressed / ns (1.025x ➖, 1↑ 3↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-file-compressed 3678958 / 3235722 / +13.7% 🔴 16177339 / 14014481 / +15.4% 🔴 0.23 / 0.23 / -1.5%
fineweb_q01/duckdb:vortex-file-compressed 38948604 / 43574910 / -10.6% 🟢 123524525 / 139653162 / -11.5% 🟢 0.32 / 0.31 / +1.1%
fineweb_q02/duckdb:vortex-file-compressed 47007058 / 49884324 / -5.8% 119995482 / 136089988 / -11.8% 🟢 0.39 / 0.37 / +6.9%
fineweb_q03/duckdb:vortex-file-compressed 69849734 / 68100994 / +2.6% 292517185 / 197911585 / +47.8% 🔴 0.24 / 0.34 / -30.6%
fineweb_q04/duckdb:vortex-file-compressed 280580040 / 276914095 / +1.3% 392130701 / 404238910 / -3.0% 0.72 / 0.69 / +4.5%
fineweb_q05/duckdb:vortex-file-compressed 218839518 / 211687765 / +3.4% 329958966 / 305314302 / +8.1% 0.66 / 0.69 / -4.3%
fineweb_q06/duckdb:vortex-file-compressed 70914165 / 64379886 / +10.1% 🔴 370902828 / 236405949 / +56.9% 🔴 0.19 / 0.27 / -29.8%
fineweb_q07/duckdb:vortex-file-compressed 58336328 / 60858951 / -4.1% 189990204 / 184704367 / +2.9% 0.31 / 0.33 / -6.8%
fineweb_q08/duckdb:vortex-file-compressed 30735227 / 26806332 / +14.7% 🔴 106683070 / 89728029 / +18.9% 🔴 0.29 / 0.30 / -3.6%
duckdb / parquet / ns (1.002x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:parquet 34816790 / 36575976 / -4.8% 41243303 / 38230924 / +7.9% 0.84 / 0.96 / -11.8%
fineweb_q01/duckdb:parquet 80281109 / 77014698 / +4.2% 105728584 / 107467456 / -1.6% 0.76 / 0.72 / +6.0%
fineweb_q02/duckdb:parquet 78846629 / 77516643 / +1.7% 107413638 / 105892899 / +1.4% 0.73 / 0.73 / +0.3%
fineweb_q03/duckdb:parquet 207600762 / 204241497 / +1.6% 428498332 / 408622196 / +4.9% 0.48 / 0.50 / -3.1%
fineweb_q04/duckdb:parquet 229114990 / 230874830 / -0.8% 440550011 / 432271646 / +1.9% 0.52 / 0.53 / -2.6%
fineweb_q05/duckdb:parquet 203141514 / 203598926 / -0.2% 431376112 / 417298960 / +3.4% 0.47 / 0.49 / -3.5%
fineweb_q06/duckdb:parquet 142084822 / 144367906 / -1.6% 275194137 / 270942178 / +1.6% 0.52 / 0.53 / -3.1%
fineweb_q07/duckdb:parquet 149394730 / 143117594 / +4.4% 346492700 / 341522917 / +1.5% 0.43 / 0.42 / +2.9%
fineweb_q08/duckdb:parquet 37071026 / 37859953 / -2.1% 40311359 / 42856566 / -5.9% 0.92 / 0.88 / +4.1%

No file size changes detected.

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench Sorted on NVME 📖

Commits: PR 4182f555 vs base 8aeeac3a
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +2.1%
Engines: DataFusion No clear signal (-4.2%, low confidence) · DuckDB No clear signal (+8.9%, low confidence)
Vortex (geomean): hot 0.997x ➖ · cold 0.927x ➖
Parquet (geomean): hot 0.977x ➖ · cold 1.007x ➖
Shifts: Parquet (control) -2.3% · Median polish -1.0%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.938x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/datafusion:vortex-file-compressed 242195833 / 477507918 / -49.3% 🟢 403593262 / 1017824967 / -60.3% 🟢 0.60 / 0.47 / +27.9%
clickbench-sorted_q24/datafusion:vortex-file-compressed 28118876 / 27305214 / +3.0% 87748103 / 88832344 / -1.2% 0.32 / 0.31 / +4.3%
clickbench-sorted_q26/datafusion:vortex-file-compressed 27240246 / 26321735 / +3.5% 91559614 / 92424080 / -0.9% 0.30 / 0.28 / +4.5%
clickbench-sorted_q36/datafusion:vortex-file-compressed 51767441 / 52315450 / -1.0% 127599584 / 130473721 / -2.2% 0.41 / 0.40 / +1.2%
clickbench-sorted_q37/datafusion:vortex-file-compressed 40132494 / 41218621 / -2.6% 110951317 / 111047488 / -0.1% 0.36 / 0.37 / -2.6%
clickbench-sorted_q38/datafusion:vortex-file-compressed 50213086 / 49899108 / +0.6% 109012554 / 121152041 / -10.0% 🟢 0.46 / 0.41 / +11.8%
clickbench-sorted_q39/datafusion:vortex-file-compressed 126041363 / 122660778 / +2.8% 201418962 / 210812295 / -4.5% 0.63 / 0.58 / +7.5%
clickbench-sorted_q40/datafusion:vortex-file-compressed 21552744 / 21482642 / +0.3% 82226589 / 79761425 / +3.1% 0.26 / 0.27 / -2.7%
clickbench-sorted_q41/datafusion:vortex-file-compressed 20221247 / 20457290 / -1.2% 82234799 / 83889833 / -2.0% 0.25 / 0.24 / +0.8%
clickbench-sorted_q42/datafusion:vortex-file-compressed 16546336 / 16694826 / -0.9% 65770667 / 70616435 / -6.9% 0.25 / 0.24 / +6.4%
datafusion / parquet / ns (0.980x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/datafusion:parquet 2459418822 / 2484792930 / -1.0% 3001630371 / 2898411674 / +3.6% 0.82 / 0.86 / -4.4%
clickbench-sorted_q24/datafusion:parquet 16590246 / 17986541 / -7.8% 118461725 / 116686309 / +1.5% 0.14 / 0.15 / -9.1%
clickbench-sorted_q26/datafusion:parquet 17499713 / 17084592 / +2.4% 119254031 / 120211909 / -0.8% 0.15 / 0.14 / +3.3%
clickbench-sorted_q36/datafusion:parquet 156610756 / 166684815 / -6.0% 274679745 / 277513718 / -1.0% 0.57 / 0.60 / -5.1%
clickbench-sorted_q37/datafusion:parquet 98142826 / 99318362 / -1.2% 204875930 / 220492871 / -7.1% 0.48 / 0.45 / +6.3%
clickbench-sorted_q38/datafusion:parquet 145402860 / 143843544 / +1.1% 253494366 / 261741498 / -3.2% 0.57 / 0.55 / +4.4%
clickbench-sorted_q39/datafusion:parquet 264910418 / 283712064 / -6.6% 418696949 / 380239912 / +10.1% 🔴 0.63 / 0.75 / -15.2%
clickbench-sorted_q40/datafusion:parquet 65586716 / 63634844 / +3.1% 184685310 / 178823506 / +3.3% 0.36 / 0.36 / -0.2%
clickbench-sorted_q41/datafusion:parquet 58215372 / 60196198 / -3.3% 174049749 / 170435351 / +2.1% 0.33 / 0.35 / -5.3%
clickbench-sorted_q42/datafusion:parquet 33374846 / 33407351 / -0.1% 137742808 / 137137037 / +0.4% 0.24 / 0.24 / -0.5%
duckdb / vortex-file-compressed / ns (1.060x ➖, 0↑ 3↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/duckdb:vortex-file-compressed 120028508 / 115503090 / +3.9% 203502127 / 203462604 / +0.0% 0.59 / 0.57 / +3.9%
clickbench-sorted_q24/duckdb:vortex-file-compressed 26691080 / 28725416 / -7.1% 76226885 / 74095327 / +2.9% 0.35 / 0.39 / -9.7%
clickbench-sorted_q26/duckdb:vortex-file-compressed 29052260 / 25003117 / +16.2% 🔴 73652574 / 71577186 / +2.9% 0.39 / 0.35 / +12.9%
clickbench-sorted_q36/duckdb:vortex-file-compressed 77613120 / 73707233 / +5.3% 183238489 / 190240784 / -3.7% 0.42 / 0.39 / +9.3%
clickbench-sorted_q37/duckdb:vortex-file-compressed 59120324 / 59485932 / -0.6% 168090385 / 161143719 / +4.3% 0.35 / 0.37 / -4.7%
clickbench-sorted_q38/duckdb:vortex-file-compressed 82982238 / 73744224 / +12.5% 🔴 168697889 / 180789933 / -6.7% 0.49 / 0.41 / +20.6%
clickbench-sorted_q39/duckdb:vortex-file-compressed 191303482 / 168326312 / +13.7% 🔴 278311876 / 257258739 / +8.2% 0.69 / 0.65 / +5.1%
clickbench-sorted_q40/duckdb:vortex-file-compressed 35081488 / 32159446 / +9.1% 97074974 / 117174645 / -17.2% 🟢 0.36 / 0.27 / +31.7%
clickbench-sorted_q41/duckdb:vortex-file-compressed 35770829 / 33020836 / +8.3% 108770343 / 122260399 / -11.0% 🟢 0.33 / 0.27 / +21.8%
clickbench-sorted_q42/duckdb:vortex-file-compressed 30903919 / 30703042 / +0.7% 97549043 / 107672948 / -9.4% 0.32 / 0.29 / +11.1%
duckdb / parquet / ns (0.973x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/duckdb:parquet 217289682 / 225406052 / -3.6% 273453410 / 256275048 / +6.7% 0.79 / 0.88 / -9.7%
clickbench-sorted_q24/duckdb:parquet 32951357 / 35202033 / -6.4% 55933765 / 57845512 / -3.3% 0.59 / 0.61 / -3.2%
clickbench-sorted_q26/duckdb:parquet 24531446 / 26679070 / -8.0% 55731933 / 61213598 / -9.0% 0.44 / 0.44 / +1.0%
clickbench-sorted_q36/duckdb:parquet 74597990 / 72584764 / +2.8% 101503625 / 100270806 / +1.2% 0.73 / 0.72 / +1.5%
clickbench-sorted_q37/duckdb:parquet 58483878 / 56317209 / +3.8% 88001730 / 88272316 / -0.3% 0.66 / 0.64 / +4.2%
clickbench-sorted_q38/duckdb:parquet 61892194 / 64919406 / -4.7% 95208990 / 91984878 / +3.5% 0.65 / 0.71 / -7.9%
clickbench-sorted_q39/duckdb:parquet 111136205 / 108452657 / +2.5% 157184768 / 160239485 / -1.9% 0.71 / 0.68 / +4.5%
clickbench-sorted_q40/duckdb:parquet 29520246 / 31506549 / -6.3% 69672103 / 68680661 / +1.4% 0.42 / 0.46 / -7.6%
clickbench-sorted_q41/duckdb:parquet 28518448 / 30446710 / -6.3% 65820290 / 64388612 / +2.2% 0.43 / 0.47 / -8.4%
clickbench-sorted_q42/duckdb:parquet 20744520 / 20663252 / +0.4% 48113993 / 44918895 / +7.1% 0.43 / 0.46 / -6.3%

File Size Changes (100 files changed, -0.0% overall, 48↑ 52↓)
File Scale Format Base HEAD Change %
hits_011.vortex 1.0 vortex-file-compressed 197.72 MB 199.04 MB +1.32 MB +0.7%
hits_070.vortex 1.0 vortex-file-compressed 198.13 MB 199.25 MB +1.11 MB +0.6%
hits_097.vortex 1.0 vortex-file-compressed 191.86 MB 192.91 MB +1.05 MB +0.5%
hits_084.vortex 1.0 vortex-file-compressed 153.55 MB 154.38 MB +853.98 KB +0.5%
hits_040.vortex 1.0 vortex-file-compressed 142.38 MB 143.13 MB +765.74 KB +0.5%
hits_042.vortex 1.0 vortex-file-compressed 200.11 MB 201.09 MB +1001.12 KB +0.5%
hits_057.vortex 1.0 vortex-file-compressed 158.95 MB 159.60 MB +664.11 KB +0.4%
hits_058.vortex 1.0 vortex-file-compressed 154.15 MB 154.75 MB +615.79 KB +0.4%
hits_004.vortex 1.0 vortex-file-compressed 130.49 MB 130.82 MB +341.51 KB +0.3%
hits_089.vortex 1.0 vortex-file-compressed 130.51 MB 130.82 MB +321.34 KB +0.2%
hits_041.vortex 1.0 vortex-file-compressed 130.14 MB 130.45 MB +316.65 KB +0.2%
hits_079.vortex 1.0 vortex-file-compressed 180.07 MB 180.44 MB +382.35 KB +0.2%
hits_090.vortex 1.0 vortex-file-compressed 191.61 MB 191.98 MB +381.45 KB +0.2%
hits_007.vortex 1.0 vortex-file-compressed 199.19 MB 199.55 MB +369.55 KB +0.2%
hits_020.vortex 1.0 vortex-file-compressed 159.15 MB 159.43 MB +284.77 KB +0.2%
hits_005.vortex 1.0 vortex-file-compressed 166.42 MB 166.68 MB +266.55 KB +0.2%
hits_008.vortex 1.0 vortex-file-compressed 138.86 MB 139.04 MB +186.66 KB +0.1%
hits_059.vortex 1.0 vortex-file-compressed 198.34 MB 198.58 MB +246.12 KB +0.1%
hits_094.vortex 1.0 vortex-file-compressed 157.55 MB 157.74 MB +194.01 KB +0.1%
hits_023.vortex 1.0 vortex-file-compressed 194.34 MB 194.56 MB +224.42 KB +0.1%
hits_025.vortex 1.0 vortex-file-compressed 171.13 MB 171.31 MB +189.52 KB +0.1%
hits_096.vortex 1.0 vortex-file-compressed 198.66 MB 198.86 MB +204.45 KB +0.1%
hits_085.vortex 1.0 vortex-file-compressed 199.00 MB 199.20 MB +201.65 KB +0.1%
hits_037.vortex 1.0 vortex-file-compressed 176.53 MB 176.70 MB +173.70 KB +0.1%
hits_063.vortex 1.0 vortex-file-compressed 130.77 MB 130.89 MB +123.10 KB +0.1%
hits_098.vortex 1.0 vortex-file-compressed 136.66 MB 136.78 MB +116.33 KB +0.1%
hits_034.vortex 1.0 vortex-file-compressed 180.85 MB 180.99 MB +146.56 KB +0.1%
hits_000.vortex 1.0 vortex-file-compressed 130.59 MB 130.67 MB +89.73 KB +0.1%
hits_056.vortex 1.0 vortex-file-compressed 134.43 MB 134.51 MB +78.23 KB +0.1%
hits_019.vortex 1.0 vortex-file-compressed 139.66 MB 139.73 MB +76.68 KB +0.1%
hits_010.vortex 1.0 vortex-file-compressed 168.07 MB 168.16 MB +90.30 KB +0.1%
hits_051.vortex 1.0 vortex-file-compressed 171.60 MB 171.68 MB +83.38 KB +0.0%
hits_082.vortex 1.0 vortex-file-compressed 138.62 MB 138.68 MB +61.17 KB +0.0%
hits_092.vortex 1.0 vortex-file-compressed 198.87 MB 198.95 MB +82.15 KB +0.0%
hits_068.vortex 1.0 vortex-file-compressed 159.45 MB 159.52 MB +64.73 KB +0.0%
hits_069.vortex 1.0 vortex-file-compressed 141.67 MB 141.72 MB +55.60 KB +0.0%
hits_071.vortex 1.0 vortex-file-compressed 138.78 MB 138.82 MB +49.83 KB +0.0%
hits_027.vortex 1.0 vortex-file-compressed 188.80 MB 188.86 MB +65.98 KB +0.0%
hits_078.vortex 1.0 vortex-file-compressed 130.01 MB 130.04 MB +38.46 KB +0.0%
hits_026.vortex 1.0 vortex-file-compressed 130.39 MB 130.43 MB +35.40 KB +0.0%
hits_043.vortex 1.0 vortex-file-compressed 125.80 MB 125.83 MB +32.20 KB +0.0%
hits_021.vortex 1.0 vortex-file-compressed 153.36 MB 153.39 MB +35.71 KB +0.0%
hits_076.vortex 1.0 vortex-file-compressed 159.93 MB 159.96 MB +28.98 KB +0.0%
hits_065.vortex 1.0 vortex-file-compressed 160.23 MB 160.25 MB +28.63 KB +0.0%
hits_024.vortex 1.0 vortex-file-compressed 159.54 MB 159.56 MB +19.07 KB +0.0%
hits_080.vortex 1.0 vortex-file-compressed 126.22 MB 126.23 MB +7.77 KB +0.0%
hits_091.vortex 1.0 vortex-file-compressed 146.10 MB 146.11 MB +5.91 KB +0.0%
hits_055.vortex 1.0 vortex-file-compressed 199.00 MB 199.01 MB +5.94 KB +0.0%
hits_012.vortex 1.0 vortex-file-compressed 189.83 MB 189.82 MB 8.88 KB -0.0%
hits_053.vortex 1.0 vortex-file-compressed 188.96 MB 188.95 MB 11.03 KB -0.0%
hits_014.vortex 1.0 vortex-file-compressed 171.39 MB 171.37 MB 24.42 KB -0.0%
hits_030.vortex 1.0 vortex-file-compressed 130.85 MB 130.83 MB 22.77 KB -0.0%
hits_006.vortex 1.0 vortex-file-compressed 125.66 MB 125.62 MB 34.14 KB -0.0%
hits_002.vortex 1.0 vortex-file-compressed 160.06 MB 160.01 MB 45.59 KB -0.0%
hits_086.vortex 1.0 vortex-file-compressed 191.25 MB 191.18 MB 66.51 KB -0.0%
hits_088.vortex 1.0 vortex-file-compressed 171.43 MB 171.38 MB 59.98 KB -0.0%
hits_047.vortex 1.0 vortex-file-compressed 153.64 MB 153.59 MB 56.98 KB -0.0%
hits_003.vortex 1.0 vortex-file-compressed 135.72 MB 135.67 MB 53.29 KB -0.0%
hits_073.vortex 1.0 vortex-file-compressed 172.03 MB 171.96 MB 70.25 KB -0.0%
hits_087.vortex 1.0 vortex-file-compressed 160.03 MB 159.96 MB 70.31 KB -0.0%
hits_067.vortex 1.0 vortex-file-compressed 130.81 MB 130.75 MB 62.56 KB -0.0%
hits_064.vortex 1.0 vortex-file-compressed 190.09 MB 189.99 MB 98.75 KB -0.1%
hits_049.vortex 1.0 vortex-file-compressed 190.40 MB 190.30 MB 98.95 KB -0.1%
hits_060.vortex 1.0 vortex-file-compressed 192.23 MB 192.13 MB 100.73 KB -0.1%
hits_029.vortex 1.0 vortex-file-compressed 199.27 MB 199.16 MB 113.68 KB -0.1%
hits_083.vortex 1.0 vortex-file-compressed 156.07 MB 155.98 MB 92.59 KB -0.1%
hits_009.vortex 1.0 vortex-file-compressed 100.77 MB 100.71 MB 61.15 KB -0.1%
hits_054.vortex 1.0 vortex-file-compressed 146.08 MB 145.99 MB 94.39 KB -0.1%
hits_015.vortex 1.0 vortex-file-compressed 130.23 MB 130.15 MB 84.95 KB -0.1%
hits_018.vortex 1.0 vortex-file-compressed 199.02 MB 198.89 MB 137.22 KB -0.1%
hits_036.vortex 1.0 vortex-file-compressed 170.66 MB 170.54 MB 127.20 KB -0.1%
hits_048.vortex 1.0 vortex-file-compressed 198.85 MB 198.68 MB 172.70 KB -0.1%
hits_074.vortex 1.0 vortex-file-compressed 198.49 MB 198.32 MB 175.33 KB -0.1%
hits_099.vortex 1.0 vortex-file-compressed 170.58 MB 170.43 MB 152.31 KB -0.1%
hits_001.vortex 1.0 vortex-file-compressed 188.12 MB 187.95 MB 181.91 KB -0.1%
hits_044.vortex 1.0 vortex-file-compressed 199.59 MB 199.39 MB 200.51 KB -0.1%
hits_046.vortex 1.0 vortex-file-compressed 100.54 MB 100.44 MB 101.89 KB -0.1%
hits_016.vortex 1.0 vortex-file-compressed 179.70 MB 179.51 MB 194.06 KB -0.1%
hits_035.vortex 1.0 vortex-file-compressed 102.23 MB 102.11 MB 119.00 KB -0.1%
hits_032.vortex 1.0 vortex-file-compressed 153.87 MB 153.69 MB 181.34 KB -0.1%
hits_095.vortex 1.0 vortex-file-compressed 153.58 MB 153.36 MB 220.95 KB -0.1%
hits_072.vortex 1.0 vortex-file-compressed 101.92 MB 101.74 MB 177.51 KB -0.2%
hits_028.vortex 1.0 vortex-file-compressed 151.15 MB 150.85 MB 307.17 KB -0.2%
hits_022.vortex 1.0 vortex-file-compressed 198.77 MB 198.32 MB 460.93 KB -0.2%
hits_081.vortex 1.0 vortex-file-compressed 199.86 MB 199.39 MB 480.49 KB -0.2%
hits_017.vortex 1.0 vortex-file-compressed 146.20 MB 145.84 MB 370.48 KB -0.2%
hits_093.vortex 1.0 vortex-file-compressed 131.16 MB 130.81 MB 350.93 KB -0.3%
hits_066.vortex 1.0 vortex-file-compressed 162.97 MB 162.43 MB 557.26 KB -0.3%
hits_050.vortex 1.0 vortex-file-compressed 160.58 MB 160.03 MB 561.66 KB -0.3%
hits_077.vortex 1.0 vortex-file-compressed 172.18 MB 171.58 MB 612.42 KB -0.3%
hits_013.vortex 1.0 vortex-file-compressed 160.84 MB 160.23 MB 626.53 KB -0.4%
hits_052.vortex 1.0 vortex-file-compressed 130.41 MB 129.86 MB 558.99 KB -0.4%
hits_045.vortex 1.0 vortex-file-compressed 139.42 MB 138.78 MB 662.62 KB -0.5%
hits_062.vortex 1.0 vortex-file-compressed 170.75 MB 169.92 MB 851.51 KB -0.5%
hits_039.vortex 1.0 vortex-file-compressed 160.04 MB 159.24 MB 825.28 KB -0.5%
hits_033.vortex 1.0 vortex-file-compressed 199.27 MB 198.24 MB 1.04 MB -0.5%
hits_031.vortex 1.0 vortex-file-compressed 159.63 MB 158.63 MB 1.00 MB -0.6%
hits_061.vortex 1.0 vortex-file-compressed 159.87 MB 158.34 MB 1.53 MB -1.0%
hits_038.vortex 1.0 vortex-file-compressed 190.97 MB 189.12 MB 1.85 MB -1.0%
hits_075.vortex 1.0 vortex-file-compressed 190.90 MB 188.33 MB 2.57 MB -1.3%

Totals:

  • vortex-file-compressed: 15.88 GB → 15.87 GB (-0.0%)

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-DS SF=1 on NVME 📖

Commits: PR 4182f555 vs base 42a5d3b5
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.0%
Engines: DataFusion No clear signal (-0.3%, low confidence) · DuckDB No clear signal (+0.3%, environment too noisy confidence)
Vortex (geomean): hot 1.000x ➖ · cold 0.998x ➖
Parquet (geomean): hot 1.000x ➖ · cold 1.005x ➖
Shifts: Parquet (control) -0.0% · Median polish -0.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.995x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:vortex-file-compressed 28802188 / 29995955 / -4.0% 85071346 / 85963842 / -1.0% 0.34 / 0.35 / -3.0%
tpcds_q02/datafusion:vortex-file-compressed 51884438 / 52766390 / -1.7% 107046168 / 108333814 / -1.2% 0.48 / 0.49 / -0.5%
tpcds_q03/datafusion:vortex-file-compressed 15403346 / 15292292 / +0.7% 60058687 / 58609550 / +2.5% 0.26 / 0.26 / -1.7%
tpcds_q04/datafusion:vortex-file-compressed 194405132 / 193988038 / +0.2% 268283619 / 270416841 / -0.8% 0.72 / 0.72 / +1.0%
tpcds_q05/datafusion:vortex-file-compressed 63251958 / 61931932 / +2.1% 127631165 / 127320364 / +0.2% 0.50 / 0.49 / +1.9%
tpcds_q06/datafusion:vortex-file-compressed 26998249 / 27513586 / -1.9% 80037099 / 79362860 / +0.8% 0.34 / 0.35 / -2.7%
tpcds_q07/datafusion:vortex-file-compressed 41944980 / 41540568 / +1.0% 106875562 / 110399021 / -3.2% 0.39 / 0.38 / +4.3%
tpcds_q08/datafusion:vortex-file-compressed 31113070 / 31005794 / +0.3% 86616907 / 83869016 / +3.3% 0.36 / 0.37 / -2.8%
tpcds_q09/datafusion:vortex-file-compressed 25304244 / 25506268 / -0.8% 72461668 / 70046432 / +3.4% 0.35 / 0.36 / -4.1%
tpcds_q10/datafusion:vortex-file-compressed 38712486 / 37650458 / +2.8% 92210613 / 88134843 / +4.6% 0.42 / 0.43 / -1.7%
tpcds_q11/datafusion:vortex-file-compressed 105650076 / 107355173 / -1.6% 175272872 / 177790111 / -1.4% 0.60 / 0.60 / -0.2%
tpcds_q12/datafusion:vortex-file-compressed 19631094 / 20051862 / -2.1% 64159307 / 64456170 / -0.5% 0.31 / 0.31 / -1.6%
tpcds_q13/datafusion:vortex-file-compressed 42096345 / 41326600 / +1.9% 97899622 / 94848300 / +3.2% 0.43 / 0.44 / -1.3%
tpcds_q14/datafusion:vortex-file-compressed 141248823 / 142742204 / -1.0% 202988378 / 207006105 / -1.9% 0.70 / 0.69 / +0.9%
tpcds_q15/datafusion:vortex-file-compressed 29508166 / 28642374 / +3.0% 84531454 / 81709804 / +3.5% 0.35 / 0.35 / -0.4%
tpcds_q16/datafusion:vortex-file-compressed 25340182 / 26530792 / -4.5% 76662627 / 73935975 / +3.7% 0.33 / 0.36 / -7.9%
tpcds_q17/datafusion:vortex-file-compressed 67022448 / 68032193 / -1.5% 142719418 / 135018762 / +5.7% 0.47 / 0.50 / -6.8%
tpcds_q18/datafusion:vortex-file-compressed 82956357 / 85058314 / -2.5% 149949637 / 150195814 / -0.2% 0.55 / 0.57 / -2.3%
tpcds_q19/datafusion:vortex-file-compressed 25021375 / 25148822 / -0.5% 78703456 / 77317367 / +1.8% 0.32 / 0.33 / -2.3%
tpcds_q20/datafusion:vortex-file-compressed 23696376 / 24742500 / -4.2% 72316131 / 72376424 / -0.1% 0.33 / 0.34 / -4.1%
tpcds_q21/datafusion:vortex-file-compressed 28572106 / 29174280 / -2.1% 86813463 / 86332995 / +0.6% 0.33 / 0.34 / -2.6%
tpcds_q22/datafusion:vortex-file-compressed 123475727 / 130819328 / -5.6% 135397861 / 137313113 / -1.4% 0.91 / 0.95 / -4.3%
tpcds_q23/datafusion:vortex-file-compressed 128732470 / 126811320 / +1.5% 204081921 / 202957949 / +0.6% 0.63 / 0.62 / +1.0%
tpcds_q24/datafusion:vortex-file-compressed 83304694 / 83764726 / -0.5% 149381958 / 151910325 / -1.7% 0.56 / 0.55 / +1.1%
tpcds_q25/datafusion:vortex-file-compressed 65958078 / 66677898 / -1.1% 140364714 / 137295347 / +2.2% 0.47 / 0.49 / -3.2%
tpcds_q26/datafusion:vortex-file-compressed 37896641 / 38322138 / -1.1% 97296978 / 93787513 / +3.7% 0.39 / 0.41 / -4.7%
tpcds_q27/datafusion:vortex-file-compressed 91431650 / 95118622 / -3.9% 173835511 / 166406885 / +4.5% 0.53 / 0.57 / -8.0%
tpcds_q28/datafusion:vortex-file-compressed 23863788 / 24760872 / -3.6% 71217241 / 69690025 / +2.2% 0.34 / 0.36 / -5.7%
tpcds_q29/datafusion:vortex-file-compressed 65220886 / 68306886 / -4.5% 138682160 / 133835154 / +3.6% 0.47 / 0.51 / -7.9%
tpcds_q30/datafusion:vortex-file-compressed 34692296 / 34487365 / +0.6% 80839765 / 81830992 / -1.2% 0.43 / 0.42 / +1.8%
tpcds_q31/datafusion:vortex-file-compressed 74248812 / 74566124 / -0.4% 145068365 / 144481110 / +0.4% 0.51 / 0.52 / -0.8%
tpcds_q32/datafusion:vortex-file-compressed 18345550 / 18732370 / -2.1% 64658020 / 63354206 / +2.1% 0.28 / 0.30 / -4.0%
tpcds_q33/datafusion:vortex-file-compressed 33986274 / 33064775 / +2.8% 89575050 / 89915984 / -0.4% 0.38 / 0.37 / +3.2%
tpcds_q34/datafusion:vortex-file-compressed 25678750 / 25922702 / -0.9% 78378626 / 76805673 / +2.0% 0.33 / 0.34 / -2.9%
tpcds_q35/datafusion:vortex-file-compressed 48560061 / 48448200 / +0.2% 106183740 / 102985333 / +3.1% 0.46 / 0.47 / -2.8%
tpcds_q36/datafusion:vortex-file-compressed 59972518 / 58695114 / +2.2% 129505315 / 132553719 / -2.3% 0.46 / 0.44 / +4.6%
tpcds_q37/datafusion:vortex-file-compressed 18967147 / 17866792 / +6.2% 66696388 / 64911681 / +2.7% 0.28 / 0.28 / +3.3%
tpcds_q38/datafusion:vortex-file-compressed 39812356 / 41504054 / -4.1% 100105642 / 95273684 / +5.1% 0.40 / 0.44 / -8.7%
tpcds_q39/datafusion:vortex-file-compressed 94867480 / 105470500 / -10.1% 🟢 154322294 / 159960878 / -3.5% 0.61 / 0.66 / -6.8%
tpcds_q40/datafusion:vortex-file-compressed 31037464 / 30865368 / +0.6% 89826604 / 92827940 / -3.2% 0.35 / 0.33 / +3.9%
tpcds_q41/datafusion:vortex-file-compressed 18946013 / 18321003 / +3.4% 63067866 / 57616835 / +9.5% 0.30 / 0.32 / -5.5%
tpcds_q42/datafusion:vortex-file-compressed 13943962 / 13900168 / +0.3% 58868984 / 55537286 / +6.0% 0.24 / 0.25 / -5.4%
tpcds_q43/datafusion:vortex-file-compressed 18266048 / 17878732 / +2.2% 64814495 / 66499325 / -2.5% 0.28 / 0.27 / +4.8%
tpcds_q44/datafusion:vortex-file-compressed 33749513 / 33189910 / +1.7% 90304029 / 87948903 / +2.7% 0.37 / 0.38 / -1.0%
tpcds_q45/datafusion:vortex-file-compressed 32502612 / 32766714 / -0.8% 89704057 / 83513167 / +7.4% 0.36 / 0.39 / -7.7%
tpcds_q46/datafusion:vortex-file-compressed 33163248 / 33030318 / +0.4% 95851003 / 93904652 / +2.1% 0.35 / 0.35 / -1.6%
tpcds_q47/datafusion:vortex-file-compressed 120984886 / 119659344 / +1.1% 191748465 / 191252800 / +0.3% 0.63 / 0.63 / +0.8%
tpcds_q48/datafusion:vortex-file-compressed 33022228 / 33107343 / -0.3% 85241349 / 86945277 / -2.0% 0.39 / 0.38 / +1.7%
tpcds_q49/datafusion:vortex-file-compressed 65925525 / 62908194 / +4.8% 127211831 / 125357435 / +1.5% 0.52 / 0.50 / +3.3%
tpcds_q50/datafusion:vortex-file-compressed 43746352 / 41868090 / +4.5% 99776183 / 102472165 / -2.6% 0.44 / 0.41 / +7.3%
tpcds_q51/datafusion:vortex-file-compressed 72364102 / 71882800 / +0.7% 133796086 / 140423718 / -4.7% 0.54 / 0.51 / +5.7%
tpcds_q52/datafusion:vortex-file-compressed 14179547 / 14176743 / +0.0% 56916032 / 61443899 / -7.4% 0.25 / 0.23 / +8.0%
tpcds_q53/datafusion:vortex-file-compressed 23544334 / 23851215 / -1.3% 76766463 / 73846837 / +4.0% 0.31 / 0.32 / -5.0%
tpcds_q54/datafusion:vortex-file-compressed 36988855 / 37541528 / -1.5% 89669638 / 91339779 / -1.8% 0.41 / 0.41 / +0.4%
tpcds_q55/datafusion:vortex-file-compressed 14643442 / 14574785 / +0.5% 59656652 / 57051530 / +4.6% 0.25 / 0.26 / -3.9%
tpcds_q56/datafusion:vortex-file-compressed 33062098 / 32670444 / +1.2% 86867349 / 88951275 / -2.3% 0.38 / 0.37 / +3.6%
tpcds_q57/datafusion:vortex-file-compressed 94564378 / 97086634 / -2.6% 165669417 / 165286697 / +0.2% 0.57 / 0.59 / -2.8%
tpcds_q58/datafusion:vortex-file-compressed 54503262 / 56610298 / -3.7% 122493840 / 124583358 / -1.7% 0.44 / 0.45 / -2.1%
tpcds_q59/datafusion:vortex-file-compressed 52650332 / 53179082 / -1.0% 108804678 / 107475244 / +1.2% 0.48 / 0.49 / -2.2%
tpcds_q60/datafusion:vortex-file-compressed 33587581 / 31711224 / +5.9% 86891781 / 93744241 / -7.3% 0.39 / 0.34 / +14.3%
tpcds_q61/datafusion:vortex-file-compressed 37724539 / 38565843 / -2.2% 95992232 / 99784887 / -3.8% 0.39 / 0.39 / +1.7%
tpcds_q62/datafusion:vortex-file-compressed 23964846 / 23517262 / +1.9% 74742597 / 70013538 / +6.8% 0.32 / 0.34 / -4.5%
tpcds_q63/datafusion:vortex-file-compressed 23556464 / 24831500 / -5.1% 73364326 / 75676829 / -3.1% 0.32 / 0.33 / -2.1%
tpcds_q64/datafusion:vortex-file-compressed 369542829 / 378555798 / -2.4% 475668769 / 490469675 / -3.0% 0.78 / 0.77 / +0.7%
tpcds_q65/datafusion:vortex-file-compressed 67710325 / 66978728 / +1.1% 127289443 / 128709657 / -1.1% 0.53 / 0.52 / +2.2%
tpcds_q66/datafusion:vortex-file-compressed 71566814 / 70866735 / +1.0% 134674145 / 135870407 / -0.9% 0.53 / 0.52 / +1.9%
tpcds_q67/datafusion:vortex-file-compressed 113604503 / 117187161 / -3.1% 183170659 / 195382107 / -6.3% 0.62 / 0.60 / +3.4%
tpcds_q68/datafusion:vortex-file-compressed 31833645 / 31252567 / +1.9% 93973660 / 97081289 / -3.2% 0.34 / 0.32 / +5.2%
tpcds_q69/datafusion:vortex-file-compressed 40624954 / 38307450 / +6.0% 93281115 / 92939145 / +0.4% 0.44 / 0.41 / +5.7%
tpcds_q70/datafusion:vortex-file-compressed 110826964 / 109827821 / +0.9% 170312266 / 174682923 / -2.5% 0.65 / 0.63 / +3.5%
tpcds_q71/datafusion:vortex-file-compressed 24650162 / 24394016 / +1.1% 78061859 / 76314304 / +2.3% 0.32 / 0.32 / -1.2%
tpcds_q72/datafusion:vortex-file-compressed 1431347927 / 1454483057 / -1.6% 1522907226 / 1539775277 / -1.1% 0.94 / 0.94 / -0.5%
tpcds_q73/datafusion:vortex-file-compressed 24050948 / 23738881 / +1.3% 74211368 / 77536262 / -4.3% 0.32 / 0.31 / +5.9%
tpcds_q74/datafusion:vortex-file-compressed 69264842 / 69843942 / -0.8% 132847839 / 130369971 / +1.9% 0.52 / 0.54 / -2.7%
tpcds_q75/datafusion:vortex-file-compressed 130831738 / 132896348 / -1.6% 219345297 / 215265970 / +1.9% 0.60 / 0.62 / -3.4%
tpcds_q76/datafusion:vortex-file-compressed 38368428 / 39763862 / -3.5% 95512310 / 98747652 / -3.3% 0.40 / 0.40 / -0.2%
tpcds_q77/datafusion:vortex-file-compressed 42364216 / 42473538 / -0.3% 102105355 / 102105286 / +0.0% 0.41 / 0.42 / -0.3%
tpcds_q78/datafusion:vortex-file-compressed 104074735 / 107464712 / -3.2% 181136407 / 180430353 / +0.4% 0.57 / 0.60 / -3.5%
tpcds_q79/datafusion:vortex-file-compressed 27221884 / 28707815 / -5.2% 82405499 / 83220821 / -1.0% 0.33 / 0.34 / -4.2%
tpcds_q80/datafusion:vortex-file-compressed 96322922 / 97166987 / -0.9% 193368240 / 190607087 / +1.4% 0.50 / 0.51 / -2.3%
tpcds_q81/datafusion:vortex-file-compressed 35916516 / 36973786 / -2.9% 79864179 / 80135508 / -0.3% 0.45 / 0.46 / -2.5%
tpcds_q82/datafusion:vortex-file-compressed 19351582 / 18626018 / +3.9% 70813552 / 65753259 / +7.7% 0.27 / 0.28 / -3.5%
tpcds_q83/datafusion:vortex-file-compressed 45365815 / 45993312 / -1.4% 98492438 / 99333055 / -0.8% 0.46 / 0.46 / -0.5%
tpcds_q84/datafusion:vortex-file-compressed 15342497 / 15873837 / -3.3% 56093525 / 54361880 / +3.2% 0.27 / 0.29 / -6.3%
tpcds_q85/datafusion:vortex-file-compressed 64851444 / 64025052 / +1.3% 135034970 / 132067708 / +2.2% 0.48 / 0.48 / -0.9%
tpcds_q86/datafusion:vortex-file-compressed 20695174 / 19866432 / +4.2% 63866357 / 65906801 / -3.1% 0.32 / 0.30 / +7.5%
tpcds_q87/datafusion:vortex-file-compressed 39862278 / 40086656 / -0.6% 94818723 / 96390820 / -1.6% 0.42 / 0.42 / +1.1%
tpcds_q88/datafusion:vortex-file-compressed 50149526 / 50557322 / -0.8% 107596011 / 112103869 / -4.0% 0.47 / 0.45 / +3.3%
tpcds_q89/datafusion:vortex-file-compressed 25401632 / 25972710 / -2.2% 80244739 / 79420604 / +1.0% 0.32 / 0.33 / -3.2%
tpcds_q90/datafusion:vortex-file-compressed 13812824 / 14524134 / -4.9% 54823704 / 57938132 / -5.4% 0.25 / 0.25 / +0.5%
tpcds_q91/datafusion:vortex-file-compressed 22611970 / 21960662 / +3.0% 72995777 / 67109479 / +8.8% 0.31 / 0.33 / -5.3%
tpcds_q92/datafusion:vortex-file-compressed 17703371 / 18273196 / -3.1% 59046134 / 62175286 / -5.0% 0.30 / 0.29 / +2.0%
tpcds_q93/datafusion:vortex-file-compressed 29121524 / 30375522 / -4.1% 85703378 / 83660641 / +2.4% 0.34 / 0.36 / -6.4%
tpcds_q94/datafusion:vortex-file-compressed 23676616 / 23372402 / +1.3% 68877907 / 71254741 / -3.3% 0.34 / 0.33 / +4.8%
tpcds_q95/datafusion:vortex-file-compressed 52835852 / 52724526 / +0.2% 114428224 / 114445144 / -0.0% 0.46 / 0.46 / +0.2%
tpcds_q96/datafusion:vortex-file-compressed 11807132 / 11443720 / +3.2% 55036453 / 54770184 / +0.5% 0.21 / 0.21 / +2.7%
tpcds_q97/datafusion:vortex-file-compressed 27568706 / 27870865 / -1.1% 87213517 / 86839793 / +0.4% 0.32 / 0.32 / -1.5%
tpcds_q98/datafusion:vortex-file-compressed 22000704 / 22401986 / -1.8% 73982046 / 73059365 / +1.3% 0.30 / 0.31 / -3.0%
tpcds_q99/datafusion:vortex-file-compressed 28195848 / 28291429 / -0.3% 79130136 / 78194958 / +1.2% 0.36 / 0.36 / -1.5%
datafusion / parquet / ns (0.998x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:parquet 33864336 / 36836906 / -8.1% 79461466 / 79687714 / -0.3% 0.43 / 0.46 / -7.8%
tpcds_q02/datafusion:parquet 51200221 / 52257252 / -2.0% 101767799 / 101415378 / +0.3% 0.50 / 0.52 / -2.4%
tpcds_q03/datafusion:parquet 22692200 / 21839002 / +3.9% 62472618 / 62029312 / +0.7% 0.36 / 0.35 / +3.2%
tpcds_q04/datafusion:parquet 280778485 / 281612692 / -0.3% 345442811 / 360103867 / -4.1% 0.81 / 0.78 / +3.9%
tpcds_q05/datafusion:parquet 72756164 / 74598444 / -2.5% 135916118 / 138268425 / -1.7% 0.54 / 0.54 / -0.8%
tpcds_q06/datafusion:parquet 38007472 / 38537904 / -1.4% 84571102 / 84032770 / +0.6% 0.45 / 0.46 / -2.0%
tpcds_q07/datafusion:parquet 57891945 / 57127346 / +1.3% 118299456 / 122844616 / -3.7% 0.49 / 0.47 / +5.2%
tpcds_q08/datafusion:parquet 43757627 / 43205094 / +1.3% 94970766 / 94364165 / +0.6% 0.46 / 0.46 / +0.6%
tpcds_q09/datafusion:parquet 33861648 / 32029004 / +5.7% 85098870 / 84441260 / +0.8% 0.40 / 0.38 / +4.9%
tpcds_q10/datafusion:parquet 51821410 / 54815925 / -5.5% 96745332 / 97234366 / -0.5% 0.54 / 0.56 / -5.0%
tpcds_q11/datafusion:parquet 139223402 / 140412729 / -0.8% 203826435 / 202872393 / +0.5% 0.68 / 0.69 / -1.3%
tpcds_q12/datafusion:parquet 30308594 / 29846492 / +1.5% 67769184 / 71737276 / -5.5% 0.45 / 0.42 / +7.5%
tpcds_q13/datafusion:parquet 59036386 / 59486279 / -0.8% 114573760 / 112854686 / +1.5% 0.52 / 0.53 / -2.2%
tpcds_q14/datafusion:parquet 176119318 / 173819724 / +1.3% 235005382 / 230562617 / +1.9% 0.75 / 0.75 / -0.6%
tpcds_q15/datafusion:parquet 31517859 / 30826106 / +2.2% 82868597 / 77004336 / +7.6% 0.38 / 0.40 / -5.0%
tpcds_q16/datafusion:parquet 37582522 / 37130070 / +1.2% 82733361 / 81716525 / +1.2% 0.45 / 0.45 / -0.0%
tpcds_q17/datafusion:parquet 80994055 / 77367823 / +4.7% 158727873 / 152725160 / +3.9% 0.51 / 0.51 / +0.7%
tpcds_q18/datafusion:parquet 64413882 / 66805398 / -3.6% 126888733 / 125523591 / +1.1% 0.51 / 0.53 / -4.6%
tpcds_q19/datafusion:parquet 39479078 / 40291528 / -2.0% 89491476 / 82376444 / +8.6% 0.44 / 0.49 / -9.8%
tpcds_q20/datafusion:parquet 35185246 / 34859194 / +0.9% 74816559 / 74050789 / +1.0% 0.47 / 0.47 / -0.1%
tpcds_q21/datafusion:parquet 24616690 / 25245229 / -2.5% 68000252 / 66602447 / +2.1% 0.36 / 0.38 / -4.5%
tpcds_q22/datafusion:parquet 128157827 / 116978846 / +9.6% 146763371 / 181161380 / -19.0% 🟢 0.87 / 0.65 / +35.2%
tpcds_q23/datafusion:parquet 158262544 / 163076307 / -3.0% 232294060 / 239035683 / -2.8% 0.68 / 0.68 / -0.1%
tpcds_q24/datafusion:parquet 104770041 / 102545299 / +2.2% 173161741 / 173721397 / -0.3% 0.61 / 0.59 / +2.5%
tpcds_q25/datafusion:parquet 83366644 / 81823084 / +1.9% 163332842 / 159302630 / +2.5% 0.51 / 0.51 / -0.6%
tpcds_q26/datafusion:parquet 47418601 / 47270286 / +0.3% 98164254 / 104225113 / -5.8% 0.48 / 0.45 / +6.5%
tpcds_q27/datafusion:parquet 109113370 / 111520028 / -2.2% 201803827 / 196499459 / +2.7% 0.54 / 0.57 / -4.7%
tpcds_q28/datafusion:parquet 36434428 / 35853254 / +1.6% 89482933 / 89778416 / -0.3% 0.41 / 0.40 / +2.0%
tpcds_q29/datafusion:parquet 82188498 / 81423654 / +0.9% 157479047 / 158917981 / -0.9% 0.52 / 0.51 / +1.9%
tpcds_q30/datafusion:parquet 55827512 / 55680646 / +0.3% 100791276 / 100915877 / -0.1% 0.55 / 0.55 / +0.4%
tpcds_q31/datafusion:parquet 92762794 / 93573073 / -0.9% 149785950 / 145246768 / +3.1% 0.62 / 0.64 / -3.9%
tpcds_q32/datafusion:parquet 28042430 / 27553278 / +1.8% 72836932 / 68783957 / +5.9% 0.39 / 0.40 / -3.9%
tpcds_q33/datafusion:parquet 44766297 / 44676278 / +0.2% 96550422 / 97258830 / -0.7% 0.46 / 0.46 / +0.9%
tpcds_q34/datafusion:parquet 31011286 / 30937100 / +0.2% 72253996 / 72637504 / -0.5% 0.43 / 0.43 / +0.8%
tpcds_q35/datafusion:parquet 70860164 / 72265010 / -1.9% 118804131 / 119907736 / -0.9% 0.60 / 0.60 / -1.0%
tpcds_q36/datafusion:parquet 66771826 / 66612081 / +0.2% 136176286 / 140096315 / -2.8% 0.49 / 0.48 / +3.1%
tpcds_q37/datafusion:parquet 26194554 / 25642571 / +2.2% 71755656 / 77894256 / -7.9% 0.37 / 0.33 / +10.9%
tpcds_q38/datafusion:parquet 49344660 / 49918116 / -1.1% 103560414 / 106317068 / -2.6% 0.48 / 0.47 / +1.5%
tpcds_q39/datafusion:parquet 85316271 / 84948049 / +0.4% 156037624 / 143476461 / +8.8% 0.55 / 0.59 / -7.7%
tpcds_q40/datafusion:parquet 33851640 / 33906047 / -0.2% 88072910 / 90273897 / -2.4% 0.38 / 0.38 / +2.3%
tpcds_q41/datafusion:parquet 22033090 / 22431967 / -1.8% 64351239 / 63238803 / +1.8% 0.34 / 0.35 / -3.5%
tpcds_q42/datafusion:parquet 20530641 / 20952766 / -2.0% 61943803 / 61155349 / +1.3% 0.33 / 0.34 / -3.3%
tpcds_q43/datafusion:parquet 25731211 / 25235781 / +2.0% 68452948 / 63081302 / +8.5% 0.38 / 0.40 / -6.0%
tpcds_q44/datafusion:parquet 39816314 / 40846834 / -2.5% 97016928 / 98267125 / -1.3% 0.41 / 0.42 / -1.3%
tpcds_q45/datafusion:parquet 38199830 / 39876400 / -4.2% 93859668 / 86572059 / +8.4% 0.41 / 0.46 / -11.6%
tpcds_q46/datafusion:parquet 38677859 / 40182516 / -3.7% 97519692 / 96950137 / +0.6% 0.40 / 0.41 / -4.3%
tpcds_q47/datafusion:parquet 141277242 / 141029034 / +0.2% 214147857 / 216110165 / -0.9% 0.66 / 0.65 / +1.1%
tpcds_q48/datafusion:parquet 51098652 / 53398525 / -4.3% 104614015 / 100074910 / +4.5% 0.49 / 0.53 / -8.5%
tpcds_q49/datafusion:parquet 78263598 / 79337488 / -1.4% 149943876 / 147455328 / +1.7% 0.52 / 0.54 / -3.0%
tpcds_q50/datafusion:parquet 57373157 / 57811070 / -0.8% 114499707 / 110805132 / +3.3% 0.50 / 0.52 / -4.0%
tpcds_q51/datafusion:parquet 82458078 / 82646949 / -0.2% 140699592 / 135937558 / +3.5% 0.59 / 0.61 / -3.6%
tpcds_q52/datafusion:parquet 21656026 / 19558822 / +10.7% 🔴 61832614 / 63325883 / -2.4% 0.35 / 0.31 / +13.4%
tpcds_q53/datafusion:parquet 26040062 / 25744825 / +1.1% 76525515 / 75256625 / +1.7% 0.34 / 0.34 / -0.5%
tpcds_q54/datafusion:parquet 53104964 / 54466438 / -2.5% 103240690 / 106264450 / -2.8% 0.51 / 0.51 / +0.4%
tpcds_q55/datafusion:parquet 20624706 / 20326632 / +1.5% 62615920 / 62463237 / +0.2% 0.33 / 0.33 / +1.2%
tpcds_q56/datafusion:parquet 45932690 / 44260634 / +3.8% 101103281 / 94660842 / +6.8% 0.45 / 0.47 / -2.8%
tpcds_q57/datafusion:parquet 125074144 / 120087364 / +4.2% 192254847 / 192842782 / -0.3% 0.65 / 0.62 / +4.5%
tpcds_q58/datafusion:parquet 73298568 / 77058032 / -4.9% 135111374 / 132830583 / +1.7% 0.54 / 0.58 / -6.5%
tpcds_q59/datafusion:parquet 69879991 / 70290468 / -0.6% 121565337 / 123219772 / -1.3% 0.57 / 0.57 / +0.8%
tpcds_q60/datafusion:parquet 43620408 / 44908306 / -2.9% 99130839 / 99213645 / -0.1% 0.44 / 0.45 / -2.8%
tpcds_q61/datafusion:parquet 51673275 / 52143220 / -0.9% 110889876 / 111393919 / -0.5% 0.47 / 0.47 / -0.5%
tpcds_q62/datafusion:parquet 32185474 / 29970402 / +7.4% 83420347 / 76696763 / +8.8% 0.39 / 0.39 / -1.3%
tpcds_q63/datafusion:parquet 27778898 / 26220276 / +5.9% 74803179 / 77797304 / -3.8% 0.37 / 0.34 / +10.2%
tpcds_q64/datafusion:parquet 273977857 / 272644376 / +0.5% 359326807 / 364607858 / -1.4% 0.76 / 0.75 / +2.0%
tpcds_q65/datafusion:parquet 42305199 / 44470413 / -4.9% 94104010 / 96537619 / -2.5% 0.45 / 0.46 / -2.4%
tpcds_q66/datafusion:parquet 78767572 / 78270616 / +0.6% 128430859 / 136750288 / -6.1% 0.61 / 0.57 / +7.2%
tpcds_q67/datafusion:parquet 129824037 / 139582728 / -7.0% 195280056 / 209766729 / -6.9% 0.66 / 0.67 / -0.1%
tpcds_q68/datafusion:parquet 38094040 / 39505404 / -3.6% 92866770 / 94141780 / -1.4% 0.41 / 0.42 / -2.2%
tpcds_q69/datafusion:parquet 58052278 / 57317034 / +1.3% 101311420 / 103351001 / -2.0% 0.57 / 0.55 / +3.3%
tpcds_q70/datafusion:parquet 47298356 / 46938118 / +0.8% 95523234 / 95114700 / +0.4% 0.50 / 0.49 / +0.3%
tpcds_q71/datafusion:parquet 32225565 / 34073942 / -5.4% 79392318 / 77913799 / +1.9% 0.41 / 0.44 / -7.2%
tpcds_q72/datafusion:parquet 405871418 / 394716834 / +2.8% 501825681 / 506382051 / -0.9% 0.81 / 0.78 / +3.8%
tpcds_q73/datafusion:parquet 30677470 / 31404833 / -2.3% 71280536 / 69390783 / +2.7% 0.43 / 0.45 / -4.9%
tpcds_q74/datafusion:parquet 90331549 / 92386067 / -2.2% 151033503 / 146673017 / +3.0% 0.60 / 0.63 / -5.0%
tpcds_q75/datafusion:parquet 144688232 / 147190002 / -1.7% 235480041 / 235960895 / -0.2% 0.61 / 0.62 / -1.5%
tpcds_q76/datafusion:parquet 46765652 / 47836832 / -2.2% 111515313 / 109756121 / +1.6% 0.42 / 0.44 / -3.8%
tpcds_q77/datafusion:parquet 56636075 / 57883907 / -2.2% 114985709 / 115639251 / -0.6% 0.49 / 0.50 / -1.6%
tpcds_q78/datafusion:parquet 116810888 / 119550843 / -2.3% 212524162 / 207830408 / +2.3% 0.55 / 0.58 / -4.4%
tpcds_q79/datafusion:parquet 34762664 / 34830686 / -0.2% 85118249 / 87916047 / -3.2% 0.41 / 0.40 / +3.1%
tpcds_q80/datafusion:parquet 97383682 / 98199870 / -0.8% 196120870 / 190083032 / +3.2% 0.50 / 0.52 / -3.9%
tpcds_q81/datafusion:parquet 51040136 / 50580743 / +0.9% 97985732 / 95958014 / +2.1% 0.52 / 0.53 / -1.2%
tpcds_q82/datafusion:parquet 28439410 / 27305868 / +4.2% 74256144 / 71711325 / +3.5% 0.38 / 0.38 / +0.6%
tpcds_q83/datafusion:parquet 62348658 / 61644048 / +1.1% 110030368 / 110862366 / -0.8% 0.57 / 0.56 / +1.9%
tpcds_q84/datafusion:parquet 33347044 / 33164408 / +0.6% 73302340 / 71833520 / +2.0% 0.45 / 0.46 / -1.5%
tpcds_q85/datafusion:parquet 90177112 / 90265813 / -0.1% 162228805 / 160532357 / +1.1% 0.56 / 0.56 / -1.1%
tpcds_q86/datafusion:parquet 23814635 / 24222304 / -1.7% 63642228 / 64038635 / -0.6% 0.37 / 0.38 / -1.1%
tpcds_q87/datafusion:parquet 52513398 / 52761742 / -0.5% 105152792 / 100076461 / +5.1% 0.50 / 0.53 / -5.3%
tpcds_q88/datafusion:parquet 58109700 / 56693704 / +2.5% 117042288 / 114939442 / +1.8% 0.50 / 0.49 / +0.7%
tpcds_q89/datafusion:parquet 30385676 / 30345564 / +0.1% 82664518 / 84268574 / -1.9% 0.37 / 0.36 / +2.1%
tpcds_q90/datafusion:parquet 20453876 / 21367340 / -4.3% 60693116 / 59252144 / +2.4% 0.34 / 0.36 / -6.5%
tpcds_q91/datafusion:parquet 43711914 / 45424760 / -3.8% 86956732 / 86928920 / +0.0% 0.50 / 0.52 / -3.8%
tpcds_q92/datafusion:parquet 25713158 / 25632467 / +0.3% 71657335 / 69669662 / +2.9% 0.36 / 0.37 / -2.5%
tpcds_q93/datafusion:parquet 34837049 / 35459616 / -1.8% 97641098 / 94552079 / +3.3% 0.36 / 0.38 / -4.9%
tpcds_q94/datafusion:parquet 34921922 / 35262462 / -1.0% 74996007 / 74553203 / +0.6% 0.47 / 0.47 / -1.6%
tpcds_q95/datafusion:parquet 62308969 / 60959431 / +2.2% 110946312 / 115116466 / -3.6% 0.56 / 0.53 / +6.1%
tpcds_q96/datafusion:parquet 18505508 / 18990876 / -2.6% 55496755 / 56145621 / -1.2% 0.33 / 0.34 / -1.4%
tpcds_q97/datafusion:parquet 40126154 / 40340711 / -0.5% 96378705 / 89814326 / +7.3% 0.42 / 0.45 / -7.3%
tpcds_q98/datafusion:parquet 32152912 / 31814514 / +1.1% 82559146 / 80381186 / +2.7% 0.39 / 0.40 / -1.6%
tpcds_q99/datafusion:parquet 35247186 / 33870516 / +4.1% 85845262 / 76441572 / +12.3% 🔴 0.41 / 0.44 / -7.3%
duckdb / vortex-file-compressed / ns (1.005x ➖, 0↑ 3↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:vortex-file-compressed 25720958 / 25818850 / -0.4% 45754726 / 42828770 / +6.8% 0.56 / 0.60 / -6.7%
tpcds_q02/duckdb:vortex-file-compressed 28416445 / 28848325 / -1.5% 45722343 / 51074301 / -10.5% 🟢 0.62 / 0.56 / +10.0%
tpcds_q03/duckdb:vortex-file-compressed 19529594 / 18319752 / +6.6% 43972559 / 43202881 / +1.8% 0.44 / 0.42 / +4.7%
tpcds_q04/duckdb:vortex-file-compressed 92446420 / 90431066 / +2.2% 122130876 / 123790958 / -1.3% 0.76 / 0.73 / +3.6%
tpcds_q05/duckdb:vortex-file-compressed 32930000 / 33853931 / -2.7% 58931755 / 60485289 / -2.6% 0.56 / 0.56 / -0.2%
tpcds_q06/duckdb:vortex-file-compressed 46075138 / 45747652 / +0.7% 69612244 / 68400443 / +1.8% 0.66 / 0.67 / -1.0%
tpcds_q07/duckdb:vortex-file-compressed 31347058 / 30696920 / +2.1% 55445323 / 61029950 / -9.2% 0.57 / 0.50 / +12.4%
tpcds_q08/duckdb:vortex-file-compressed 36838404 / 36323771 / +1.4% 61546306 / 56870326 / +8.2% 0.60 / 0.64 / -6.3%
tpcds_q09/duckdb:vortex-file-compressed 16960116 / 16789451 / +1.0% 53649558 / 61761059 / -13.1% 🟢 0.32 / 0.27 / +16.3%
tpcds_q10/duckdb:vortex-file-compressed 51878944 / 53536899 / -3.1% 84126667 / 78330885 / +7.4% 0.62 / 0.68 / -9.8%
tpcds_q11/duckdb:vortex-file-compressed 74931174 / 73187426 / +2.4% 103861612 / 105015373 / -1.1% 0.72 / 0.70 / +3.5%
tpcds_q12/duckdb:vortex-file-compressed 17526220 / 16721380 / +4.8% 33059493 / 36447342 / -9.3% 0.53 / 0.46 / +15.6%
tpcds_q13/duckdb:vortex-file-compressed 38272774 / 38308234 / -0.1% 67513408 / 75860981 / -11.0% 🟢 0.57 / 0.50 / +12.3%
tpcds_q14/duckdb:vortex-file-compressed 105124810 / 106587722 / -1.4% 154472581 / 143192005 / +7.9% 0.68 / 0.74 / -8.6%
tpcds_q15/duckdb:vortex-file-compressed 33972621 / 35403922 / -4.0% 48579695 / 49274895 / -1.4% 0.70 / 0.72 / -2.7%
tpcds_q16/duckdb:vortex-file-compressed 33979026 / 33252122 / +2.2% 54114994 / 53519231 / +1.1% 0.63 / 0.62 / +1.1%
tpcds_q17/duckdb:vortex-file-compressed 53020771 / 50983432 / +4.0% 86271339 / 84708301 / +1.8% 0.61 / 0.60 / +2.1%
tpcds_q18/duckdb:vortex-file-compressed 48035502 / 46543630 / +3.2% 73170368 / 68825841 / +6.3% 0.66 / 0.68 / -2.9%
tpcds_q19/duckdb:vortex-file-compressed 39007685 / 41296947 / -5.5% 70083414 / 64770318 / +8.2% 0.56 / 0.64 / -12.7%
tpcds_q20/duckdb:vortex-file-compressed 17926432 / 17203031 / +4.2% 35678993 / 33653143 / +6.0% 0.50 / 0.51 / -1.7%
tpcds_q21/duckdb:vortex-file-compressed 22314505 / 21092592 / +5.8% 57551390 / 53840403 / +6.9% 0.39 / 0.39 / -1.0%
tpcds_q22/duckdb:vortex-file-compressed 66131825 / 67397142 / -1.9% 95281848 / 104779055 / -9.1% 0.69 / 0.64 / +7.9%
tpcds_q23/duckdb:vortex-file-compressed 68645224 / 71515214 / -4.0% 112705390 / 108814362 / +3.6% 0.61 / 0.66 / -7.3%
tpcds_q24/duckdb:vortex-file-compressed 48772654 / 50745588 / -3.9% 82939026 / 87982746 / -5.7% 0.59 / 0.58 / +2.0%
tpcds_q25/duckdb:vortex-file-compressed 44931474 / 42853044 / +4.9% 78649754 / 76244547 / +3.2% 0.57 / 0.56 / +1.6%
tpcds_q26/duckdb:vortex-file-compressed 23999858 / 25205408 / -4.8% 42849383 / 40080749 / +6.9% 0.56 / 0.63 / -10.9%
tpcds_q27/duckdb:vortex-file-compressed 30702269 / 31885967 / -3.7% 64114682 / 61577113 / +4.1% 0.48 / 0.52 / -7.5%
tpcds_q28/duckdb:vortex-file-compressed 13647524 / 12139710 / +12.4% 🔴 27188852 / 25640222 / +6.0% 0.50 / 0.47 / +6.0%
tpcds_q29/duckdb:vortex-file-compressed 48134738 / 49552748 / -2.9% 87287399 / 85532775 / +2.1% 0.55 / 0.58 / -4.8%
tpcds_q30/duckdb:vortex-file-compressed 33392078 / 34666620 / -3.7% 55739078 / 54411415 / +2.4% 0.60 / 0.64 / -6.0%
tpcds_q31/duckdb:vortex-file-compressed 31944057 / 31936904 / +0.0% 61032662 / 64215625 / -5.0% 0.52 / 0.50 / +5.2%
tpcds_q32/duckdb:vortex-file-compressed 17401387 / 18698074 / -6.9% 36782163 / 39561861 / -7.0% 0.47 / 0.47 / +0.1%
tpcds_q33/duckdb:vortex-file-compressed 31684500 / 30939372 / +2.4% 63348789 / 57828431 / +9.5% 0.50 / 0.54 / -6.5%
tpcds_q34/duckdb:vortex-file-compressed 25894872 / 25874698 / +0.1% 44862039 / 46615243 / -3.8% 0.58 / 0.56 / +4.0%
tpcds_q35/duckdb:vortex-file-compressed 78477208 / 76950445 / +2.0% 106096526 / 112540094 / -5.7% 0.74 / 0.68 / +8.2%
tpcds_q36/duckdb:vortex-file-compressed 28396014 / 28609285 / -0.7% 60464544 / 59011331 / +2.5% 0.47 / 0.48 / -3.1%
tpcds_q37/duckdb:vortex-file-compressed 24422475 / 24981462 / -2.2% 56753363 / 47876958 / +18.5% 🔴 0.43 / 0.52 / -17.5%
tpcds_q38/duckdb:vortex-file-compressed 39086908 / 37879964 / +3.2% 60814458 / 61143530 / -0.5% 0.64 / 0.62 / +3.7%
tpcds_q39/duckdb:vortex-file-compressed 34956145 / 34383415 / +1.7% 60478323 / 55535964 / +8.9% 0.58 / 0.62 / -6.6%
tpcds_q40/duckdb:vortex-file-compressed 22754346 / 23083024 / -1.4% 40239341 / 39365271 / +2.2% 0.57 / 0.59 / -3.6%
tpcds_q41/duckdb:vortex-file-compressed 9309925 / 9780786 / -4.8% 19712530 / 20428035 / -3.5% 0.47 / 0.48 / -1.4%
tpcds_q42/duckdb:vortex-file-compressed 16315778 / 15003348 / +8.7% 40472750 / 42891220 / -5.6% 0.40 / 0.35 / +15.2%
tpcds_q43/duckdb:vortex-file-compressed 20083702 / 19557924 / +2.7% 40850473 / 40831096 / +0.0% 0.49 / 0.48 / +2.6%
tpcds_q44/duckdb:vortex-file-compressed 24824266 / 25087640 / -1.0% 60845996 / 71607625 / -15.0% 🟢 0.41 / 0.35 / +16.5%
tpcds_q45/duckdb:vortex-file-compressed 35451126 / 35267334 / +0.5% 49394918 / 54277101 / -9.0% 0.72 / 0.65 / +10.5%
tpcds_q46/duckdb:vortex-file-compressed 34243956 / 32158252 / +6.5% 60088516 / 62423734 / -3.7% 0.57 / 0.52 / +10.6%
tpcds_q47/duckdb:vortex-file-compressed 55588224 / 53263911 / +4.4% 83666591 / 80192917 / +4.3% 0.66 / 0.66 / +0.0%
tpcds_q48/duckdb:vortex-file-compressed 36299903 / 34971756 / +3.8% 67300328 / 72861000 / -7.6% 0.54 / 0.48 / +12.4%
tpcds_q49/duckdb:vortex-file-compressed 35054798 / 32929674 / +6.5% 76704730 / 73587336 / +4.2% 0.46 / 0.45 / +2.1%
tpcds_q50/duckdb:vortex-file-compressed 32580006 / 31039809 / +5.0% 60722831 / 61497258 / -1.3% 0.54 / 0.50 / +6.3%
tpcds_q51/duckdb:vortex-file-compressed 96782642 / 96712997 / +0.1% 120663641 / 158206638 / -23.7% 🟢 0.80 / 0.61 / +31.2%
tpcds_q52/duckdb:vortex-file-compressed 16376126 / 17869972 / -8.4% 39259608 / 39176100 / +0.2% 0.42 / 0.46 / -8.6%
tpcds_q53/duckdb:vortex-file-compressed 24641722 / 25003714 / -1.4% 54169897 / 51312437 / +5.6% 0.45 / 0.49 / -6.6%
tpcds_q54/duckdb:vortex-file-compressed 36726343 / 37156339 / -1.2% 60349173 / 67973245 / -11.2% 🟢 0.61 / 0.55 / +11.3%
tpcds_q55/duckdb:vortex-file-compressed 16965917 / 17359310 / -2.3% 44680725 / 41383693 / +8.0% 0.38 / 0.42 / -9.5%
tpcds_q56/duckdb:vortex-file-compressed 31368836 / 31121062 / +0.8% 62424462 / 66605034 / -6.3% 0.50 / 0.47 / +7.5%
tpcds_q57/duckdb:vortex-file-compressed 42819198 / 39919318 / +7.3% 64055335 / 59292166 / +8.0% 0.67 / 0.67 / -0.7%
tpcds_q58/duckdb:vortex-file-compressed 33970097 / 33542250 / +1.3% 57566554 / 59705016 / -3.6% 0.59 / 0.56 / +5.0%
tpcds_q59/duckdb:vortex-file-compressed 38837446 / 39501443 / -1.7% 51074576 / 57759610 / -11.6% 🟢 0.76 / 0.68 / +11.2%
tpcds_q60/duckdb:vortex-file-compressed 32017164 / 31961988 / +0.2% 58936014 / 65423146 / -9.9% 0.54 / 0.49 / +11.2%
tpcds_q61/duckdb:vortex-file-compressed 36523527 / 36588884 / -0.2% 83274413 / 78114638 / +6.6% 0.44 / 0.47 / -6.4%
tpcds_q62/duckdb:vortex-file-compressed 18440018 / 18442362 / -0.0% 38710132 / 36778108 / +5.3% 0.48 / 0.50 / -5.0%
tpcds_q63/duckdb:vortex-file-compressed 23918102 / 23367342 / +2.4% 49334558 / 52472582 / -6.0% 0.48 / 0.45 / +8.9%
tpcds_q64/duckdb:vortex-file-compressed 110471676 / 111284278 / -0.7% 150349146 / 153449438 / -2.0% 0.73 / 0.73 / +1.3%
tpcds_q65/duckdb:vortex-file-compressed 26187098 / 25572898 / +2.4% 47832922 / 50952425 / -6.1% 0.55 / 0.50 / +9.1%
tpcds_q66/duckdb:vortex-file-compressed 38194238 / 39857636 / -4.2% 67436072 / 66758074 / +1.0% 0.57 / 0.60 / -5.1%
tpcds_q67/duckdb:vortex-file-compressed 130435480 / 125823242 / +3.7% 152510336 / 161765001 / -5.7% 0.86 / 0.78 / +10.0%
tpcds_q68/duckdb:vortex-file-compressed 30764420 / 32065112 / -4.1% 61861042 / 61101813 / +1.2% 0.50 / 0.52 / -5.2%
tpcds_q69/duckdb:vortex-file-compressed 55199184 / 54368382 / +1.5% 82741399 / 88894624 / -6.9% 0.67 / 0.61 / +9.1%
tpcds_q70/duckdb:vortex-file-compressed 34118726 / 37162057 / -8.2% 65636646 / 65011038 / +1.0% 0.52 / 0.57 / -9.1%
tpcds_q71/duckdb:vortex-file-compressed 23466133 / 25962671 / -9.6% 50368882 / 55024527 / -8.5% 0.47 / 0.47 / -1.3%
tpcds_q72/duckdb:vortex-file-compressed 146949618 / 146006556 / +0.6% 190279763 / 196140775 / -3.0% 0.77 / 0.74 / +3.7%
tpcds_q73/duckdb:vortex-file-compressed 25604209 / 24517287 / +4.4% 49309460 / 44796972 / +10.1% 🔴 0.52 / 0.55 / -5.1%
tpcds_q74/duckdb:vortex-file-compressed 49355256 / 50194738 / -1.7% 73146547 / 79149606 / -7.6% 0.67 / 0.63 / +6.4%
tpcds_q75/duckdb:vortex-file-compressed 53103448 / 52213482 / +1.7% 90677127 / 87168099 / +4.0% 0.59 / 0.60 / -2.2%
tpcds_q76/duckdb:vortex-file-compressed 23826741 / 24103938 / -1.2% 60655488 / 58308939 / +4.0% 0.39 / 0.41 / -5.0%
tpcds_q77/duckdb:vortex-file-compressed 28886914 / 27665724 / +4.4% 54895473 / 55876025 / -1.8% 0.53 / 0.50 / +6.3%
tpcds_q78/duckdb:vortex-file-compressed 72194428 / 74237560 / -2.8% 100038704 / 95171782 / +5.1% 0.72 / 0.78 / -7.5%
tpcds_q79/duckdb:vortex-file-compressed 26118418 / 26682594 / -2.1% 56741646 / 59131154 / -4.0% 0.46 / 0.45 / +2.0%
tpcds_q80/duckdb:vortex-file-compressed 50977486 / 52738601 / -3.3% 90591073 / 82641662 / +9.6% 0.56 / 0.64 / -11.8%
tpcds_q81/duckdb:vortex-file-compressed 37832868 / 37841108 / -0.0% 56100450 / 54634358 / +2.7% 0.67 / 0.69 / -2.6%
tpcds_q82/duckdb:vortex-file-compressed 52025812 / 52433969 / -0.8% 85180229 / 79246295 / +7.5% 0.61 / 0.66 / -7.7%
tpcds_q83/duckdb:vortex-file-compressed 31714914 / 32117978 / -1.3% 43009294 / 43508818 / -1.1% 0.74 / 0.74 / -0.1%
tpcds_q84/duckdb:vortex-file-compressed 25152454 / 25513235 / -1.4% 44636803 / 40241802 / +10.9% 🔴 0.56 / 0.63 / -11.1%
tpcds_q85/duckdb:vortex-file-compressed 50114559 / 50167924 / -0.1% 73569877 / 76600717 / -4.0% 0.68 / 0.65 / +4.0%
tpcds_q86/duckdb:vortex-file-compressed 18777230 / 17721529 / +6.0% 36764179 / 39876964 / -7.8% 0.51 / 0.44 / +14.9%
tpcds_q87/duckdb:vortex-file-compressed 42230014 / 41237342 / +2.4% 65477534 / 66200371 / -1.1% 0.64 / 0.62 / +3.5%
tpcds_q88/duckdb:vortex-file-compressed 59707376 / 60283933 / -1.0% 120537978 / 119275456 / +1.1% 0.50 / 0.51 / -2.0%
tpcds_q89/duckdb:vortex-file-compressed 22486287 / 24627052 / -8.7% 52978385 / 51468074 / +2.9% 0.42 / 0.48 / -11.3%
tpcds_q90/duckdb:vortex-file-compressed 15310036 / 13027303 / +17.5% 🔴 28227284 / 28186631 / +0.1% 0.54 / 0.46 / +17.4%
tpcds_q91/duckdb:vortex-file-compressed 30271069 / 27514656 / +10.0% 🔴 46838545 / 45047779 / +4.0% 0.65 / 0.61 / +5.8%
tpcds_q92/duckdb:vortex-file-compressed 21892381 / 22268098 / -1.7% 39221476 / 43087206 / -9.0% 0.56 / 0.52 / +8.0%
tpcds_q93/duckdb:vortex-file-compressed 29169144 / 28198244 / +3.4% 49505046 / 51390014 / -3.7% 0.59 / 0.55 / +7.4%
tpcds_q94/duckdb:vortex-file-compressed 29904688 / 29904510 / +0.0% 52869718 / 49868892 / +6.0% 0.57 / 0.60 / -5.7%
tpcds_q95/duckdb:vortex-file-compressed 138581160 / 136839202 / +1.3% 161150363 / 159818590 / +0.8% 0.86 / 0.86 / +0.4%
tpcds_q96/duckdb:vortex-file-compressed 15060313 / 14013747 / +7.5% 36064049 / 33557429 / +7.5% 0.42 / 0.42 / -0.0%
tpcds_q97/duckdb:vortex-file-compressed 40803466 / 42014570 / -2.9% 60050737 / 60151421 / -0.2% 0.68 / 0.70 / -2.7%
tpcds_q98/duckdb:vortex-file-compressed 23345900 / 24507064 / -4.7% 49511055 / 50379746 / -1.7% 0.47 / 0.49 / -3.1%
tpcds_q99/duckdb:vortex-file-compressed 25338396 / 23182398 / +9.3% 41757581 / 45634863 / -8.5% 0.61 / 0.51 / +19.4%
duckdb / parquet / ns (1.002x ➖, 1↑ 5↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:parquet 31636920 / 31924578 / -0.9% 47221649 / 47052544 / +0.4% 0.67 / 0.68 / -1.3%
tpcds_q02/duckdb:parquet 22217545 / 22315884 / -0.4% 31817747 / 38084535 / -16.5% 🟢 0.70 / 0.59 / +19.2%
tpcds_q03/duckdb:parquet 14205316 / 12323660 / +15.3% 🔴 24197377 / 23417672 / +3.3% 0.59 / 0.53 / +11.6%
tpcds_q04/duckdb:parquet 197880605 / 196754142 / +0.6% 202798370 / 205840010 / -1.5% 0.98 / 0.96 / +2.1%
tpcds_q05/duckdb:parquet 32682356 / 32710085 / -0.1% 43627448 / 41366552 / +5.5% 0.75 / 0.79 / -5.3%
tpcds_q06/duckdb:parquet 35662942 / 37616508 / -5.2% 59143880 / 56754081 / +4.2% 0.60 / 0.66 / -9.0%
tpcds_q07/duckdb:parquet 21958502 / 23776070 / -7.6% 36097763 / 36986342 / -2.4% 0.61 / 0.64 / -5.4%
tpcds_q08/duckdb:parquet 33658250 / 32613420 / +3.2% 50359557 / 46541763 / +8.2% 0.67 / 0.70 / -4.6%
tpcds_q09/duckdb:parquet 32614872 / 30435134 / +7.2% 37762410 / 41610378 / -9.2% 0.86 / 0.73 / +18.1%
tpcds_q10/duckdb:parquet 39733686 / 41045179 / -3.2% 60097963 / 59620305 / +0.8% 0.66 / 0.69 / -4.0%
tpcds_q11/duckdb:parquet 103477010 / 104642832 / -1.1% 124853571 / 118569873 / +5.3% 0.83 / 0.88 / -6.1%
tpcds_q12/duckdb:parquet 17615200 / 17941680 / -1.8% 27221850 / 27866443 / -2.3% 0.65 / 0.64 / +0.5%
tpcds_q13/duckdb:parquet 34894227 / 34119115 / +2.3% 50596018 / 50457208 / +0.3% 0.69 / 0.68 / +2.0%
tpcds_q14/duckdb:parquet 103533728 / 105702610 / -2.1% 112336918 / 115397343 / -2.7% 0.92 / 0.92 / +0.6%
tpcds_q15/duckdb:parquet 36622361 / 35284124 / +3.8% 47444289 / 49001018 / -3.2% 0.77 / 0.72 / +7.2%
tpcds_q16/duckdb:parquet 27817336 / 27570910 / +0.9% 41488813 / 43999165 / -5.7% 0.67 / 0.63 / +7.0%
tpcds_q17/duckdb:parquet 44305602 / 44653156 / -0.8% 59359574 / 58483147 / +1.5% 0.75 / 0.76 / -2.2%
tpcds_q18/duckdb:parquet 56106406 / 54975910 / +2.1% 78883989 / 76774132 / +2.7% 0.71 / 0.72 / -0.7%
tpcds_q19/duckdb:parquet 34230219 / 33732800 / +1.5% 47548989 / 48792476 / -2.5% 0.72 / 0.69 / +4.1%
tpcds_q20/duckdb:parquet 19258838 / 19291278 / -0.2% 29630524 / 28627582 / +3.5% 0.65 / 0.67 / -3.5%
tpcds_q21/duckdb:parquet 14555526 / 14621738 / -0.5% 23194862 / 24549406 / -5.5% 0.63 / 0.60 / +5.4%
tpcds_q22/duckdb:parquet 68164194 / 49952996 / +36.5% 🔴 82450535 / 81844771 / +0.7% 0.83 / 0.61 / +35.5%
tpcds_q23/duckdb:parquet 66165104 / 70829112 / -6.6% 78548521 / 85236084 / -7.8% 0.84 / 0.83 / +1.4%
tpcds_q24/duckdb:parquet 48809151 / 48710308 / +0.2% 72053310 / 71004921 / +1.5% 0.68 / 0.69 / -1.3%
tpcds_q25/duckdb:parquet 42085988 / 41887506 / +0.5% 58820051 / 59074041 / -0.4% 0.72 / 0.71 / +0.9%
tpcds_q26/duckdb:parquet 43995306 / 45714191 / -3.8% 56973707 / 55584248 / +2.5% 0.77 / 0.82 / -6.1%
tpcds_q27/duckdb:parquet 57276688 / 59680860 / -4.0% 73684533 / 77758636 / -5.2% 0.78 / 0.77 / +1.3%
tpcds_q28/duckdb:parquet 28528952 / 30387309 / -6.1% 39696549 / 39333111 / +0.9% 0.72 / 0.77 / -7.0%
tpcds_q29/duckdb:parquet 42911070 / 43797106 / -2.0% 56030604 / 57393084 / -2.4% 0.77 / 0.76 / +0.4%
tpcds_q30/duckdb:parquet 44481115 / 44487612 / -0.0% 60818120 / 60990853 / -0.3% 0.73 / 0.73 / +0.3%
tpcds_q31/duckdb:parquet 29857198 / 29996638 / -0.5% 42899198 / 43923009 / -2.3% 0.70 / 0.68 / +1.9%
tpcds_q32/duckdb:parquet 15309470 / 15413920 / -0.7% 27536614 / 26156057 / +5.3% 0.56 / 0.59 / -5.7%
tpcds_q33/duckdb:parquet 24190778 / 24362844 / -0.7% 37455756 / 38271627 / -2.1% 0.65 / 0.64 / +1.5%
tpcds_q34/duckdb:parquet 22053801 / 22549636 / -2.2% 34959759 / 35536003 / -1.6% 0.63 / 0.63 / -0.6%
tpcds_q35/duckdb:parquet 68311515 / 67821696 / +0.7% 90981229 / 89646917 / +1.5% 0.75 / 0.76 / -0.8%
tpcds_q36/duckdb:parquet 22539120 / 22378196 / +0.7% 40328501 / 40292931 / +0.1% 0.56 / 0.56 / +0.6%
tpcds_q37/duckdb:parquet 17931194 / 18067383 / -0.8% 31102999 / 29933738 / +3.9% 0.58 / 0.60 / -4.5%
tpcds_q38/duckdb:parquet 40637600 / 41797656 / -2.8% 50684983 / 52710087 / -3.8% 0.80 / 0.79 / +1.1%
tpcds_q39/duckdb:parquet 37451480 / 37508841 / -0.2% 46878981 / 51647283 / -9.2% 0.80 / 0.73 / +10.0%
tpcds_q40/duckdb:parquet 22544233 / 22838101 / -1.3% 33373537 / 30657782 / +8.9% 0.68 / 0.74 / -9.3%
tpcds_q41/duckdb:parquet 10573933 / 11269600 / -6.2% 22347293 / 20965581 / +6.6% 0.47 / 0.54 / -12.0%
tpcds_q42/duckdb:parquet 13095759 / 13195181 / -0.8% 24039275 / 23036487 / +4.4% 0.54 / 0.57 / -4.9%
tpcds_q43/duckdb:parquet 15122590 / 14955020 / +1.1% 26329349 / 29146029 / -9.7% 0.57 / 0.51 / +11.9%
tpcds_q44/duckdb:parquet 25080988 / 25135164 / -0.2% 39838116 / 40711677 / -2.1% 0.63 / 0.62 / +2.0%
tpcds_q45/duckdb:parquet 33097938 / 32755548 / +1.0% 44699625 / 42652692 / +4.8% 0.74 / 0.77 / -3.6%
tpcds_q46/duckdb:parquet 49747953 / 51047946 / -2.5% 71103185 / 66999328 / +6.1% 0.70 / 0.76 / -8.2%
tpcds_q47/duckdb:parquet 50399045 / 47826334 / +5.4% 62608497 / 61046604 / +2.6% 0.80 / 0.78 / +2.8%
tpcds_q48/duckdb:parquet 31435798 / 32752530 / -4.0% 43926764 / 42994311 / +2.2% 0.72 / 0.76 / -6.1%
tpcds_q49/duckdb:parquet 27610300 / 30298366 / -8.9% 44044697 / 45386111 / -3.0% 0.63 / 0.67 / -6.1%
tpcds_q50/duckdb:parquet 24780586 / 24782119 / -0.0% 38119355 / 37540961 / +1.5% 0.65 / 0.66 / -1.5%
tpcds_q51/duckdb:parquet 131651662 / 96740823 / +36.1% 🔴 143768130 / 119284228 / +20.5% 🔴 0.92 / 0.81 / +12.9%
tpcds_q52/duckdb:parquet 13791357 / 12277496 / +12.3% 🔴 24845316 / 24737365 / +0.4% 0.56 / 0.50 / +11.8%
tpcds_q53/duckdb:parquet 16138198 / 16680844 / -3.3% 32436191 / 31352143 / +3.5% 0.50 / 0.53 / -6.5%
tpcds_q54/duckdb:parquet 30502405 / 30728221 / -0.7% 47231339 / 47189504 / +0.1% 0.65 / 0.65 / -0.8%
tpcds_q55/duckdb:parquet 11690474 / 12068159 / -3.1% 22756764 / 23612219 / -3.6% 0.51 / 0.51 / +0.5%
tpcds_q56/duckdb:parquet 23939416 / 25966758 / -7.8% 39788262 / 39349313 / +1.1% 0.60 / 0.66 / -8.8%
tpcds_q57/duckdb:parquet 42478560 / 43082512 / -1.4% 55964624 / 54665471 / +2.4% 0.76 / 0.79 / -3.7%
tpcds_q58/duckdb:parquet 27113038 / 27962357 / -3.0% 42095588 / 40044585 / +5.1% 0.64 / 0.70 / -7.8%
tpcds_q59/duckdb:parquet 30917094 / 30695983 / +0.7% 55429605 / 42731801 / +29.7% 🔴 0.56 / 0.72 / -22.4%
tpcds_q60/duckdb:parquet 24517248 / 26351967 / -7.0% 39908607 / 39451363 / +1.2% 0.61 / 0.67 / -8.0%
tpcds_q61/duckdb:parquet 31072126 / 32717286 / -5.0% 44074001 / 45277501 / -2.7% 0.70 / 0.72 / -2.4%
tpcds_q62/duckdb:parquet 14909838 / 15086062 / -1.2% 22758334 / 22894565 / -0.6% 0.66 / 0.66 / -0.6%
tpcds_q63/duckdb:parquet 15369450 / 17788204 / -13.6% 🟢 28556193 / 30002947 / -4.8% 0.54 / 0.59 / -9.2%
tpcds_q64/duckdb:parquet 80139012 / 83410334 / -3.9% 102988669 / 102960901 / +0.0% 0.78 / 0.81 / -3.9%
tpcds_q65/duckdb:parquet 21230322 / 23055918 / -7.9% 35730657 / 36981682 / -3.4% 0.59 / 0.62 / -4.7%
tpcds_q66/duckdb:parquet 35093138 / 35900466 / -2.2% 47225803 / 47239700 / -0.0% 0.74 / 0.76 / -2.2%
tpcds_q67/duckdb:parquet 128766501 / 124563979 / +3.4% 138202401 / 134783190 / +2.5% 0.93 / 0.92 / +0.8%
tpcds_q68/duckdb:parquet 41685930 / 39430418 / +5.7% 58832414 / 60341122 / -2.5% 0.71 / 0.65 / +8.4%
tpcds_q69/duckdb:parquet 41577540 / 41263006 / +0.8% 62410227 / 60620615 / +3.0% 0.67 / 0.68 / -2.1%
tpcds_q70/duckdb:parquet 28466466 / 27069483 / +5.2% 43463460 / 44433030 / -2.2% 0.65 / 0.61 / +7.5%
tpcds_q71/duckdb:parquet 21110248 / 21248655 / -0.7% 35045246 / 35657967 / -1.7% 0.60 / 0.60 / +1.1%
tpcds_q72/duckdb:parquet 189318514 / 150196404 / +26.0% 🔴 139454606 / 132883577 / +4.9% 1.36 / 1.13 / +20.1%
tpcds_q73/duckdb:parquet 18413112 / 18561502 / -0.8% 32673178 / 30684774 / +6.5% 0.56 / 0.60 / -6.8%
tpcds_q74/duckdb:parquet 144813726 / 144645118 / +0.1% 166100255 / 161720465 / +2.7% 0.87 / 0.89 / -2.5%
tpcds_q75/duckdb:parquet 61175984 / 59994332 / +2.0% 81070306 / 80196595 / +1.1% 0.75 / 0.75 / +0.9%
tpcds_q76/duckdb:parquet 19987518 / 19651704 / +1.7% 32700766 / 32311632 / +1.2% 0.61 / 0.61 / +0.5%
tpcds_q77/duckdb:parquet 24638492 / 25764408 / -4.4% 38368827 / 39520672 / -2.9% 0.64 / 0.65 / -1.5%
tpcds_q78/duckdb:parquet 81112940 / 77462268 / +4.7% 91080539 / 93474068 / -2.6% 0.89 / 0.83 / +7.5%
tpcds_q79/duckdb:parquet 33554988 / 33615206 / -0.2% 50120888 / 51141504 / -2.0% 0.67 / 0.66 / +1.9%
tpcds_q80/duckdb:parquet 48818263 / 47752074 / +2.2% 62368644 / 60726729 / +2.7% 0.78 / 0.79 / -0.5%
tpcds_q81/duckdb:parquet 41219572 / 41090078 / +0.3% 58092522 / 58989707 / -1.5% 0.71 / 0.70 / +1.9%
tpcds_q82/duckdb:parquet 19786116 / 19079990 / +3.7% 33548926 / 34156524 / -1.8% 0.59 / 0.56 / +5.6%
tpcds_q83/duckdb:parquet 22359497 / 21627335 / +3.4% 33888784 / 31465060 / +7.7% 0.66 / 0.69 / -4.0%
tpcds_q84/duckdb:parquet 23769530 / 24048464 / -1.2% 32757383 / 33218955 / -1.4% 0.73 / 0.72 / +0.2%
tpcds_q85/duckdb:parquet 49134428 / 47376717 / +3.7% 65281162 / 64896341 / +0.6% 0.75 / 0.73 / +3.1%
tpcds_q86/duckdb:parquet 14969606 / 15772077 / -5.1% 25303195 / 25003853 / +1.2% 0.59 / 0.63 / -6.2%
tpcds_q87/duckdb:parquet 43715520 / 42973341 / +1.7% 54175602 / 53477291 / +1.3% 0.81 / 0.80 / +0.4%
tpcds_q88/duckdb:parquet 43126424 / 42657000 / +1.1% 53732854 / 52582005 / +2.2% 0.80 / 0.81 / -1.1%
tpcds_q89/duckdb:parquet 18284934 / 18861186 / -3.1% 32784542 / 32519359 / +0.8% 0.56 / 0.58 / -3.8%
tpcds_q90/duckdb:parquet 9844991 / 9650224 / +2.0% 21844968 / 21588828 / +1.2% 0.45 / 0.45 / +0.8%
tpcds_q91/duckdb:parquet 27863296 / 27824681 / +0.1% 42764780 / 41031909 / +4.2% 0.65 / 0.68 / -3.9%
tpcds_q92/duckdb:parquet 15435518 / 15887114 / -2.8% 26993626 / 26849067 / +0.5% 0.57 / 0.59 / -3.4%
tpcds_q93/duckdb:parquet 31184826 / 31251776 / -0.2% 47795754 / 47650843 / +0.3% 0.65 / 0.66 / -0.5%
tpcds_q94/duckdb:parquet 21713874 / 21691156 / +0.1% 35957114 / 36173631 / -0.6% 0.60 / 0.60 / +0.7%
tpcds_q95/duckdb:parquet 141008860 / 137882212 / +2.3% 148214819 / 147461397 / +0.5% 0.95 / 0.94 / +1.7%
tpcds_q96/duckdb:parquet 9846998 / 9807968 / +0.4% 17330445 / 17761701 / -2.4% 0.57 / 0.55 / +2.9%
tpcds_q97/duckdb:parquet 38684287 / 39466471 / -2.0% 52926513 / 50087126 / +5.7% 0.73 / 0.79 / -7.2%
tpcds_q98/duckdb:parquet 21528720 / 22832680 / -5.7% 34995520 / 35592197 / -1.7% 0.62 / 0.64 / -4.1%
tpcds_q99/duckdb:parquet 23983721 / 23873875 / +0.5% 33706454 / 32936456 / +2.3% 0.71 / 0.72 / -1.8%

No file size changes detected.

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on NVME 📖

Commits: PR 4182f555 vs base 8aeeac3a
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +1.6%
Engines: DataFusion No clear signal (+1.1%, low confidence) · DuckDB No clear signal (+2.1%, environment too noisy confidence)
Vortex (geomean): hot 1.006x ➖ · cold 1.001x ➖
Parquet (geomean): hot 0.990x ➖ · cold 1.000x ➖
Shifts: Parquet (control) -1.0% · Median polish +0.4%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.013x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 356895665 / 326236455 / +9.4% 465871481 / 480293645 / -3.0% 0.77 / 0.68 / +12.8%
tpch_q02/datafusion:vortex-file-compressed 96352307 / 95382478 / +1.0% 186062980 / 183709082 / +1.3% 0.52 / 0.52 / -0.3%
tpch_q03/datafusion:vortex-file-compressed 146069418 / 148177486 / -1.4% 277205895 / 289519957 / -4.3% 0.53 / 0.51 / +3.0%
tpch_q04/datafusion:vortex-file-compressed 61889348 / 62348435 / -0.7% 142439093 / 150580782 / -5.4% 0.43 / 0.41 / +4.9%
tpch_q05/datafusion:vortex-file-compressed 268190801 / 265550654 / +1.0% 447905709 / 470906997 / -4.9% 0.60 / 0.56 / +6.2%
tpch_q06/datafusion:vortex-file-compressed 23852862 / 24512481 / -2.7% 144661028 / 142665913 / +1.4% 0.16 / 0.17 / -4.0%
tpch_q07/datafusion:vortex-file-compressed 354616926 / 352296694 / +0.7% 499078271 / 495284679 / +0.8% 0.71 / 0.71 / -0.1%
tpch_q08/datafusion:vortex-file-compressed 269408277 / 268769838 / +0.2% 497343025 / 500855593 / -0.7% 0.54 / 0.54 / +0.9%
tpch_q09/datafusion:vortex-file-compressed 464384610 / 450555371 / +3.1% 709556343 / 666618363 / +6.4% 0.65 / 0.68 / -3.2%
tpch_q10/datafusion:vortex-file-compressed 166398545 / 162031708 / +2.7% 330534196 / 305466387 / +8.2% 0.50 / 0.53 / -5.1%
tpch_q11/datafusion:vortex-file-compressed 69079373 / 68079264 / +1.5% 139425533 / 138494789 / +0.7% 0.50 / 0.49 / +0.8%
tpch_q12/datafusion:vortex-file-compressed 79979851 / 78943831 / +1.3% 174089360 / 158917041 / +9.5% 0.46 / 0.50 / -7.5%
tpch_q13/datafusion:vortex-file-compressed 115058929 / 114328446 / +0.6% 198428367 / 195505128 / +1.5% 0.58 / 0.58 / -0.8%
tpch_q14/datafusion:vortex-file-compressed 37479020 / 37501184 / -0.1% 173508983 / 176621482 / -1.8% 0.22 / 0.21 / +1.7%
tpch_q15/datafusion:vortex-file-compressed 68575096 / 68354719 / +0.3% 210646875 / 184470312 / +14.2% 🔴 0.33 / 0.37 / -12.1%
tpch_q16/datafusion:vortex-file-compressed 61585897 / 60124595 / +2.4% 135100720 / 138599573 / -2.5% 0.46 / 0.43 / +5.1%
tpch_q17/datafusion:vortex-file-compressed 419181315 / 407790062 / +2.8% 520101420 / 515324110 / +0.9% 0.81 / 0.79 / +1.8%
tpch_q18/datafusion:vortex-file-compressed 648601784 / 601458112 / +7.8% 801010626 / 769801451 / +4.1% 0.81 / 0.78 / +3.6%
tpch_q19/datafusion:vortex-file-compressed 52003625 / 53038627 / -2.0% 177449248 / 176387299 / +0.6% 0.29 / 0.30 / -2.5%
tpch_q20/datafusion:vortex-file-compressed 126198722 / 123990232 / +1.8% 269831060 / 256032003 / +5.4% 0.47 / 0.48 / -3.4%
tpch_q21/datafusion:vortex-file-compressed 436803624 / 444754140 / -1.8% 612277892 / 598860529 / +2.2% 0.71 / 0.74 / -3.9%
tpch_q22/datafusion:vortex-file-compressed 37005190 / 36486460 / +1.4% 100089698 / 98995205 / +1.1% 0.37 / 0.37 / +0.3%
datafusion / parquet / ns (1.002x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 324817477 / 321881316 / +0.9% 420783041 / 405103122 / +3.9% 0.77 / 0.79 / -2.8%
tpch_q02/datafusion:parquet 185438098 / 182615504 / +1.5% 261372394 / 258296129 / +1.2% 0.71 / 0.71 / +0.4%
tpch_q03/datafusion:parquet 214046139 / 208007875 / +2.9% 357552211 / 350996110 / +1.9% 0.60 / 0.59 / +1.0%
tpch_q04/datafusion:parquet 88971581 / 90241173 / -1.4% 199466437 / 191510779 / +4.2% 0.45 / 0.47 / -5.3%
tpch_q05/datafusion:parquet 340861207 / 341225734 / -0.1% 509782492 / 505950230 / +0.8% 0.67 / 0.67 / -0.9%
tpch_q06/datafusion:parquet 66772188 / 67729468 / -1.4% 168822515 / 167487929 / +0.8% 0.40 / 0.40 / -2.2%
tpch_q07/datafusion:parquet 482577508 / 480011393 / +0.5% 675295422 / 671885083 / +0.5% 0.71 / 0.71 / +0.0%
tpch_q08/datafusion:parquet 372163640 / 372913802 / -0.2% 544112717 / 566825344 / -4.0% 0.68 / 0.66 / +4.0%
tpch_q09/datafusion:parquet 647985594 / 650619378 / -0.4% 837301441 / 822735795 / +1.8% 0.77 / 0.79 / -2.1%
tpch_q10/datafusion:parquet 511888582 / 517245102 / -1.0% 687717020 / 680852861 / +1.0% 0.74 / 0.76 / -2.0%
tpch_q11/datafusion:parquet 118008991 / 121013160 / -2.5% 194301453 / 198606688 / -2.2% 0.61 / 0.61 / -0.3%
tpch_q12/datafusion:parquet 137573941 / 138513015 / -0.7% 254831788 / 258451574 / -1.4% 0.54 / 0.54 / +0.7%
tpch_q13/datafusion:parquet 333673852 / 324575859 / +2.8% 411925042 / 373944233 / +10.2% 🔴 0.81 / 0.87 / -6.7%
tpch_q14/datafusion:parquet 113014987 / 111403775 / +1.4% 237190958 / 235293792 / +0.8% 0.48 / 0.47 / +0.6%
tpch_q15/datafusion:parquet 185962331 / 185433151 / +0.3% 286513696 / 291483001 / -1.7% 0.65 / 0.64 / +2.0%
tpch_q16/datafusion:parquet 118264592 / 120874548 / -2.2% 206521900 / 200302194 / +3.1% 0.57 / 0.60 / -5.1%
tpch_q17/datafusion:parquet 442853431 / 436793926 / +1.4% 569993945 / 565888938 / +0.7% 0.78 / 0.77 / +0.7%
tpch_q18/datafusion:parquet 655827708 / 664495217 / -1.3% 844702021 / 863271365 / -2.2% 0.78 / 0.77 / +0.9%
tpch_q19/datafusion:parquet 180398376 / 179072445 / +0.7% 310134711 / 324859648 / -4.5% 0.58 / 0.55 / +5.5%
tpch_q20/datafusion:parquet 270633103 / 269382396 / +0.5% 398320777 / 392379719 / +1.5% 0.68 / 0.69 / -1.0%
tpch_q21/datafusion:parquet 558526565 / 549646657 / +1.6% 781171074 / 779495500 / +0.2% 0.71 / 0.71 / +1.4%
tpch_q22/datafusion:parquet 224051734 / 221699925 / +1.1% 281995718 / 280447927 / +0.6% 0.79 / 0.79 / +0.5%
duckdb / vortex-file-compressed / ns (0.999x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 99017232 / 98636629 / +0.4% 198352567 / 192504942 / +3.0% 0.50 / 0.51 / -2.6%
tpch_q02/duckdb:vortex-file-compressed 69471065 / 68655086 / +1.2% 121217426 / 116547549 / +4.0% 0.57 / 0.59 / -2.7%
tpch_q03/duckdb:vortex-file-compressed 134351653 / 133627001 / +0.5% 263743324 / 234006958 / +12.7% 🔴 0.51 / 0.57 / -10.8%
tpch_q04/duckdb:vortex-file-compressed 171373398 / 171625646 / -0.1% 250983128 / 243865207 / +2.9% 0.68 / 0.70 / -3.0%
tpch_q05/duckdb:vortex-file-compressed 141776862 / 143492913 / -1.2% 243620934 / 243890562 / -0.1% 0.58 / 0.59 / -1.1%
tpch_q06/duckdb:vortex-file-compressed 36838978 / 36065383 / +2.1% 133377275 / 135407588 / -1.5% 0.28 / 0.27 / +3.7%
tpch_q07/duckdb:vortex-file-compressed 128416462 / 129980215 / -1.2% 274310382 / 269856886 / +1.7% 0.47 / 0.48 / -2.8%
tpch_q08/duckdb:vortex-file-compressed 176882807 / 175667653 / +0.7% 293070747 / 296306394 / -1.1% 0.60 / 0.59 / +1.8%
tpch_q09/duckdb:vortex-file-compressed 300664250 / 302462180 / -0.6% 429896935 / 439703817 / -2.2% 0.70 / 0.69 / +1.7%
tpch_q10/duckdb:vortex-file-compressed 209800750 / 209329306 / +0.2% 327912623 / 368825851 / -11.1% 🟢 0.64 / 0.57 / +12.7%
tpch_q11/duckdb:vortex-file-compressed 39512320 / 38717053 / +2.1% 88218792 / 87018520 / +1.4% 0.45 / 0.44 / +0.7%
tpch_q12/duckdb:vortex-file-compressed 110115544 / 109860498 / +0.2% 187867879 / 192973060 / -2.6% 0.59 / 0.57 / +3.0%
tpch_q13/duckdb:vortex-file-compressed 199259716 / 196353533 / +1.5% 287350058 / 313174622 / -8.2% 0.69 / 0.63 / +10.6%
tpch_q14/duckdb:vortex-file-compressed 54344191 / 55862785 / -2.7% 164798768 / 172469790 / -4.4% 0.33 / 0.32 / +1.8%
tpch_q15/duckdb:vortex-file-compressed 81911265 / 80887955 / +1.3% 179927640 / 198064183 / -9.2% 0.46 / 0.41 / +11.5%
tpch_q16/duckdb:vortex-file-compressed 83721732 / 86609488 / -3.3% 125874201 / 125299809 / +0.5% 0.67 / 0.69 / -3.8%
tpch_q17/duckdb:vortex-file-compressed 115827944 / 113450765 / +2.1% 267097860 / 291042515 / -8.2% 0.43 / 0.39 / +11.2%
tpch_q18/duckdb:vortex-file-compressed 257297758 / 273015525 / -5.8% 340049365 / 338134644 / +0.6% 0.76 / 0.81 / -6.3%
tpch_q19/duckdb:vortex-file-compressed 86190199 / 84495413 / +2.0% 208076452 / 203500164 / +2.2% 0.41 / 0.42 / -0.2%
tpch_q20/duckdb:vortex-file-compressed 142134955 / 142790817 / -0.5% 267636214 / 271135982 / -1.3% 0.53 / 0.53 / +0.8%
tpch_q21/duckdb:vortex-file-compressed 496664754 / 492130260 / +0.9% 567141598 / 573361818 / -1.1% 0.88 / 0.86 / +2.0%
tpch_q22/duckdb:vortex-file-compressed 71718269 / 72798931 / -1.5% 128179624 / 131501232 / -2.5% 0.56 / 0.55 / +1.1%
duckdb / parquet / ns (0.979x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 105067481 / 153571777 / -31.6% 🟢 185144110 / 191082336 / -3.1% 0.57 / 0.80 / -29.4%
tpch_q02/duckdb:parquet 98831318 / 101850408 / -3.0% 121005191 / 120645889 / +0.3% 0.82 / 0.84 / -3.3%
tpch_q03/duckdb:parquet 160368012 / 165008400 / -2.8% 217112786 / 228583979 / -5.0% 0.74 / 0.72 / +2.3%
tpch_q04/duckdb:parquet 122862617 / 119437608 / +2.9% 169171092 / 154059922 / +9.8% 0.73 / 0.78 / -6.3%
tpch_q05/duckdb:parquet 184110472 / 188681896 / -2.4% 256813535 / 257149134 / -0.1% 0.72 / 0.73 / -2.3%
tpch_q06/duckdb:parquet 58369590 / 58282792 / +0.1% 91497088 / 96204897 / -4.9% 0.64 / 0.61 / +5.3%
tpch_q07/duckdb:parquet 145457518 / 142941286 / +1.8% 218124827 / 241148545 / -9.5% 0.67 / 0.59 / +12.5%
tpch_q08/duckdb:parquet 220937640 / 217344185 / +1.7% 299282683 / 299265418 / +0.0% 0.74 / 0.73 / +1.6%
tpch_q09/duckdb:parquet 344686287 / 347467253 / -0.8% 437956840 / 433245902 / +1.1% 0.79 / 0.80 / -1.9%
tpch_q10/duckdb:parquet 656346455 / 654772668 / +0.2% 729719204 / 731813984 / -0.3% 0.90 / 0.89 / +0.5%
tpch_q11/duckdb:parquet 42088387 / 41482478 / +1.5% 54806141 / 54565954 / +0.4% 0.77 / 0.76 / +1.0%
tpch_q12/duckdb:parquet 118261258 / 116953161 / +1.1% 151867526 / 150105389 / +1.2% 0.78 / 0.78 / -0.1%
tpch_q13/duckdb:parquet 396088969 / 396925004 / -0.2% 430869780 / 426824343 / +0.9% 0.92 / 0.93 / -1.1%
tpch_q14/duckdb:parquet 154608869 / 153342909 / +0.8% 213595688 / 215207571 / -0.7% 0.72 / 0.71 / +1.6%
tpch_q15/duckdb:parquet 77288004 / 78699724 / -1.8% 124167493 / 123228987 / +0.8% 0.62 / 0.64 / -2.5%
tpch_q16/duckdb:parquet 154528054 / 156286636 / -1.1% 174878758 / 174793657 / +0.0% 0.88 / 0.89 / -1.2%
tpch_q17/duckdb:parquet 120696620 / 127883592 / -5.6% 201005836 / 206380737 / -2.6% 0.60 / 0.62 / -3.1%
tpch_q18/duckdb:parquet 294611337 / 311600088 / -5.5% 294923772 / 277069833 / +6.4% 1.00 / 1.12 / -11.2%
tpch_q19/duckdb:parquet 237318273 / 237208452 / +0.0% 307825442 / 323942968 / -5.0% 0.77 / 0.73 / +5.3%
tpch_q20/duckdb:parquet 200042365 / 196687826 / +1.7% 262301402 / 266994241 / -1.8% 0.76 / 0.74 / +3.5%
tpch_q21/duckdb:parquet 435325177 / 426058069 / +2.2% 476025976 / 473733854 / +0.5% 0.91 / 0.90 / +1.7%
tpch_q22/duckdb:parquet 337772093 / 336778885 / +0.3% 359145160 / 374925767 / -4.2% 0.94 / 0.90 / +4.7%

No file size changes detected.

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb S3 📖

Commits: PR 4182f555 vs base 42a5d3b5
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -4.8%
Engines: DataFusion No clear signal (+19.7%, environment too noisy confidence) · DuckDB No clear signal (-24.3%, low confidence)
Vortex (geomean): hot 0.773x ➖ · cold 0.718x ➖
Parquet (geomean): hot 0.813x ➖ · cold 0.791x ➖
Shifts: Parquet (control) -18.7% · Median polish -9.6%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.799x ➖, 2↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-file-compressed 35112791 / 42095168 / -16.6% 118339008 / 173441605 / -31.8% 🟢 0.30 / 0.24 / +22.3%
fineweb_q01/datafusion:vortex-file-compressed 387560972 / 457396466 / -15.3% 620284335 / 1040902792 / -40.4% 🟢 0.62 / 0.44 / +42.2%
fineweb_q02/datafusion:vortex-file-compressed 369352402 / 456207440 / -19.0% 435370837 / 695696523 / -37.4% 🟢 0.85 / 0.66 / +29.4%
fineweb_q03/datafusion:vortex-file-compressed 417041721 / 624318445 / -33.2% 🟢 694696144 / 1890894199 / -63.3% 🟢 0.60 / 0.33 / +81.8%
fineweb_q04/datafusion:vortex-file-compressed 657517042 / 662483298 / -0.7% 574568494 / 691492457 / -16.9% 1.14 / 0.96 / +19.4%
fineweb_q05/datafusion:vortex-file-compressed 596583162 / 622331308 / -4.1% 508481814 / 883854667 / -42.5% 🟢 1.17 / 0.70 / +66.6%
fineweb_q06/datafusion:vortex-file-compressed 698970113 / 966919202 / -27.7% 737273804 / 829276291 / -11.1% 0.95 / 1.17 / -18.7%
fineweb_q07/datafusion:vortex-file-compressed 502587142 / 588663280 / -14.6% 447796547 / 652771780 / -31.4% 🟢 1.12 / 0.90 / +24.5%
fineweb_q08/datafusion:vortex-file-compressed 200559358 / 339544122 / -40.9% 🟢 398010853 / 286903081 / +38.7% 🔴 0.50 / 1.18 / -57.4%
datafusion / parquet / ns (0.667x ✅, 4↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:parquet 478224004 / 676873892 / -29.3% 921249036 / 1561550914 / -41.0% 🟢 0.52 / 0.43 / +19.8%
fineweb_q01/datafusion:parquet 858656376 / 1140023851 / -24.7% 969101824 / 1200541567 / -19.3% 0.89 / 0.95 / -6.7%
fineweb_q02/datafusion:parquet 818316742 / 1191122069 / -31.3% 🟢 837658071 / 2101352904 / -60.1% 🟢 0.98 / 0.57 / +72.3%
fineweb_q03/datafusion:parquet 851855652 / 1502628162 / -43.3% 🟢 884664972 / 1363092584 / -35.1% 🟢 0.96 / 1.10 / -12.7%
fineweb_q04/datafusion:parquet 955562743 / 1306246926 / -26.8% 1020943875 / 1335404887 / -23.5% 0.94 / 0.98 / -4.3%
fineweb_q05/datafusion:parquet 963474218 / 1196857048 / -19.5% 962964184 / 1365361234 / -29.5% 1.00 / 0.88 / +14.1%
fineweb_q06/datafusion:parquet 864750084 / 1295030748 / -33.2% 🟢 908165765 / 1457459667 / -37.7% 🟢 0.95 / 0.89 / +7.2%
fineweb_q07/datafusion:parquet 869065400 / 2414875406 / -64.0% 🟢 980232981 / 2868127450 / -65.8% 🟢 0.89 / 0.84 / +5.3%
fineweb_q08/datafusion:parquet 1055554650 / 1180313258 / -10.6% 1065542085 / 1171959788 / -9.1% 0.99 / 1.01 / -1.6%
duckdb / vortex-file-compressed / ns (0.749x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-file-compressed 78274776 / 71616853 / +9.3% 77867200 / 124407192 / -37.4% 🟢 1.01 / 0.58 / +74.6%
fineweb_q01/duckdb:vortex-file-compressed 560313976 / 5741652737 / -90.2% 🟢 606547860 / 3394374299 / -82.1% 🟢 0.92 / 1.69 / -45.4%
fineweb_q02/duckdb:vortex-file-compressed 674580158 / 703741500 / -4.1% 717422086 / 869007077 / -17.4% 0.94 / 0.81 / +16.1%
fineweb_q03/duckdb:vortex-file-compressed 1559554782 / 1723643644 / -9.5% 1844872501 / 1944688545 / -5.1% 0.85 / 0.89 / -4.6%
fineweb_q04/duckdb:vortex-file-compressed 1703881118 / 1677067460 / +1.6% 1625905804 / 1665979408 / -2.4% 1.05 / 1.01 / +4.1%
fineweb_q05/duckdb:vortex-file-compressed 1532674743 / 1680936356 / -8.8% 1591714307 / 1619586003 / -1.7% 0.96 / 1.04 / -7.2%
fineweb_q06/duckdb:vortex-file-compressed 1657033988 / 1784818150 / -7.2% 1699478343 / 1689226361 / +0.6% 0.98 / 1.06 / -7.7%
fineweb_q07/duckdb:vortex-file-compressed 1444505996 / 1548137316 / -6.7% 1485991800 / 1710971860 / -13.1% 0.97 / 0.90 / +7.4%
fineweb_q08/duckdb:vortex-file-compressed 651068690 / 652531202 / -0.2% 698971246 / 747720118 / -6.5% 0.93 / 0.87 / +6.7%
duckdb / parquet / ns (0.990x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:parquet 5236068926 / 5280003928 / -0.8% 1054783916 / 534963094 / +97.2% 🔴 4.96 / 9.87 / -49.7%
fineweb_q01/duckdb:parquet 5324616484 / 5337110474 / -0.2% 611551621 / 759361559 / -19.5% 8.71 / 7.03 / +23.9%
fineweb_q02/duckdb:parquet 5320350929 / 5340153140 / -0.4% 626970058 / 633167169 / -1.0% 8.49 / 8.43 / +0.6%
fineweb_q03/duckdb:parquet 5342283442 / 5425490840 / -1.5% 1236689758 / 1467948889 / -15.8% 4.32 / 3.70 / +16.9%
fineweb_q04/duckdb:parquet 5277151956 / 5340709940 / -1.2% 793871817 / 904219847 / -12.2% 6.65 / 5.91 / +12.5%
fineweb_q05/duckdb:parquet 3010707223 / 3049475774 / -1.3% 974570797 / 891851956 / +9.3% 3.09 / 3.42 / -9.7%
fineweb_q06/duckdb:parquet 5403941320 / 5398933908 / +0.1% 1439041595 / 1663766918 / -13.5% 3.76 / 3.25 / +15.7%
fineweb_q07/duckdb:parquet 3180997304 / 3218819182 / -1.2% 1178202401 / 1207693145 / -2.4% 2.70 / 2.67 / +1.3%
fineweb_q08/duckdb:parquet 2848273548 / 2922899662 / -2.6% 727606690 / 679113704 / +7.1% 3.91 / 4.30 / -9.0%

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: Statistical and Population Genetics 📖

Commits: PR 4182f555 vs base 42a5d3b5
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +2.6%
Engines: DuckDB No clear signal (+2.6%, low confidence)
Vortex (geomean): hot 1.030x ➖ · cold 1.015x ➖
Parquet (geomean): hot 1.004x ➖ · cold 0.990x ➖
Shifts: Parquet (control) +0.4% · Median polish +1.7%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

duckdb / vortex-file-compressed / ns (1.030x ➖, 1↑ 3↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
statpopgen_q00/duckdb:vortex-file-compressed 15152660 / 16413894 / -7.7% 28416961 / 29462287 / -3.5% 0.53 / 0.56 / -4.3%
statpopgen_q01/duckdb:vortex-file-compressed 14430331 / 14540114 / -0.8% 22364598 / 21736816 / +2.9% 0.65 / 0.67 / -3.5%
statpopgen_q02/duckdb:vortex-file-compressed 621646883 / 649178071 / -4.2% 636125237 / 649760901 / -2.1% 0.98 / 1.00 / -2.2%
statpopgen_q03/duckdb:vortex-file-compressed 1337179690 / 1540583522 / -13.2% 🟢 1308747351 / 1304877801 / +0.3% 1.02 / 1.18 / -13.5%
statpopgen_q04/duckdb:vortex-file-compressed 1661302240 / 1408578182 / +17.9% 🔴 1307641387 / 1316245125 / -0.7% 1.27 / 1.07 / +18.7%
statpopgen_q05/duckdb:vortex-file-compressed 803459914 / 706363839 / +13.7% 🔴 739919972 / 655393806 / +12.9% 🔴 1.09 / 1.08 / +0.8%
statpopgen_q06/duckdb:vortex-file-compressed 1845352322 / 1772375552 / +4.1% 1774484202 / 1798969694 / -1.4% 1.04 / 0.99 / +5.6%
statpopgen_q07/duckdb:vortex-file-compressed 353892556 / 352715558 / +0.3% 468507185 / 461690913 / +1.5% 0.76 / 0.76 / -1.1%
statpopgen_q08/duckdb:vortex-file-compressed 389608266 / 378091960 / +3.0% 487069390 / 434395559 / +12.1% 🔴 0.80 / 0.87 / -8.1%
statpopgen_q09/duckdb:vortex-file-compressed 1113685677 / 1061074005 / +5.0% 1077168303 / 1101351848 / -2.2% 1.03 / 0.96 / +7.3%
statpopgen_q10/duckdb:vortex-file-compressed 3822261168 / 3181482612 / +20.1% 🔴 3184656112 / 3230818354 / -1.4% 1.20 / 0.98 / +21.9%
duckdb / parquet / ns (1.004x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
statpopgen_q00/duckdb:parquet 376776508 / 376776638 / -0.0% 379611056 / 381849842 / -0.6% 0.99 / 0.99 / +0.6%
statpopgen_q01/duckdb:parquet 466234052 / 467361456 / -0.2% 475012864 / 474596522 / +0.1% 0.98 / 0.98 / -0.3%
statpopgen_q02/duckdb:parquet 770986681 / 772304092 / -0.2% 804957166 / 814683965 / -1.2% 0.96 / 0.95 / +1.0%
statpopgen_q03/duckdb:parquet 1058268208 / 1047178789 / +1.1% 1105167760 / 1126131075 / -1.9% 0.96 / 0.93 / +3.0%
statpopgen_q04/duckdb:parquet 1047352590 / 1054571986 / -0.7% 1095249247 / 1122376431 / -2.4% 0.96 / 0.94 / +1.8%
statpopgen_q05/duckdb:parquet 779527201 / 766847172 / +1.7% 826185714 / 800491152 / +3.2% 0.94 / 0.96 / -1.5%
statpopgen_q06/duckdb:parquet 1023730032 / 1014074148 / +1.0% 1042373856 / 1048828295 / -0.6% 0.98 / 0.97 / +1.6%
statpopgen_q07/duckdb:parquet 967441725 / 952867324 / +1.5% 1104960815 / 1191731253 / -7.3% 0.88 / 0.80 / +9.5%
statpopgen_q08/duckdb:parquet 969718762 / 965658150 / +0.4% 1144102913 / 1148859763 / -0.4% 0.85 / 0.84 / +0.8%
statpopgen_q09/duckdb:parquet 1004785519 / 995240320 / +1.0% 1061008835 / 1043306808 / +1.7% 0.95 / 0.95 / -0.7%
statpopgen_q10/duckdb:parquet 1653843713 / 1662601140 / -0.5% 1683741755 / 1698180127 / -0.9% 0.98 / 0.98 / +0.3%

No file size changes detected.

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench on NVME 📖

Commits: PR 4182f555 vs base 42a5d3b5
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +1.2%
Engines: DataFusion No clear signal (+0.7%, low confidence) · DuckDB No clear signal (+1.8%, low confidence)
Vortex (geomean): hot 1.004x ➖ · cold 0.994x ➖
Parquet (geomean): hot 0.992x ➖ · cold 0.999x ➖
Shifts: Parquet (control) -0.8% · Median polish +0.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.006x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:vortex-file-compressed 1871211 / 1872797 / -0.1% 41172264 / 42796605 / -3.8% 0.05 / 0.04 / +3.9%
clickbench_q01/datafusion:vortex-file-compressed 12925698 / 12437032 / +3.9% 63453164 / 62384100 / +1.7% 0.20 / 0.20 / +2.2%
clickbench_q02/datafusion:vortex-file-compressed 27547805 / 26347937 / +4.6% 76564019 / 76935097 / -0.5% 0.36 / 0.34 / +5.1%
clickbench_q03/datafusion:vortex-file-compressed 27398316 / 26586140 / +3.1% 99531647 / 98254936 / +1.3% 0.28 / 0.27 / +1.7%
clickbench_q04/datafusion:vortex-file-compressed 161425218 / 162351456 / -0.6% 239935884 / 239725704 / +0.1% 0.67 / 0.68 / -0.7%
clickbench_q05/datafusion:vortex-file-compressed 221410684 / 217286384 / +1.9% 300811578 / 307780654 / -2.3% 0.74 / 0.71 / +4.3%
clickbench_q06/datafusion:vortex-file-compressed 1881004 / 1881010 / -0.0% 39790830 / 41894143 / -5.0% 0.05 / 0.04 / +5.3%
clickbench_q07/datafusion:vortex-file-compressed 18860037 / 19293712 / -2.2% 74950381 / 69664516 / +7.6% 0.25 / 0.28 / -9.1%
clickbench_q08/datafusion:vortex-file-compressed 220658760 / 220070611 / +0.3% 308143802 / 304341344 / +1.2% 0.72 / 0.72 / -1.0%
clickbench_q09/datafusion:vortex-file-compressed 342415516 / 348572184 / -1.8% 425707102 / 436116975 / -2.4% 0.80 / 0.80 / +0.6%
clickbench_q10/datafusion:vortex-file-compressed 67920670 / 67484766 / +0.6% 133288952 / 135958037 / -2.0% 0.51 / 0.50 / +2.7%
clickbench_q11/datafusion:vortex-file-compressed 88754348 / 87474317 / +1.5% 154005835 / 154518985 / -0.3% 0.58 / 0.57 / +1.8%
clickbench_q12/datafusion:vortex-file-compressed 199513147 / 195623084 / +2.0% 282762170 / 288499556 / -2.0% 0.71 / 0.68 / +4.1%
clickbench_q13/datafusion:vortex-file-compressed 341998235 / 336725196 / +1.6% 448317401 / 469612862 / -4.5% 0.76 / 0.72 / +6.4%
clickbench_q14/datafusion:vortex-file-compressed 203847442 / 202702039 / +0.6% 293510840 / 295143575 / -0.6% 0.69 / 0.69 / +1.1%
clickbench_q15/datafusion:vortex-file-compressed 185360312 / 183357598 / +1.1% 264380027 / 265854980 / -0.6% 0.70 / 0.69 / +1.7%
clickbench_q16/datafusion:vortex-file-compressed 471130656 / 469486326 / +0.4% 570072408 / 572650852 / -0.5% 0.83 / 0.82 / +0.8%
clickbench_q17/datafusion:vortex-file-compressed 478939966 / 466006188 / +2.8% 574570279 / 589779588 / -2.6% 0.83 / 0.79 / +5.5%
clickbench_q18/datafusion:vortex-file-compressed 885147252 / 902362466 / -1.9% 1005627721 / 985375688 / +2.1% 0.88 / 0.92 / -3.9%
clickbench_q19/datafusion:vortex-file-compressed 17663219 / 17880217 / -1.2% 89094529 / 85749643 / +3.9% 0.20 / 0.21 / -4.9%
clickbench_q20/datafusion:vortex-file-compressed 183623916 / 183409624 / +0.1% 388591918 / 386753912 / +0.5% 0.47 / 0.47 / -0.4%
clickbench_q21/datafusion:vortex-file-compressed 263533940 / 265959949 / -0.9% 475792452 / 472539731 / +0.7% 0.55 / 0.56 / -1.6%
clickbench_q22/datafusion:vortex-file-compressed 325347554 / 325680428 / -0.1% 609834885 / 600800331 / +1.5% 0.53 / 0.54 / -1.6%
clickbench_q23/datafusion:vortex-file-compressed 610813879 / 627616452 / -2.7% 870825593 / 929278320 / -6.3% 0.70 / 0.68 / +3.9%
clickbench_q24/datafusion:vortex-file-compressed 42899446 / 42951652 / -0.1% 118726731 / 116456980 / +1.9% 0.36 / 0.37 / -2.0%
clickbench_q25/datafusion:vortex-file-compressed 55717169 / 55378564 / +0.6% 127539787 / 124288981 / +2.6% 0.44 / 0.45 / -2.0%
clickbench_q26/datafusion:vortex-file-compressed 43847539 / 41946013 / +4.5% 120913179 / 116676095 / +3.6% 0.36 / 0.36 / +0.9%
clickbench_q27/datafusion:vortex-file-compressed 274853938 / 271163354 / +1.4% 457411672 / 462422100 / -1.1% 0.60 / 0.59 / +2.5%
clickbench_q28/datafusion:vortex-file-compressed 1428464344 / 1438916760 / -0.7% 1570920350 / 1460798508 / +7.5% 0.91 / 0.99 / -7.7%
clickbench_q29/datafusion:vortex-file-compressed 38601888 / 38955329 / -0.9% 94519490 / 93474258 / +1.1% 0.41 / 0.42 / -2.0%
clickbench_q30/datafusion:vortex-file-compressed 176147928 / 173676081 / +1.4% 259432640 / 263939863 / -1.7% 0.68 / 0.66 / +3.2%
clickbench_q31/datafusion:vortex-file-compressed 198314404 / 195944742 / +1.2% 326071300 / 329242188 / -1.0% 0.61 / 0.60 / +2.2%
clickbench_q32/datafusion:vortex-file-compressed 823047144 / 816551014 / +0.8% 938832959 / 954933626 / -1.7% 0.88 / 0.86 / +2.5%
clickbench_q33/datafusion:vortex-file-compressed 1021326830 / 1007286792 / +1.4% 1192938599 / 1214605058 / -1.8% 0.86 / 0.83 / +3.2%
clickbench_q34/datafusion:vortex-file-compressed 1001918848 / 1008563887 / -0.7% 1201743554 / 1258600367 / -4.5% 0.83 / 0.80 / +4.0%
clickbench_q35/datafusion:vortex-file-compressed 149802340 / 151495236 / -1.1% 227582565 / 226461837 / +0.5% 0.66 / 0.67 / -1.6%
clickbench_q36/datafusion:vortex-file-compressed 57442076 / 58149141 / -1.2% 119086334 / 120778840 / -1.4% 0.48 / 0.48 / +0.2%
clickbench_q37/datafusion:vortex-file-compressed 29347216 / 28910337 / +1.5% 85727456 / 87324987 / -1.8% 0.34 / 0.33 / +3.4%
clickbench_q38/datafusion:vortex-file-compressed 15538178 / 15384559 / +1.0% 75436403 / 72027978 / +4.7% 0.21 / 0.21 / -3.6%
clickbench_q39/datafusion:vortex-file-compressed 111753376 / 111233198 / +0.5% 185620208 / 183361388 / +1.2% 0.60 / 0.61 / -0.8%
clickbench_q40/datafusion:vortex-file-compressed 13919726 / 14057642 / -1.0% 68305186 / 67784226 / +0.8% 0.20 / 0.21 / -1.7%
clickbench_q41/datafusion:vortex-file-compressed 12867806 / 12361072 / +4.1% 64527073 / 65538726 / -1.5% 0.20 / 0.19 / +5.7%
clickbench_q42/datafusion:vortex-file-compressed 13739884 / 13755054 / -0.1% 66937107 / 65882254 / +1.6% 0.21 / 0.21 / -1.7%
datafusion / parquet / ns (0.999x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:parquet 1933894 / 1918887 / +0.8% 80394778 / 75292742 / +6.8% 0.02 / 0.03 / -5.6%
clickbench_q01/datafusion:parquet 17265626 / 17971539 / -3.9% 113814975 / 114330139 / -0.5% 0.15 / 0.16 / -3.5%
clickbench_q02/datafusion:parquet 33659087 / 32414876 / +3.8% 136555042 / 136999971 / -0.3% 0.25 / 0.24 / +4.2%
clickbench_q03/datafusion:parquet 27851688 / 25813544 / +7.9% 140661716 / 135676483 / +3.7% 0.20 / 0.19 / +4.1%
clickbench_q04/datafusion:parquet 175908086 / 174029527 / +1.1% 301956426 / 302637474 / -0.2% 0.58 / 0.58 / +1.3%
clickbench_q05/datafusion:parquet 239986666 / 241120005 / -0.5% 368283242 / 374491290 / -1.7% 0.65 / 0.64 / +1.2%
clickbench_q06/datafusion:parquet 1917748 / 1977764 / -3.0% 80350506 / 76786614 / +4.6% 0.02 / 0.03 / -7.3%
clickbench_q07/datafusion:parquet 18497215 / 19158256 / -3.5% 114741186 / 123552841 / -7.1% 0.16 / 0.16 / +4.0%
clickbench_q08/datafusion:parquet 229296350 / 227943422 / +0.6% 387450935 / 382670692 / +1.2% 0.59 / 0.60 / -0.6%
clickbench_q09/datafusion:parquet 362060818 / 362967239 / -0.2% 500432490 / 489828802 / +2.2% 0.72 / 0.74 / -2.4%
clickbench_q10/datafusion:parquet 72165818 / 73563814 / -1.9% 192319656 / 192835502 / -0.3% 0.38 / 0.38 / -1.6%
clickbench_q11/datafusion:parquet 86567116 / 88011426 / -1.6% 220697952 / 218350130 / +1.1% 0.39 / 0.40 / -2.7%
clickbench_q12/datafusion:parquet 238326778 / 237020148 / +0.6% 373799360 / 365870818 / +2.2% 0.64 / 0.65 / -1.6%
clickbench_q13/datafusion:parquet 388189010 / 404352541 / -4.0% 548003088 / 556765453 / -1.6% 0.71 / 0.73 / -2.5%
clickbench_q14/datafusion:parquet 254279716 / 253295058 / +0.4% 390533112 / 397068236 / -1.6% 0.65 / 0.64 / +2.1%
clickbench_q15/datafusion:parquet 195231268 / 192432185 / +1.5% 329994606 / 327600520 / +0.7% 0.59 / 0.59 / +0.7%
clickbench_q16/datafusion:parquet 477586384 / 477918949 / -0.1% 633397501 / 628691443 / +0.7% 0.75 / 0.76 / -0.8%
clickbench_q17/datafusion:parquet 475122421 / 470065240 / +1.1% 631997617 / 634768586 / -0.4% 0.75 / 0.74 / +1.5%
clickbench_q18/datafusion:parquet 908698206 / 893182522 / +1.7% 1071982099 / 1065804554 / +0.6% 0.85 / 0.84 / +1.2%
clickbench_q19/datafusion:parquet 23155876 / 23252158 / -0.4% 124157523 / 125297900 / -0.9% 0.19 / 0.19 / +0.5%
clickbench_q20/datafusion:parquet 448294293 / 452707784 / -1.0% 613947247 / 613630016 / +0.1% 0.73 / 0.74 / -1.0%
clickbench_q21/datafusion:parquet 438912862 / 445470706 / -1.5% 607610211 / 611497011 / -0.6% 0.72 / 0.73 / -0.8%
clickbench_q22/datafusion:parquet 617334397 / 623216864 / -0.9% 849665444 / 842795554 / +0.8% 0.73 / 0.74 / -1.7%
clickbench_q23/datafusion:parquet 2426464788 / 2395517934 / +1.3% 2864055663 / 2908536341 / -1.5% 0.85 / 0.82 / +2.9%
clickbench_q24/datafusion:parquet 42662016 / 42765289 / -0.2% 139169593 / 139133639 / +0.0% 0.31 / 0.31 / -0.3%
clickbench_q25/datafusion:parquet 89795932 / 90522734 / -0.8% 203005311 / 201144667 / +0.9% 0.44 / 0.45 / -1.7%
clickbench_q26/datafusion:parquet 44343004 / 43191468 / +2.7% 140926026 / 146538053 / -3.8% 0.31 / 0.29 / +6.8%
clickbench_q27/datafusion:parquet 540154148 / 527159030 / +2.5% 680991220 / 676539693 / +0.7% 0.79 / 0.78 / +1.8%
clickbench_q28/datafusion:parquet 1534915811 / 1535393828 / -0.0% 1640161772 / 1626788104 / +0.8% 0.94 / 0.94 / -0.8%
clickbench_q29/datafusion:parquet 39912474 / 39504981 / +1.0% 151963693 / 150303195 / +1.1% 0.26 / 0.26 / -0.1%
clickbench_q30/datafusion:parquet 233857854 / 234738027 / -0.4% 392987949 / 391781693 / +0.3% 0.60 / 0.60 / -0.7%
clickbench_q31/datafusion:parquet 269799752 / 260651114 / +3.5% 443790478 / 437298828 / +1.5% 0.61 / 0.60 / +2.0%
clickbench_q32/datafusion:parquet 843033686 / 842813673 / +0.0% 1031103810 / 1030694344 / +0.0% 0.82 / 0.82 / -0.0%
clickbench_q33/datafusion:parquet 1081655710 / 1089117082 / -0.7% 1312415375 / 1294355945 / +1.4% 0.82 / 0.84 / -2.1%
clickbench_q34/datafusion:parquet 1085447146 / 1082840145 / +0.2% 1298829334 / 1270469189 / +2.2% 0.84 / 0.85 / -1.9%
clickbench_q35/datafusion:parquet 157420403 / 157960984 / -0.3% 290263390 / 292235877 / -0.7% 0.54 / 0.54 / +0.3%
clickbench_q36/datafusion:parquet 109356550 / 107483539 / +1.7% 219448024 / 237127647 / -7.5% 0.50 / 0.45 / +9.9%
clickbench_q37/datafusion:parquet 48695722 / 48642788 / +0.1% 146802149 / 143166076 / +2.5% 0.33 / 0.34 / -2.4%
clickbench_q38/datafusion:parquet 65327560 / 64934042 / +0.6% 169680436 / 172084709 / -1.4% 0.39 / 0.38 / +2.0%
clickbench_q39/datafusion:parquet 208440056 / 205238774 / +1.6% 324401581 / 329943545 / -1.7% 0.64 / 0.62 / +3.3%
clickbench_q40/datafusion:parquet 26286422 / 28759078 / -8.6% 127022796 / 124183668 / +2.3% 0.21 / 0.23 / -10.6%
clickbench_q41/datafusion:parquet 25508796 / 25975452 / -1.8% 122748443 / 120312381 / +2.0% 0.21 / 0.22 / -3.7%
clickbench_q42/datafusion:parquet 25967074 / 26453342 / -1.8% 121437827 / 120561519 / +0.7% 0.21 / 0.22 / -2.5%
duckdb / vortex-file-compressed / ns (1.003x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:vortex-file-compressed 13475638 / 13271264 / +1.5% 80356718 / 69511050 / +15.6% 🔴 0.17 / 0.19 / -12.2%
clickbench_q01/duckdb:vortex-file-compressed 17678386 / 16503751 / +7.1% 90369733 / 93570800 / -3.4% 0.20 / 0.18 / +10.9%
clickbench_q02/duckdb:vortex-file-compressed 24328774 / 23929644 / +1.7% 110588006 / 125211548 / -11.7% 🟢 0.22 / 0.19 / +15.1%
clickbench_q03/duckdb:vortex-file-compressed 34227071 / 32452808 / +5.5% 105336898 / 104700483 / +0.6% 0.32 / 0.31 / +4.8%
clickbench_q04/duckdb:vortex-file-compressed 134406808 / 135052232 / -0.5% 217459383 / 213254053 / +2.0% 0.62 / 0.63 / -2.4%
clickbench_q05/duckdb:vortex-file-compressed 159300727 / 158728360 / +0.4% 242648944 / 242634260 / +0.0% 0.66 / 0.65 / +0.4%
clickbench_q06/duckdb:vortex-file-compressed 20445254 / 20016862 / +2.1% 93775761 / 101116490 / -7.3% 0.22 / 0.20 / +10.1%
clickbench_q07/duckdb:vortex-file-compressed 21955696 / 21308076 / +3.0% 104605030 / 103315119 / +1.2% 0.21 / 0.21 / +1.8%
clickbench_q08/duckdb:vortex-file-compressed 170967582 / 174185225 / -1.8% 288589533 / 280600885 / +2.8% 0.59 / 0.62 / -4.6%
clickbench_q09/duckdb:vortex-file-compressed 211432938 / 212541025 / -0.5% 334626523 / 346938549 / -3.5% 0.63 / 0.61 / +3.1%
clickbench_q10/duckdb:vortex-file-compressed 72144265 / 76004089 / -5.1% 180398271 / 182312998 / -1.1% 0.40 / 0.42 / -4.1%
clickbench_q11/duckdb:vortex-file-compressed 97065072 / 96169818 / +0.9% 204553789 / 205836447 / -0.6% 0.47 / 0.47 / +1.6%
clickbench_q12/duckdb:vortex-file-compressed 178518907 / 177887337 / +0.4% 292638983 / 296245119 / -1.2% 0.61 / 0.60 / +1.6%
clickbench_q13/duckdb:vortex-file-compressed 329074720 / 320974258 / +2.5% 440677933 / 459097151 / -4.0% 0.75 / 0.70 / +6.8%
clickbench_q14/duckdb:vortex-file-compressed 194288199 / 196808800 / -1.3% 303956565 / 307763470 / -1.2% 0.64 / 0.64 / -0.0%
clickbench_q15/duckdb:vortex-file-compressed 192054783 / 184734380 / +4.0% 303264121 / 311003191 / -2.5% 0.63 / 0.59 / +6.6%
clickbench_q16/duckdb:vortex-file-compressed 373458196 / 383180996 / -2.5% 485594025 / 506038694 / -4.0% 0.77 / 0.76 / +1.6%
clickbench_q17/duckdb:vortex-file-compressed 370825740 / 376315846 / -1.5% 488965002 / 486073028 / +0.6% 0.76 / 0.77 / -2.0%
clickbench_q18/duckdb:vortex-file-compressed 739663178 / 737392430 / +0.3% 880200793 / 882610950 / -0.3% 0.84 / 0.84 / +0.6%
clickbench_q19/duckdb:vortex-file-compressed 25846466 / 26700132 / -3.2% 110365459 / 115406810 / -4.4% 0.23 / 0.23 / +1.2%
clickbench_q20/duckdb:vortex-file-compressed 244035790 / 242842700 / +0.5% 437537223 / 460239272 / -4.9% 0.56 / 0.53 / +5.7%
clickbench_q21/duckdb:vortex-file-compressed 371590826 / 376551457 / -1.3% 649827042 / 674312565 / -3.6% 0.57 / 0.56 / +2.4%
clickbench_q22/duckdb:vortex-file-compressed 562814052 / 565250552 / -0.4% 951803627 / 973828785 / -2.3% 0.59 / 0.58 / +1.9%
clickbench_q23/duckdb:vortex-file-compressed 124665800 / 130888105 / -4.8% 238295012 / 233577583 / +2.0% 0.52 / 0.56 / -6.6%
clickbench_q24/duckdb:vortex-file-compressed 40139876 / 41487142 / -3.2% 94988363 / 94695712 / +0.3% 0.42 / 0.44 / -3.5%
clickbench_q25/duckdb:vortex-file-compressed 64006737 / 62825269 / +1.9% 144208281 / 142659373 / +1.1% 0.44 / 0.44 / +0.8%
clickbench_q26/duckdb:vortex-file-compressed 37231713 / 37216011 / +0.0% 94772741 / 91779384 / +3.3% 0.39 / 0.41 / -3.1%
clickbench_q27/duckdb:vortex-file-compressed 251774982 / 243300310 / +3.5% 512704521 / 518775148 / -1.2% 0.49 / 0.47 / +4.7%
clickbench_q28/duckdb:vortex-file-compressed 1351069829 / 1230080651 / +9.8% 1479053188 / 1514274329 / -2.3% 0.91 / 0.81 / +12.5%
clickbench_q29/duckdb:vortex-file-compressed 30995719 / 30941324 / +0.2% 113198859 / 106221408 / +6.6% 0.27 / 0.29 / -6.0%
clickbench_q30/duckdb:vortex-file-compressed 171937454 / 170569738 / +0.8% 282348122 / 289120689 / -2.3% 0.61 / 0.59 / +3.2%
clickbench_q31/duckdb:vortex-file-compressed 308175459 / 311996315 / -1.2% 439033963 / 501488811 / -12.5% 🟢 0.70 / 0.62 / +12.8%
clickbench_q32/duckdb:vortex-file-compressed 934294840 / 914690345 / +2.1% 1084764313 / 1065164878 / +1.8% 0.86 / 0.86 / +0.3%
clickbench_q33/duckdb:vortex-file-compressed 1058539114 / 1039162456 / +1.9% 1280773783 / 1286379494 / -0.4% 0.83 / 0.81 / +2.3%
clickbench_q34/duckdb:vortex-file-compressed 1074356497 / 1087086734 / -1.2% 1346014491 / 1363477652 / -1.3% 0.80 / 0.80 / +0.1%
clickbench_q35/duckdb:vortex-file-compressed 209707400 / 213255472 / -1.7% 301266693 / 288716305 / +4.3% 0.70 / 0.74 / -5.8%
clickbench_q36/duckdb:vortex-file-compressed 30120394 / 29326868 / +2.7% 104332600 / 92455342 / +12.8% 🔴 0.29 / 0.32 / -9.0%
clickbench_q37/duckdb:vortex-file-compressed 19137642 / 19901832 / -3.8% 91798419 / 104457753 / -12.1% 🟢 0.21 / 0.19 / +9.4%
clickbench_q38/duckdb:vortex-file-compressed 22305018 / 25248658 / -11.7% 🟢 114309334 / 96493776 / +18.5% 🔴 0.20 / 0.26 / -25.4%
clickbench_q39/duckdb:vortex-file-compressed 49139186 / 46992894 / +4.6% 130635093 / 135658920 / -3.7% 0.38 / 0.35 / +8.6%
clickbench_q40/duckdb:vortex-file-compressed 16896741 / 17006814 / -0.6% 90821035 / 97607783 / -7.0% 0.19 / 0.17 / +6.8%
clickbench_q41/duckdb:vortex-file-compressed 18412012 / 18303418 / +0.6% 92119326 / 93091931 / -1.0% 0.20 / 0.20 / +1.7%
clickbench_q42/duckdb:vortex-file-compressed 18859444 / 18357072 / +2.7% 76875165 / 88538498 / -13.2% 🟢 0.25 / 0.21 / +18.3%
duckdb / parquet / ns (0.985x ➖, 1↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:parquet 14203193 / 16170832 / -12.2% 🟢 41485096 / 43246159 / -4.1% 0.34 / 0.37 / -8.4%
clickbench_q01/duckdb:parquet 16176078 / 17168458 / -5.8% 35794652 / 35856206 / -0.2% 0.45 / 0.48 / -5.6%
clickbench_q02/duckdb:parquet 25146246 / 26013736 / -3.3% 57573457 / 57374440 / +0.3% 0.44 / 0.45 / -3.7%
clickbench_q03/duckdb:parquet 31639798 / 32053384 / -1.3% 92235811 / 92068133 / +0.2% 0.34 / 0.35 / -1.5%
clickbench_q04/duckdb:parquet 131399900 / 135322900 / -2.9% 187092016 / 195478135 / -4.3% 0.70 / 0.69 / +1.5%
clickbench_q05/duckdb:parquet 196155077 / 207451657 / -5.4% 256931801 / 257641450 / -0.3% 0.76 / 0.81 / -5.2%
clickbench_q06/duckdb:parquet 24645527 / 24435896 / +0.9% 47017408 / 48447519 / -3.0% 0.52 / 0.50 / +3.9%
clickbench_q07/duckdb:parquet 20091695 / 20228396 / -0.7% 40829107 / 42946738 / -4.9% 0.49 / 0.47 / +4.5%
clickbench_q08/duckdb:parquet 168738638 / 174497460 / -3.3% 253545515 / 252160084 / +0.5% 0.67 / 0.69 / -3.8%
clickbench_q09/duckdb:parquet 230820270 / 228358300 / +1.1% 320791895 / 317253883 / +1.1% 0.72 / 0.72 / -0.0%
clickbench_q10/duckdb:parquet 64296442 / 64519415 / -0.3% 116411088 / 115449666 / +0.8% 0.55 / 0.56 / -1.2%
clickbench_q11/duckdb:parquet 66945698 / 69919008 / -4.3% 132831987 / 133606657 / -0.6% 0.50 / 0.52 / -3.7%
clickbench_q12/duckdb:parquet 175279540 / 181355667 / -3.4% 269938346 / 274262281 / -1.6% 0.65 / 0.66 / -1.8%
clickbench_q13/duckdb:parquet 312925168 / 308183362 / +1.5% 418891359 / 429196747 / -2.4% 0.75 / 0.72 / +4.0%
clickbench_q14/duckdb:parquet 191586468 / 198730576 / -3.6% 307560518 / 294409786 / +4.5% 0.62 / 0.68 / -7.7%
clickbench_q15/duckdb:parquet 185414328 / 190369906 / -2.6% 228352581 / 232709157 / -1.9% 0.81 / 0.82 / -0.7%
clickbench_q16/duckdb:parquet 352062657 / 352436850 / -0.1% 475068757 / 467032356 / +1.7% 0.74 / 0.75 / -1.8%
clickbench_q17/duckdb:parquet 358893537 / 357606262 / +0.4% 471246147 / 469713289 / +0.3% 0.76 / 0.76 / +0.0%
clickbench_q18/duckdb:parquet 680977803 / 698615045 / -2.5% 878461955 / 891147815 / -1.4% 0.78 / 0.78 / -1.1%
clickbench_q19/duckdb:parquet 24112646 / 23389484 / +3.1% 67164451 / 68923024 / -2.6% 0.36 / 0.34 / +5.8%
clickbench_q20/duckdb:parquet 263015629 / 275837900 / -4.6% 450634346 / 456134271 / -1.2% 0.58 / 0.60 / -3.5%
clickbench_q21/duckdb:parquet 318730039 / 329884134 / -3.4% 610344020 / 612469219 / -0.3% 0.52 / 0.54 / -3.0%
clickbench_q22/duckdb:parquet 474237333 / 479769354 / -1.2% 791425837 / 792653177 / -0.2% 0.60 / 0.61 / -1.0%
clickbench_q23/duckdb:parquet 256509204 / 260091020 / -1.4% 302114256 / 330708362 / -8.6% 0.85 / 0.79 / +8.0%
clickbench_q24/duckdb:parquet 79905070 / 71240717 / +12.2% 🔴 119184115 / 112482951 / +6.0% 0.67 / 0.63 / +5.9%
clickbench_q25/duckdb:parquet 76386244 / 74947394 / +1.9% 175988479 / 189142961 / -7.0% 0.43 / 0.40 / +9.5%
clickbench_q26/duckdb:parquet 54659690 / 59773931 / -8.6% 105240879 / 96266747 / +9.3% 0.52 / 0.62 / -16.4%
clickbench_q27/duckdb:parquet 268387610 / 286732831 / -6.4% 516333142 / 522939165 / -1.3% 0.52 / 0.55 / -5.2%
clickbench_q28/duckdb:parquet 1760413353 / 1713490399 / +2.7% 2107595327 / 2123997801 / -0.8% 0.84 / 0.81 / +3.5%
clickbench_q29/duckdb:parquet 29804142 / 28590886 / +4.2% 60930925 / 59887475 / +1.7% 0.49 / 0.48 / +2.5%
clickbench_q30/duckdb:parquet 179617731 / 186430908 / -3.7% 340453214 / 339812615 / +0.2% 0.53 / 0.55 / -3.8%
clickbench_q31/duckdb:parquet 297348470 / 303954920 / -2.2% 614756558 / 582434759 / +5.5% 0.48 / 0.52 / -7.3%
clickbench_q32/duckdb:parquet 904089960 / 912879024 / -1.0% 1076246526 / 1053406540 / +2.2% 0.84 / 0.87 / -3.1%
clickbench_q33/duckdb:parquet 779306386 / 799734728 / -2.6% 1077887608 / 982780614 / +9.7% 0.72 / 0.81 / -11.2%
clickbench_q34/duckdb:parquet 788979638 / 799336279 / -1.3% 1003310927 / 982275664 / +2.1% 0.79 / 0.81 / -3.4%
clickbench_q35/duckdb:parquet 205913642 / 209124260 / -1.5% 252698257 / 241546221 / +4.6% 0.81 / 0.87 / -5.9%
clickbench_q36/duckdb:parquet 52652198 / 49298326 / +6.8% 73342315 / 79942182 / -8.3% 0.72 / 0.62 / +16.4%
clickbench_q37/duckdb:parquet 38201688 / 38492247 / -0.8% 57667714 / 58427944 / -1.3% 0.66 / 0.66 / +0.6%
clickbench_q38/duckdb:parquet 41331447 / 40955330 / +0.9% 57463324 / 61020621 / -5.8% 0.72 / 0.67 / +7.2%
clickbench_q39/duckdb:parquet 88781803 / 91163915 / -2.6% 110411928 / 111542257 / -1.0% 0.80 / 0.82 / -1.6%
clickbench_q40/duckdb:parquet 20281440 / 19727069 / +2.8% 42450420 / 42586074 / -0.3% 0.48 / 0.46 / +3.1%
clickbench_q41/duckdb:parquet 20688160 / 20985082 / -1.4% 41206895 / 43457860 / -5.2% 0.50 / 0.48 / +4.0%
clickbench_q42/duckdb:parquet 23141623 / 24843651 / -6.9% 47042599 / 45835389 / +2.6% 0.49 / 0.54 / -9.2%

No file size changes detected.

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on S3 📖

Commits: PR 4182f555 vs base 8aeeac3a
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -4.0%
Engines: DataFusion No clear signal (-7.7%, environment too noisy confidence) · DuckDB No clear signal (-0.0%, environment too noisy confidence)
Vortex (geomean): hot 0.864x ➖ · cold 0.830x ➖
Parquet (geomean): hot 0.900x ➖ · cold 0.872x ➖
Shifts: Parquet (control) -10.0% · Median polish -11.3%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.818x ➖, 4↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 240016452 / 240242643 / -0.1% 730013374 / 965276472 / -24.4% 0.33 / 0.25 / +32.1%
tpch_q02/datafusion:vortex-file-compressed 383201373 / 342754777 / +11.8% 723182191 / 597881186 / +21.0% 0.53 / 0.57 / -7.6%
tpch_q03/datafusion:vortex-file-compressed 343546920 / 374623191 / -8.3% 905765047 / 1203732368 / -24.8% 0.38 / 0.31 / +21.9%
tpch_q04/datafusion:vortex-file-compressed 166973870 / 205359565 / -18.7% 369272371 / 608849626 / -39.3% 🟢 0.45 / 0.34 / +34.1%
tpch_q05/datafusion:vortex-file-compressed 320344796 / 397377519 / -19.4% 659382488 / 852038548 / -22.6% 0.49 / 0.47 / +4.2%
tpch_q06/datafusion:vortex-file-compressed 246208442 / 330008031 / -25.4% 598436378 / 446003408 / +34.2% 🔴 0.41 / 0.74 / -44.4%
tpch_q07/datafusion:vortex-file-compressed 338741001 / 421588640 / -19.7% 544094951 / 634404805 / -14.2% 0.62 / 0.66 / -6.3%
tpch_q08/datafusion:vortex-file-compressed 436913953 / 498172279 / -12.3% 663129554 / 634314786 / +4.5% 0.66 / 0.79 / -16.1%
tpch_q09/datafusion:vortex-file-compressed 298991199 / 342336771 / -12.7% 469534820 / 573331471 / -18.1% 0.64 / 0.60 / +6.6%
tpch_q10/datafusion:vortex-file-compressed 381398733 / 319698271 / +19.3% 573051715 / 505772436 / +13.3% 0.67 / 0.63 / +5.3%
tpch_q11/datafusion:vortex-file-compressed 335007716 / 578527571 / -42.1% 🟢 468556929 / 554023474 / -15.4% 0.71 / 1.04 / -31.5%
tpch_q12/datafusion:vortex-file-compressed 352149063 / 470929949 / -25.2% 470184423 / 833584611 / -43.6% 🟢 0.75 / 0.56 / +32.6%
tpch_q13/datafusion:vortex-file-compressed 131969700 / 104983713 / +25.7% 359130095 / 415628837 / -13.6% 0.37 / 0.25 / +45.5%
tpch_q14/datafusion:vortex-file-compressed 183673410 / 248935364 / -26.2% 387453551 / 366260122 / +5.8% 0.47 / 0.68 / -30.3%
tpch_q15/datafusion:vortex-file-compressed 299633364 / 511920199 / -41.5% 🟢 530834693 / 957752148 / -44.6% 🟢 0.56 / 0.53 / +5.6%
tpch_q16/datafusion:vortex-file-compressed 155867944 / 181698193 / -14.2% 313024438 / 302286677 / +3.6% 0.50 / 0.60 / -17.2%
tpch_q17/datafusion:vortex-file-compressed 284090063 / 410839541 / -30.9% 🟢 558090417 / 639242342 / -12.7% 0.51 / 0.64 / -20.8%
tpch_q18/datafusion:vortex-file-compressed 263709726 / 519079274 / -49.2% 🟢 484987627 / 648127882 / -25.2% 0.54 / 0.80 / -32.1%
tpch_q19/datafusion:vortex-file-compressed 321707224 / 362921211 / -11.4% 508686142 / 554134362 / -8.2% 0.63 / 0.65 / -3.4%
tpch_q20/datafusion:vortex-file-compressed 299643455 / 368703311 / -18.7% 486093970 / 555500290 / -12.5% 0.62 / 0.66 / -7.1%
tpch_q21/datafusion:vortex-file-compressed 462533773 / 603413340 / -23.3% 638670434 / 748615515 / -14.7% 0.72 / 0.81 / -10.2%
tpch_q22/datafusion:vortex-file-compressed 144085503 / 173937423 / -17.2% 365440626 / 410303539 / -10.9% 0.39 / 0.42 / -7.0%
datafusion / parquet / ns (0.886x ➖, 1↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 221466280 / 253079853 / -12.5% 727019738 / 784815886 / -7.4% 0.30 / 0.32 / -5.5%
tpch_q02/datafusion:parquet 339577273 / 301780670 / +12.5% 620003819 / 616884215 / +0.5% 0.55 / 0.49 / +12.0%
tpch_q03/datafusion:parquet 307903147 / 352734348 / -12.7% 1127006821 / 911675756 / +23.6% 0.27 / 0.39 / -29.4%
tpch_q04/datafusion:parquet 147500776 / 198874810 / -25.8% 375664292 / 794870095 / -52.7% 🟢 0.39 / 0.25 / +56.9%
tpch_q05/datafusion:parquet 390023173 / 405964867 / -3.9% 757561870 / 591692466 / +28.0% 0.51 / 0.69 / -25.0%
tpch_q06/datafusion:parquet 145624867 / 149498974 / -2.6% 266582191 / 323567890 / -17.6% 0.55 / 0.46 / +18.2%
tpch_q07/datafusion:parquet 355523982 / 423033082 / -16.0% 492026936 / 568439665 / -13.4% 0.72 / 0.74 / -2.9%
tpch_q08/datafusion:parquet 643758617 / 467448329 / +37.7% 🔴 781538339 / 674743455 / +15.8% 0.82 / 0.69 / +18.9%
tpch_q09/datafusion:parquet 438968591 / 560761570 / -21.7% 795897282 / 715137329 / +11.3% 0.55 / 0.78 / -29.7%
tpch_q10/datafusion:parquet 398727490 / 467420755 / -14.7% 653527067 / 1431533834 / -54.3% 🟢 0.61 / 0.33 / +86.9%
tpch_q11/datafusion:parquet 269544255 / 274476986 / -1.8% 467192112 / 501002210 / -6.7% 0.58 / 0.55 / +5.3%
tpch_q12/datafusion:parquet 190250071 / 283995371 / -33.0% 🟢 427961688 / 504425884 / -15.2% 0.44 / 0.56 / -21.0%
tpch_q13/datafusion:parquet 467399795 / 519908612 / -10.1% 658474819 / 1044090307 / -36.9% 🟢 0.71 / 0.50 / +42.5%
tpch_q14/datafusion:parquet 179172358 / 221158923 / -19.0% 398415058 / 411909470 / -3.3% 0.45 / 0.54 / -16.2%
tpch_q15/datafusion:parquet 345523379 / 426961497 / -19.1% 484603979 / 978912201 / -50.5% 🟢 0.71 / 0.44 / +63.5%
tpch_q16/datafusion:parquet 126046369 / 151880106 / -17.0% 353664955 / 328915729 / +7.5% 0.36 / 0.46 / -22.8%
tpch_q17/datafusion:parquet 314430775 / 441794339 / -28.8% 713329896 / 572016885 / +24.7% 0.44 / 0.77 / -42.9%
tpch_q18/datafusion:parquet 464722600 / 529395442 / -12.2% 630352056 / 705924690 / -10.7% 0.74 / 0.75 / -1.7%
tpch_q19/datafusion:parquet 218495950 / 244627440 / -10.7% 476747071 / 494789150 / -3.6% 0.46 / 0.49 / -7.3%
tpch_q20/datafusion:parquet 255524783 / 287535047 / -11.1% 473825852 / 573800483 / -17.4% 0.54 / 0.50 / +7.6%
tpch_q21/datafusion:parquet 351521394 / 455950966 / -22.9% 472217721 / 581057413 / -18.7% 0.74 / 0.78 / -5.1%
tpch_q22/datafusion:parquet 226583530 / 184418544 / +22.9% 363248844 / 397889904 / -8.7% 0.62 / 0.46 / +34.6%
duckdb / vortex-file-compressed / ns (0.914x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 209787315 / 212073507 / -1.1% 299949535 / 593454979 / -49.5% 🟢 0.70 / 0.36 / +95.7%
tpch_q02/duckdb:vortex-file-compressed 405430177 / 378496640 / +7.1% 408130636 / 410725873 / -0.6% 0.99 / 0.92 / +7.8%
tpch_q03/duckdb:vortex-file-compressed 411587172 / 448522786 / -8.2% 448178236 / 949420310 / -52.8% 🟢 0.92 / 0.47 / +94.4%
tpch_q04/duckdb:vortex-file-compressed 272611277 / 263769608 / +3.4% 309037221 / 373524801 / -17.3% 0.88 / 0.71 / +24.9%
tpch_q05/duckdb:vortex-file-compressed 380987901 / 466862699 / -18.4% 442059293 / 1016345954 / -56.5% 🟢 0.86 / 0.46 / +87.6%
tpch_q06/duckdb:vortex-file-compressed 258914551 / 279434201 / -7.3% 292889856 / 338561089 / -13.5% 0.88 / 0.83 / +7.1%
tpch_q07/duckdb:vortex-file-compressed 412486482 / 512399260 / -19.5% 483356223 / 638074697 / -24.2% 0.85 / 0.80 / +6.3%
tpch_q08/duckdb:vortex-file-compressed 533552851 / 558335931 / -4.4% 584432062 / 648214779 / -9.8% 0.91 / 0.86 / +6.0%
tpch_q09/duckdb:vortex-file-compressed 497277938 / 485476526 / +2.4% 474361779 / 541783698 / -12.4% 1.05 / 0.90 / +17.0%
tpch_q10/duckdb:vortex-file-compressed 465501650 / 468260898 / -0.6% 522064278 / 630684189 / -17.2% 0.89 / 0.74 / +20.1%
tpch_q11/duckdb:vortex-file-compressed 161238845 / 192172866 / -16.1% 226800094 / 231420847 / -2.0% 0.71 / 0.83 / -14.4%
tpch_q12/duckdb:vortex-file-compressed 417013054 / 454389892 / -8.2% 430722368 / 560390064 / -23.1% 0.97 / 0.81 / +19.4%
tpch_q13/duckdb:vortex-file-compressed 320027471 / 304837947 / +5.0% 411799234 / 379843098 / +8.4% 0.78 / 0.80 / -3.2%
tpch_q14/duckdb:vortex-file-compressed 286378573 / 263033069 / +8.9% 343853855 / 355700009 / -3.3% 0.83 / 0.74 / +12.6%
tpch_q15/duckdb:vortex-file-compressed 159051973 / 178272478 / -10.8% 273177363 / 265660688 / +2.8% 0.58 / 0.67 / -13.2%
tpch_q16/duckdb:vortex-file-compressed 197113161 / 217361654 / -9.3% 186666910 / 226345295 / -17.5% 1.06 / 0.96 / +10.0%
tpch_q17/duckdb:vortex-file-compressed 383635103 / 437373803 / -12.3% 425901093 / 492233878 / -13.5% 0.90 / 0.89 / +1.4%
tpch_q18/duckdb:vortex-file-compressed 338572662 / 334302301 / +1.3% 347302115 / 458707796 / -24.3% 0.97 / 0.73 / +33.8%
tpch_q19/duckdb:vortex-file-compressed 339543732 / 395146724 / -14.1% 387477298 / 341539204 / +13.5% 0.88 / 1.16 / -24.3%
tpch_q20/duckdb:vortex-file-compressed 415582347 / 511749340 / -18.8% 502020859 / 689647595 / -27.2% 0.83 / 0.74 / +11.6%
tpch_q21/duckdb:vortex-file-compressed 688113415 / 1093771808 / -37.1% 🟢 700855796 / 1248597831 / -43.9% 🟢 0.98 / 0.88 / +12.1%
tpch_q22/duckdb:vortex-file-compressed 122139878 / 146869999 / -16.8% 192870967 / 192076682 / +0.4% 0.63 / 0.76 / -17.2%
duckdb / parquet / ns (0.914x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 321743165 / 364592091 / -11.8% 317053158 / 609024695 / -47.9% 🟢 1.01 / 0.60 / +69.5%
tpch_q02/duckdb:parquet 692897660 / 752853554 / -8.0% 660172270 / 891391225 / -25.9% 1.05 / 0.84 / +24.3%
tpch_q03/duckdb:parquet 792986808 / 930867654 / -14.8% 942099947 / 1215916505 / -22.5% 0.84 / 0.77 / +9.9%
tpch_q04/duckdb:parquet 496962322 / 577731161 / -14.0% 557950293 / 544670597 / +2.4% 0.89 / 1.06 / -16.0%
tpch_q05/duckdb:parquet 1104812853 / 1176669919 / -6.1% 1131943900 / 1889003529 / -40.1% 🟢 0.98 / 0.62 / +56.7%
tpch_q06/duckdb:parquet 325554161 / 593467494 / -45.1% 🟢 339814173 / 424077635 / -19.9% 0.96 / 1.40 / -31.5%
tpch_q07/duckdb:parquet 950272661 / 1003962398 / -5.3% 953216358 / 1004951669 / -5.1% 1.00 / 1.00 / -0.2%
tpch_q08/duckdb:parquet 1156006041 / 1265624816 / -8.7% 1478441320 / 1543571485 / -4.2% 0.78 / 0.82 / -4.6%
tpch_q09/duckdb:parquet 1096508264 / 1158448178 / -5.3% 1196813626 / 1180822308 / +1.4% 0.92 / 0.98 / -6.6%
tpch_q10/duckdb:parquet 1156039045 / 1112653938 / +3.9% 1259410760 / 1354170710 / -7.0% 0.92 / 0.82 / +11.7%
tpch_q11/duckdb:parquet 486885347 / 478034931 / +1.9% 530555435 / 540296208 / -1.8% 0.92 / 0.88 / +3.7%
tpch_q12/duckdb:parquet 563303577 / 594567154 / -5.3% 630682139 / 685511889 / -8.0% 0.89 / 0.87 / +3.0%
tpch_q13/duckdb:parquet 895455033 / 867633086 / +3.2% 1602957519 / 1255762952 / +27.6% 0.56 / 0.69 / -19.1%
tpch_q14/duckdb:parquet 524176473 / 615504150 / -14.8% 562715463 / 649838170 / -13.4% 0.93 / 0.95 / -1.7%
tpch_q15/duckdb:parquet 407160224 / 494670260 / -17.7% 356042982 / 513698512 / -30.7% 🟢 1.14 / 0.96 / +18.8%
tpch_q16/duckdb:parquet 526356028 / 590643080 / -10.9% 538808690 / 583221471 / -7.6% 0.98 / 1.01 / -3.5%
tpch_q17/duckdb:parquet 509320233 / 538191022 / -5.4% 508516868 / 561759878 / -9.5% 1.00 / 0.96 / +4.5%
tpch_q18/duckdb:parquet 706293354 / 761909425 / -7.3% 742419168 / 787442907 / -5.7% 0.95 / 0.97 / -1.7%
tpch_q19/duckdb:parquet 621650672 / 707712919 / -12.2% 681877510 / 934245715 / -27.0% 0.91 / 0.76 / +20.3%
tpch_q20/duckdb:parquet 919099811 / 954631880 / -3.7% 946113703 / 1058993300 / -10.7% 0.97 / 0.90 / +7.8%
tpch_q21/duckdb:parquet 777276677 / 853049877 / -8.9% 909728183 / 957709013 / -5.0% 0.85 / 0.89 / -4.1%
tpch_q22/duckdb:parquet 598422462 / 472974820 / +26.5% 545229858 / 469631711 / +16.1% 1.10 / 1.01 / +9.0%

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants