Skip to content

DRAFT Bench 26133 - #26204

Draft
kosiew wants to merge 4 commits into
apache:mainfrom
kosiew:bench-26133
Draft

kosiew wants to merge 4 commits into
apache:mainfrom
kosiew:bench-26133

Conversation

@kosiew

@kosiew kosiew commented Oct 11, 2026 •

Copy link
Copy Markdown
Contributor

DRAFT for running test benchmarks for #26133

kosiew and others added 4 commits October 11, 2026 17:58
- Add a new benchmark `window_sorted_q17_rank_100k_partitions_two_windows` that uses two-window RANK with ROW_NUMBER sibling expression.
- Update template to support `TWO_WINDOWS` flag for projecting both ranks in window function.
- Modify SQL query to include ROW_NUMBER alongside RANK in same window partition.
- Set up expected plan with BoundedWindowAggExec for the new two-window RANK workload.
@github-actions github-actions Bot added optimizer Optimizer rules core Core DataFusion crate sqllogictest SQL Logic Tests (.slt) physical-plan Changes to the physical-plan crate labels Oct 11, 2026
@kosiew

kosiew commented Oct 11, 2026

Copy link
Copy Markdown
Contributor Author

run benchmark h2o_small_window_sorted_parquet

env:
  BENCH_QUERY: 8
baseline:
  ref: 088e8a2379

@kosiew

kosiew commented Oct 11, 2026

Copy link
Copy Markdown
Contributor Author

run benchmark h2o_small_window_sorted_parquet

env:
  BENCH_QUERY: 17
baseline:
  ref: 088e8a2379

@adriangbot

Copy link
Copy Markdown

🤖 Benchmark running (GKE) | trigger
Instance: c4a-highmem-16 (12 vCPU / 65 GiB) | Linux bench-c6107878356-3288-zxmwg 6.12.94+ #1 SMP Fri Aug 21 08:00:16 UTC 2026 aarch64 GNU/Linux

CPU Details (lscpu)
Architecture:                            aarch64
CPU op-mode(s):                          64-bit
Byte Order:                              Little Endian
CPU(s):                                  16
On-line CPU(s) list:                     0-15
Vendor ID:                               ARM
Model name:                              Neoverse-V2
Model:                                   1
Thread(s) per core:                      1
Core(s) per cluster:                     16
Socket(s):                               -
Cluster(s):                              1
Stepping:                                r0p1
BogoMIPS:                                2000.00
Flags:                                   fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti
L1d cache:                               1 MiB (16 instances)
L1i cache:                               1 MiB (16 instances)
L2 cache:                                32 MiB (16 instances)
L3 cache:                                80 MiB (1 instance)
NUMA node(s):                            1
NUMA node0 CPU(s):                       0-15
Vulnerability Gather data sampling:      Not affected
Vulnerability Indirect target selection: Not affected
Vulnerability Itlb multihit:             Not affected
Vulnerability L1tf:                      Not affected
Vulnerability Mds:                       Not affected
Vulnerability Meltdown:                  Not affected
Vulnerability Mmio stale data:           Not affected
Vulnerability Reg file data sampling:    Not affected
Vulnerability Retbleed:                  Not affected
Vulnerability Spec rstack overflow:      Not affected
Vulnerability Spec store bypass:         Mitigation; Speculative Store Bypass disabled via prctl
Vulnerability Spectre v1:                Mitigation; __user pointer sanitization
Vulnerability Spectre v2:                Mitigation; CSV2, BHB
Vulnerability Srbds:                     Not affected
Vulnerability Tsa:                       Not affected
Vulnerability Tsx async abort:           Not affected
Vulnerability Vmscape:                   Not affected

Comparing bench-26133 (be6c26e) to 088e8a2 diff

Run configuration
run benchmark h2o_small_window_sorted_parquet
env:
  BENCH_QUERY: "17"
baseline:
  ref: "088e8a2379"

Results will be posted here when complete


File an issue against this benchmark runner

@adriangbot

Copy link
Copy Markdown

🤖 Benchmark running (GKE) | trigger
Instance: c4a-highmem-16 (12 vCPU / 65 GiB) | Linux bench-c6107875634-3287-vm46k 6.12.94+ #1 SMP Fri Aug 21 08:00:16 UTC 2026 aarch64 GNU/Linux

CPU Details (lscpu)
Architecture:                            aarch64
CPU op-mode(s):                          64-bit
Byte Order:                              Little Endian
CPU(s):                                  16
On-line CPU(s) list:                     0-15
Vendor ID:                               ARM
Model name:                              Neoverse-V2
Model:                                   1
Thread(s) per core:                      1
Core(s) per cluster:                     16
Socket(s):                               -
Cluster(s):                              1
Stepping:                                r0p1
BogoMIPS:                                2000.00
Flags:                                   fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti
L1d cache:                               1 MiB (16 instances)
L1i cache:                               1 MiB (16 instances)
L2 cache:                                32 MiB (16 instances)
L3 cache:                                80 MiB (1 instance)
NUMA node(s):                            1
NUMA node0 CPU(s):                       0-15
Vulnerability Gather data sampling:      Not affected
Vulnerability Indirect target selection: Not affected
Vulnerability Itlb multihit:             Not affected
Vulnerability L1tf:                      Not affected
Vulnerability Mds:                       Not affected
Vulnerability Meltdown:                  Not affected
Vulnerability Mmio stale data:           Not affected
Vulnerability Reg file data sampling:    Not affected
Vulnerability Retbleed:                  Not affected
Vulnerability Spec rstack overflow:      Not affected
Vulnerability Spec store bypass:         Mitigation; Speculative Store Bypass disabled via prctl
Vulnerability Spectre v1:                Mitigation; __user pointer sanitization
Vulnerability Spectre v2:                Mitigation; CSV2, BHB
Vulnerability Srbds:                     Not affected
Vulnerability Tsa:                       Not affected
Vulnerability Tsx async abort:           Not affected
Vulnerability Vmscape:                   Not affected

Comparing bench-26133 (be6c26e) to 088e8a2 diff

Run configuration
run benchmark h2o_small_window_sorted_parquet
env:
  BENCH_QUERY: "8"
baseline:
  ref: "088e8a2379"

Results will be posted here when complete


File an issue against this benchmark runner

@adriangbot

Copy link
Copy Markdown

Benchmark for this request failed before finishing (Kubernetes reason: BackoffLimitExceeded).

Benchmarks requested: h2o_small_window_sorted_parquet

Runner log (last 40 lines)
   Compiling prost v0.14.4
   Compiling datafusion-proto-common v55.1.0 (/workspace/datafusion-base/datafusion/proto-common)
   Compiling datafusion-proto-models v55.1.0 (/workspace/datafusion-base/datafusion/proto-models)
   Compiling datafusion-physical-expr-common v55.1.0 (/workspace/datafusion-base/datafusion/physical-expr-common)
   Compiling datafusion-functions-window-common v55.1.0 (/workspace/datafusion-base/datafusion/functions-window-common)
   Compiling datafusion-functions-aggregate-common v55.1.0 (/workspace/datafusion-base/datafusion/functions-aggregate-common)
   Compiling datafusion-expr v55.1.0 (/workspace/datafusion-base/datafusion/expr)
   Compiling datafusion-physical-expr v55.1.0 (/workspace/datafusion-base/datafusion/physical-expr)
   Compiling datafusion-execution v55.1.0 (/workspace/datafusion-base/datafusion/execution)
   Compiling datafusion-functions v55.1.0 (/workspace/datafusion-base/datafusion/functions)
   Compiling datafusion-functions-aggregate v55.1.0 (/workspace/datafusion-base/datafusion/functions-aggregate)
   Compiling datafusion-optimizer v55.1.0 (/workspace/datafusion-base/datafusion/optimizer)
   Compiling datafusion-functions-window v55.1.0 (/workspace/datafusion-base/datafusion/functions-window)
   Compiling datafusion-physical-plan v55.1.0 (/workspace/datafusion-base/datafusion/physical-plan)
   Compiling datafusion-physical-expr-adapter v55.1.0 (/workspace/datafusion-base/datafusion/physical-expr-adapter)
   Compiling datafusion-functions-nested v55.1.0 (/workspace/datafusion-base/datafusion/functions-nested)
   Compiling datafusion-sql v55.1.0 (/workspace/datafusion-base/datafusion/sql)
   Compiling datafusion-session v55.1.0 (/workspace/datafusion-base/datafusion/session)
   Compiling datafusion-datasource v55.1.0 (/workspace/datafusion-base/datafusion/datasource)
   Compiling datafusion-catalog v55.1.0 (/workspace/datafusion-base/datafusion/catalog)
   Compiling datafusion-pruning v55.1.0 (/workspace/datafusion-base/datafusion/pruning)
   Compiling datafusion-datasource-csv v55.1.0 (/workspace/datafusion-base/datafusion/datasource-csv)
   Compiling datafusion-datasource-arrow v55.1.0 (/workspace/datafusion-base/datafusion/datasource-arrow)
   Compiling datafusion-datasource-json v55.1.0 (/workspace/datafusion-base/datafusion/datasource-json)
   Compiling datafusion-datasource-parquet v55.1.0 (/workspace/datafusion-base/datafusion/datasource-parquet)
   Compiling datafusion-physical-optimizer v55.1.0 (/workspace/datafusion-base/datafusion/physical-optimizer)
   Compiling datafusion-catalog-listing v55.1.0 (/workspace/datafusion-base/datafusion/catalog-listing)
   Compiling datafusion-functions-table v55.1.0 (/workspace/datafusion-base/datafusion/functions-table)
   Compiling datafusion v55.1.0 (/workspace/datafusion-base/datafusion/core)
   Compiling datafusion-proto v55.1.0 (/workspace/datafusion-base/datafusion/proto)
   Compiling datafusion-benchmarks v55.1.0 (/workspace/datafusion-base/benchmarks)
    Finished `bench` profile [optimized] target(s) in 10m 16s
     Running benches/sql.rs (/workspace/datafusion-base/target/release/deps/sql-398528ee5ddd94cb)
Gnuplot not found, using plotters backend

thread 'main' (14133) panicked at benchmarks/benches/sql.rs:55:27:
failed to run SQL benchmarks: Plan("No files found at file:///workspace/datafusion-base/benchmarks/data/h2o/J1_1e7_1e7_NA.parquet. Cannot infer schema from an empty location; either add data files or declare an explicit schema for the table.")
note: run with `RUST_BACKTRACE=1` environment variable to display a backtrace
error: bench failed, to rerun pass `--bench sql`
Kubernetes message
Job has reached the specified backoff limit

File an issue against this benchmark runner

@adriangbot

Copy link
Copy Markdown

Benchmark for this request failed before finishing (Kubernetes reason: BackoffLimitExceeded).

Benchmarks requested: h2o_small_window_sorted_parquet

Runner log (last 40 lines)
   Compiling prost v0.14.4
   Compiling datafusion-proto-common v55.1.0 (/workspace/datafusion-base/datafusion/proto-common)
   Compiling datafusion-proto-models v55.1.0 (/workspace/datafusion-base/datafusion/proto-models)
   Compiling datafusion-physical-expr-common v55.1.0 (/workspace/datafusion-base/datafusion/physical-expr-common)
   Compiling datafusion-functions-aggregate-common v55.1.0 (/workspace/datafusion-base/datafusion/functions-aggregate-common)
   Compiling datafusion-functions-window-common v55.1.0 (/workspace/datafusion-base/datafusion/functions-window-common)
   Compiling datafusion-expr v55.1.0 (/workspace/datafusion-base/datafusion/expr)
   Compiling datafusion-physical-expr v55.1.0 (/workspace/datafusion-base/datafusion/physical-expr)
   Compiling datafusion-execution v55.1.0 (/workspace/datafusion-base/datafusion/execution)
   Compiling datafusion-functions v55.1.0 (/workspace/datafusion-base/datafusion/functions)
   Compiling datafusion-physical-plan v55.1.0 (/workspace/datafusion-base/datafusion/physical-plan)
   Compiling datafusion-physical-expr-adapter v55.1.0 (/workspace/datafusion-base/datafusion/physical-expr-adapter)
   Compiling datafusion-functions-aggregate v55.1.0 (/workspace/datafusion-base/datafusion/functions-aggregate)
   Compiling datafusion-functions-window v55.1.0 (/workspace/datafusion-base/datafusion/functions-window)
   Compiling datafusion-optimizer v55.1.0 (/workspace/datafusion-base/datafusion/optimizer)
   Compiling datafusion-functions-nested v55.1.0 (/workspace/datafusion-base/datafusion/functions-nested)
   Compiling datafusion-sql v55.1.0 (/workspace/datafusion-base/datafusion/sql)
   Compiling datafusion-session v55.1.0 (/workspace/datafusion-base/datafusion/session)
   Compiling datafusion-datasource v55.1.0 (/workspace/datafusion-base/datafusion/datasource)
   Compiling datafusion-pruning v55.1.0 (/workspace/datafusion-base/datafusion/pruning)
   Compiling datafusion-catalog v55.1.0 (/workspace/datafusion-base/datafusion/catalog)
   Compiling datafusion-datasource-arrow v55.1.0 (/workspace/datafusion-base/datafusion/datasource-arrow)
   Compiling datafusion-datasource-json v55.1.0 (/workspace/datafusion-base/datafusion/datasource-json)
   Compiling datafusion-datasource-csv v55.1.0 (/workspace/datafusion-base/datafusion/datasource-csv)
   Compiling datafusion-datasource-parquet v55.1.0 (/workspace/datafusion-base/datafusion/datasource-parquet)
   Compiling datafusion-physical-optimizer v55.1.0 (/workspace/datafusion-base/datafusion/physical-optimizer)
   Compiling datafusion-catalog-listing v55.1.0 (/workspace/datafusion-base/datafusion/catalog-listing)
   Compiling datafusion-functions-table v55.1.0 (/workspace/datafusion-base/datafusion/functions-table)
   Compiling datafusion v55.1.0 (/workspace/datafusion-base/datafusion/core)
   Compiling datafusion-proto v55.1.0 (/workspace/datafusion-base/datafusion/proto)
   Compiling datafusion-benchmarks v55.1.0 (/workspace/datafusion-base/benchmarks)
    Finished `bench` profile [optimized] target(s) in 10m 22s
     Running benches/sql.rs (/workspace/datafusion-base/target/release/deps/sql-398528ee5ddd94cb)
Gnuplot not found, using plotters backend

thread 'main' (14089) panicked at benchmarks/benches/sql.rs:55:27:
failed to run SQL benchmarks: Plan("No files found at file:///workspace/datafusion-base/benchmarks/data/h2o/J1_1e7_1e7_NA.parquet. Cannot infer schema from an empty location; either add data files or declare an explicit schema for the table.")
note: run with `RUST_BACKTRACE=1` environment variable to display a backtrace
error: bench failed, to rerun pass `--bench sql`
Kubernetes message
Job has reached the specified backoff limit

File an issue against this benchmark runner

@codecov-commenter

Copy link
Copy Markdown

Codecov Report

❌ Patch coverage is 87.86828% with 70 lines in your changes missing coverage. Please review.
✅ Project coverage is 82.81%. Comparing base (75ddead) to head (be6c26e).

Files with missing lines Patch % Lines
datafusion/physical-plan/src/topk/mod.rs 89.84% 6 Missing and 33 partials ⚠️
...fusion/physical-plan/src/sorts/partitioned_topk.rs 83.97% 9 Missing and 20 partials ⚠️
datafusion/physical-optimizer/src/window_topn.rs 83.33% 0 Missing and 2 partials ⚠️
Additional details and impacted files
@@           Coverage Diff            @@
##             main   #26204    +/-   ##
========================================
  Coverage   82.80%   82.81%            
========================================
  Files        1149     1149            
  Lines      452205   452650   +445     
  Branches   452205   452650   +445     
========================================
+ Hits       374458   374842   +384     
- Misses      54950    54965    +15     
- Partials    22797    22843    +46     

☔ View full report in Codecov by Harness.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
  • 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

@kosiew

kosiew commented Oct 11, 2026

Copy link
Copy Markdown
Contributor Author

run benchmark h2o_small_window_sorted_parquet

env:
  BENCH_QUERY: 8
  DATA_DIR: /workspace/datafusion-bench/benchmarks/data
baseline:
  ref: 088e8a2379

@kosiew

kosiew commented Oct 11, 2026

Copy link
Copy Markdown
Contributor Author

run benchmark h2o_small_window_sorted_parquet

env:
  BENCH_QUERY: 17
  DATA_DIR: /workspace/datafusion-bench/benchmarks/data
baseline:
  ref: 088e8a2379

@adriangbot

Copy link
Copy Markdown

🤖 Benchmark running (GKE) | trigger
Instance: c4a-highmem-16 (12 vCPU / 65 GiB) | Linux bench-c6108136734-3289-zsh89 6.12.94+ #1 SMP Fri Aug 21 08:00:16 UTC 2026 aarch64 GNU/Linux

CPU Details (lscpu)
Architecture:                            aarch64
CPU op-mode(s):                          64-bit
Byte Order:                              Little Endian
CPU(s):                                  16
On-line CPU(s) list:                     0-15
Vendor ID:                               ARM
Model name:                              Neoverse-V2
Model:                                   1
Thread(s) per core:                      1
Core(s) per cluster:                     16
Socket(s):                               -
Cluster(s):                              1
Stepping:                                r0p1
BogoMIPS:                                2000.00
Flags:                                   fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti
L1d cache:                               1 MiB (16 instances)
L1i cache:                               1 MiB (16 instances)
L2 cache:                                32 MiB (16 instances)
L3 cache:                                80 MiB (1 instance)
NUMA node(s):                            1
NUMA node0 CPU(s):                       0-15
Vulnerability Gather data sampling:      Not affected
Vulnerability Indirect target selection: Not affected
Vulnerability Itlb multihit:             Not affected
Vulnerability L1tf:                      Not affected
Vulnerability Mds:                       Not affected
Vulnerability Meltdown:                  Not affected
Vulnerability Mmio stale data:           Not affected
Vulnerability Reg file data sampling:    Not affected
Vulnerability Retbleed:                  Not affected
Vulnerability Spec rstack overflow:      Not affected
Vulnerability Spec store bypass:         Mitigation; Speculative Store Bypass disabled via prctl
Vulnerability Spectre v1:                Mitigation; __user pointer sanitization
Vulnerability Spectre v2:                Mitigation; CSV2, BHB
Vulnerability Srbds:                     Not affected
Vulnerability Tsa:                       Not affected
Vulnerability Tsx async abort:           Not affected
Vulnerability Vmscape:                   Not affected

Comparing bench-26133 (be6c26e) to 088e8a2 diff

Run configuration
run benchmark h2o_small_window_sorted_parquet
env:
  BENCH_QUERY: "8"
  DATA_DIR: "/workspace/datafusion-bench/benchmarks/data"
baseline:
  ref: "088e8a2379"

Results will be posted here when complete


File an issue against this benchmark runner

@adriangbot

Copy link
Copy Markdown

🤖 Benchmark running (GKE) | trigger
Instance: c4a-highmem-16 (12 vCPU / 65 GiB) | Linux bench-c6108139366-3290-xwgck 6.12.94+ #1 SMP Fri Aug 21 08:00:16 UTC 2026 aarch64 GNU/Linux

CPU Details (lscpu)
Architecture:                            aarch64
CPU op-mode(s):                          64-bit
Byte Order:                              Little Endian
CPU(s):                                  16
On-line CPU(s) list:                     0-15
Vendor ID:                               ARM
Model name:                              Neoverse-V2
Model:                                   1
Thread(s) per core:                      1
Core(s) per cluster:                     16
Socket(s):                               -
Cluster(s):                              1
Stepping:                                r0p1
BogoMIPS:                                2000.00
Flags:                                   fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti
L1d cache:                               1 MiB (16 instances)
L1i cache:                               1 MiB (16 instances)
L2 cache:                                32 MiB (16 instances)
L3 cache:                                80 MiB (1 instance)
NUMA node(s):                            1
NUMA node0 CPU(s):                       0-15
Vulnerability Gather data sampling:      Not affected
Vulnerability Indirect target selection: Not affected
Vulnerability Itlb multihit:             Not affected
Vulnerability L1tf:                      Not affected
Vulnerability Mds:                       Not affected
Vulnerability Meltdown:                  Not affected
Vulnerability Mmio stale data:           Not affected
Vulnerability Reg file data sampling:    Not affected
Vulnerability Retbleed:                  Not affected
Vulnerability Spec rstack overflow:      Not affected
Vulnerability Spec store bypass:         Mitigation; Speculative Store Bypass disabled via prctl
Vulnerability Spectre v1:                Mitigation; __user pointer sanitization
Vulnerability Spectre v2:                Mitigation; CSV2, BHB
Vulnerability Srbds:                     Not affected
Vulnerability Tsa:                       Not affected
Vulnerability Tsx async abort:           Not affected
Vulnerability Vmscape:                   Not affected

Comparing bench-26133 (be6c26e) to 088e8a2 diff

Run configuration
run benchmark h2o_small_window_sorted_parquet
env:
  BENCH_QUERY: "17"
  DATA_DIR: "/workspace/datafusion-bench/benchmarks/data"
baseline:
  ref: "088e8a2379"

Results will be posted here when complete


File an issue against this benchmark runner

@adriangbot

Copy link
Copy Markdown

🤖 Benchmark completed (GKE) | trigger

Instance: c4a-highmem-16 (12 vCPU / 65 GiB)

Comparing bench-26133 (be6c26e) to 088e8a2 diff

Run configuration
run benchmark h2o_small_window_sorted_parquet
env:
  BENCH_QUERY: "8"
  DATA_DIR: "/workspace/datafusion-bench/benchmarks/data"
baseline:
  ref: "088e8a2379"
CPU Details (lscpu)
Architecture:                            aarch64
CPU op-mode(s):                          64-bit
Byte Order:                              Little Endian
CPU(s):                                  16
On-line CPU(s) list:                     0-15
Vendor ID:                               ARM
Model name:                              Neoverse-V2
Model:                                   1
Thread(s) per core:                      1
Core(s) per cluster:                     16
Socket(s):                               -
Cluster(s):                              1
Stepping:                                r0p1
BogoMIPS:                                2000.00
Flags:                                   fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti
L1d cache:                               1 MiB (16 instances)
L1i cache:                               1 MiB (16 instances)
L2 cache:                                32 MiB (16 instances)
L3 cache:                                80 MiB (1 instance)
NUMA node(s):                            1
NUMA node0 CPU(s):                       0-15
Vulnerability Gather data sampling:      Not affected
Vulnerability Indirect target selection: Not affected
Vulnerability Itlb multihit:             Not affected
Vulnerability L1tf:                      Not affected
Vulnerability Mds:                       Not affected
Vulnerability Meltdown:                  Not affected
Vulnerability Mmio stale data:           Not affected
Vulnerability Reg file data sampling:    Not affected
Vulnerability Retbleed:                  Not affected
Vulnerability Spec rstack overflow:      Not affected
Vulnerability Spec store bypass:         Mitigation; Speculative Store Bypass disabled via prctl
Vulnerability Spectre v1:                Mitigation; __user pointer sanitization
Vulnerability Spectre v2:                Mitigation; CSV2, BHB
Vulnerability Srbds:                     Not affected
Vulnerability Tsa:                       Not affected
Vulnerability Tsx async abort:           Not affected
Vulnerability Vmscape:                   Not affected
Details

group                                                       HEAD                                   bench-26133
-----                                                       ----                                   -----------
h2o/window_sorted_q08_rank_100k_partitions_window_sorted    1.73     63.3±0.77ms        ? ?/sec    1.00     36.6±2.57ms        ? ?/sec

Resource Usage

h2o_small_window_sorted_parquet — base (merge-base)

Metric Value
Wall time 340.2s
Peak memory 844.4 MiB
Avg memory 23.5 MiB
CPU user 96.2s
CPU sys 3.1s
Peak spill 0 B

h2o_small_window_sorted_parquet — branch

Metric Value
Wall time 640.3s
Peak memory 714.8 MiB
Avg memory 12.1 MiB
CPU user 94.8s
CPU sys 6.1s
Peak spill 0 B

File an issue against this benchmark runner

@adriangbot

Copy link
Copy Markdown

🤖 Benchmark completed (GKE) | trigger

Instance: c4a-highmem-16 (12 vCPU / 65 GiB)

Comparing bench-26133 (be6c26e) to 088e8a2 diff

Run configuration
run benchmark h2o_small_window_sorted_parquet
env:
  BENCH_QUERY: "17"
  DATA_DIR: "/workspace/datafusion-bench/benchmarks/data"
baseline:
  ref: "088e8a2379"
CPU Details (lscpu)
Architecture:                            aarch64
CPU op-mode(s):                          64-bit
Byte Order:                              Little Endian
CPU(s):                                  16
On-line CPU(s) list:                     0-15
Vendor ID:                               ARM
Model name:                              Neoverse-V2
Model:                                   1
Thread(s) per core:                      1
Core(s) per cluster:                     16
Socket(s):                               -
Cluster(s):                              1
Stepping:                                r0p1
BogoMIPS:                                2000.00
Flags:                                   fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti
L1d cache:                               1 MiB (16 instances)
L1i cache:                               1 MiB (16 instances)
L2 cache:                                32 MiB (16 instances)
L3 cache:                                80 MiB (1 instance)
NUMA node(s):                            1
NUMA node0 CPU(s):                       0-15
Vulnerability Gather data sampling:      Not affected
Vulnerability Indirect target selection: Not affected
Vulnerability Itlb multihit:             Not affected
Vulnerability L1tf:                      Not affected
Vulnerability Mds:                       Not affected
Vulnerability Meltdown:                  Not affected
Vulnerability Mmio stale data:           Not affected
Vulnerability Reg file data sampling:    Not affected
Vulnerability Retbleed:                  Not affected
Vulnerability Spec rstack overflow:      Not affected
Vulnerability Spec store bypass:         Mitigation; Speculative Store Bypass disabled via prctl
Vulnerability Spectre v1:                Mitigation; __user pointer sanitization
Vulnerability Spectre v2:                Mitigation; CSV2, BHB
Vulnerability Srbds:                     Not affected
Vulnerability Tsa:                       Not affected
Vulnerability Tsx async abort:           Not affected
Vulnerability Vmscape:                   Not affected
Details

group                                                                   HEAD                                   bench-26133
-----                                                                   ----                                   -----------
h2o/window_sorted_q17_rank_100k_partitions_two_windows_window_sorted    1.00     68.8±1.21ms        ? ?/sec    1.00     68.9±1.17ms        ? ?/sec

Resource Usage

h2o_small_window_sorted_parquet — base (merge-base)

Metric Value
Wall time 335.2s
Peak memory 1.1 GiB
Avg memory 24.0 MiB
CPU user 99.6s
CPU sys 3.2s
Peak spill 0 B

h2o_small_window_sorted_parquet — branch

Metric Value
Wall time 605.2s
Peak memory 698.0 MiB
Avg memory 13.1 MiB
CPU user 103.0s
CPU sys 3.2s
Peak spill 0 B

File an issue against this benchmark runner

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

core Core DataFusion crate optimizer Optimizer rules physical-plan Changes to the physical-plan crate sqllogictest SQL Logic Tests (.slt)

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants