Skip to content

Test PR for on-demand benchmark workflow#7

Open
roshkhatri wants to merge 2 commits into
unstablefrom
test-benchmark-workflow
Open

Test PR for on-demand benchmark workflow#7
roshkhatri wants to merge 2 commits into
unstablefrom
test-benchmark-workflow

Conversation

@roshkhatri

Copy link
Copy Markdown
Owner

Dummy PR to test the on-demand benchmark workflow.

@github-actions

github-actions Bot commented Apr 1, 2026

Copy link
Copy Markdown

On-Demand Benchmark ran on commit: 9fa74f0
Commands: SET
Runs: 3 | Workflow Run

RPS Benchmark Comparison: unstable vs d798669

No significant changes

No statistically significant changes detected across 1 test(s).

1 with no significant change

Click to expand full comparison tables
% Change Test unstable d798669 unstable stats d798669 stats
-2±3% SET rps P1 T1 146K 143K n=3, σ=3.65K, CV=2.5%, CI99%=±14.3%, PI99%=±28.6% n=3, σ=2.79K, CV=2.0%, CI99%=±11.2%, PI99%=±22.4%

Configuration:

  • architecture: x86_64
  • benchmark_mode: duration
  • clients: 50
  • cluster_mode: False
  • data_size: 16
  • duration: 10
  • tls: False
  • valkey_benchmark_threads: 2
  • warmup: 2

Legend:

  • Test column: Command, metric, P=pipeline depth, T=io-threads
  • Significance: ✅ significant improvement, ❌ significant regression, ➖ not significant, ❔ insufficient data

Statistical Notes:

  • CV: Coefficient of Variation - relative variability (σ/μ × 100%)
  • CI99%: 99% Confidence Interval - range where the true population mean is likely to fall
  • PI99%: 99% Prediction Interval - range where a single future observation is likely to fall

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant