Skip to content

Support regex pattern matching for metric thresholds#171

Merged
Andrew-Dame merged 4 commits into
mainfrom
metric-regex
May 12, 2026
Merged

Support regex pattern matching for metric thresholds#171
Andrew-Dame merged 4 commits into
mainfrom
metric-regex

Conversation

@Andrew-Dame
Copy link
Copy Markdown
Contributor

Adds regex pattern matching for metric names to dynamically discover and track multiple TensorBoard tags from a single config. This eliminates massive boilerplate in large registries like TorchTPU.

@github-actions
Copy link
Copy Markdown

github-actions Bot commented May 9, 2026

Last Updated: 2026-05-12 21:20:22 UTC

A/B Benchmark Results: Benchmark workflow e2e test

e2e_bazel_benchmark_cpu_standard

Metric Baseline
(43b3d0f)
Experiment
(97994b4)
Delta Threshold Status
wall_time (MEAN) 101.0200 101.0200 +0.00% 5% PASS
wall_time (P90) 101.8600 101.8600 +0.00% 5% PASS

Global Status: PASS

Run History

Comment thread benchmarking/tb_parser/tb_parser_lib.py Outdated
Copy link
Copy Markdown

@pganssle-google pganssle-google left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM except for nits. Selecting "Request changes" because GH doesn't seem to have the concept of "Approved with comments"

Comment thread benchmarking/tb_parser/tb_parser_lib.py Outdated
Comment thread python_seed_env/src/seed_env/core.py
Comment thread benchmarking/tb_parser/tb_parser_lib.py
Comment thread benchmarking/tb_parser/tb_parser_lib.py Outdated
@Andrew-Dame Andrew-Dame merged commit 4529fbc into main May 12, 2026
20 checks passed
@Andrew-Dame Andrew-Dame deleted the metric-regex branch May 12, 2026 21:48
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants