Skip to content

server: expose speculative decoding counters in Prometheus metrics#23328

Open
boxcee wants to merge 1 commit into
ggml-org:masterfrom
boxcee:feat/prometheus-spec-metrics
Open

server: expose speculative decoding counters in Prometheus metrics#23328
boxcee wants to merge 1 commit into
ggml-org:masterfrom
boxcee:feat/prometheus-spec-metrics

server: expose speculative decoding counters in Prometheus metrics

122fb87
Select commit
Loading
Failed to load commit list.
Sign in for the full log view