Skip to content

[MSD benchmark] Unified Storage: Init at startup, fix traces, and speed up indexing#10

Open
khaliqgant wants to merge 17 commits into
msd-benchmark-base/grafana/pr-97529from
msd-benchmark/grafana/pr-97529
Open

[MSD benchmark] Unified Storage: Init at startup, fix traces, and speed up indexing#10
khaliqgant wants to merge 17 commits into
msd-benchmark-base/grafana/pr-97529from
msd-benchmark/grafana/pr-97529

Conversation

@khaliqgant

Copy link
Copy Markdown

MSD benchmark PR recreated from Martian Code Review Bench.

Source PR: grafana#97529
Dataset: grafana
Original title: Unified Storage: Init at startup, fix traces, and speed up indexing

Changes:

  • Initializes unified storage when the ResourceServer is created, instead of doing it inside the first gRPC call it receives. This was causing context cancelled errors since the index takes too long to build within the context of the gRPC call.
  • Fixes trace propagation by passing span contexts down.
  • Improves index build speed using finer grain locking when writing the index cache. We were locking the whole BuildIndex function, which was slowing things down when building many namespaces with high concurrency.

Notes for reviewer:

  • Does anything else depend on initializing US lazily? What could this break?

@khaliqgant khaliqgant changed the base branch from main to msd-benchmark-base/grafana/pr-97529 May 15, 2026 14:57
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants