Skip to content

shred: speed up agave harness#542

Merged
mjain-jump merged 1 commit into
agave-v4.1.0-beta.3from
mjain/speed-up-shred
Jun 10, 2026
Merged

shred: speed up agave harness#542
mjain-jump merged 1 commit into
agave-v4.1.0-beta.3from
mjain/speed-up-shred

Conversation

@mjain-jump

Copy link
Copy Markdown
Collaborator

No description provided.

Copilot AI review requested due to automatic review settings June 10, 2026 19:02
cmoyes-jump
cmoyes-jump previously approved these changes Jun 10, 2026

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

This PR targets harness runtime by reducing RocksDB degradation across repeated shred-parse inputs while keeping the same overall shred parsing / FEC recovery flow.

Changes:

  • Add a per-thread input counter and periodically reopen the thread-local Blockstore to avoid accumulating RocksDB tombstones that slow reads over time.
  • Keep the existing per-input purge_slots(..) reset for reused Blockstore instances, but force a full reopen every BLOCKSTORE_REOPEN_EVERY inputs.
  • Bump the pinned firedancer-io/agave git revision across Agave/Solana git dependencies (and corresponding Cargo.lock entries).

Reviewed changes

Copilot reviewed 2 out of 3 changed files in this pull request and generated no comments.

File Description
src/shred.rs Periodically recreates the ephemeral thread-local blockstore to avoid RocksDB slowdowns from accumulated delete markers.
Cargo.toml Updates the Agave git rev for multiple dependencies.
Cargo.lock Updates locked sources to match the new Agave git rev.

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

@mjain-jump mjain-jump force-pushed the mjain/speed-up-shred branch from e513d79 to 2b02c22 Compare June 10, 2026 19:06
@mjain-jump mjain-jump enabled auto-merge (squash) June 10, 2026 19:14
@mjain-jump mjain-jump disabled auto-merge June 10, 2026 19:14
@mjain-jump mjain-jump merged commit e7138b8 into agave-v4.1.0-beta.3 Jun 10, 2026
4 checks passed
@mjain-jump mjain-jump deleted the mjain/speed-up-shred branch June 10, 2026 19:14
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants