Unify producer batching across all read blocks (#400)#401

Merged

spicy-sauce merged 41 commits into

mainfrom

400-producer-batching-unification

May 31, 2026

Commits on Dec 28, 2025

Commits on May 28, 2026

Add design spec for producer batching unification (#400)

spicy-sauce
and
claude
committed
Add implementation plan for producer batching unification (#400)

spicy-sauce
and
claude
committed
Add $inherit schema fragment resolver (#400)
spicy-sauce
committed
Tighten $inherit resolver: reject non-list, guard against nested (#400)
spicy-sauce
committed
Remove unused List import in schema_utils (#400)

spicy-sauce
and
claude
committed
Producer base class re-chunks via produce_chunks (#400)
spicy-sauce
committed
Migrate std/read to produce_chunks (#400, #296)
spicy-sauce
committed
Migrate files/read_csv to produce_chunks (#400)
spicy-sauce
committed
Migrate parquet/read to produce_chunks, fix one-by-one yield (#400, #293)
spicy-sauce
committed
Migrate relational/read to produce_chunks, add fetch_size (#400, #295)

spicy-sauce
and
claude
committed
Migrate http/receiver to produce_chunks (#400)
spicy-sauce
committed
Migrate redis/read_stream to batched xreadgroup (#400, #377)
spicy-sauce
committed
Migrate azure/read_event_hub; rename batch_size -> max_batch_size (#400, BREAKING)
spicy-sauce
committed
Regenerate JSON schemas and reference docs after producer batching (#400)
spicy-sauce
committed
Resolve $inherit before jsonschema2mk so block docs include batch_size (#400)
spicy-sauce
committed
Document producer batching model in processing-strategies (#400)

spicy-sauce
and
claude
committed
Clean up http/receiver test teardown (#400)

spicy-sauce
and
claude
committed
Merge remote-tracking branch 'origin/main' into 400-producer-batching-unification
spicy-sauce
committed
Add docstrings to all methods touched in this PR (#400)

spicy-sauce
and
claude
committed
Fix CI: isort formatting + stdlib-only $inherit resolver in docs script (#400)

spicy-sauce
and
claude
committed
Add azure-eventhub deps to test extras for CI (#400)

spicy-sauce
and
claude
committed
Format superpowers spec and plan with prettier (#400)

spicy-sauce
and
claude
committed
Address Copilot review: propagate source errors + bounded backpressure (#400)

spicy-sauce
and
claude
committed
Add docstrings to all test functions added in this PR (#400)

spicy-sauce
and
claude
committed
Drop meaningless test_max_batch_size_defaults_to_300_when_omitted (#400)

spicy-sauce
and
claude
committed
Drop retrospective implementation plan; keep design spec (#400)

spicy-sauce
and
claude
committed
Switch from custom \$inherit to standard JSON Schema composition (#400)

spicy-sauce
and
claude
committed
Update spec to reflect what shipped (#400)

spicy-sauce
and
claude
committed
Spec: correct Event Hub migration note (#400)

spicy-sauce
and
claude
committed

Commits on May 31, 2026