Skip to content

Releases: google/ml-flashpoint

v0.0.9

Choose a tag to compare

@g-husam g-husam released this 20 May 15:14
97f5c54

Release Notes: v0.0.8 -> 97f5c54


🏆 Features

  • (4bdfa00) adapter/nemo: add keep_mlf_checkpoint_on_train_end flag (#103)

✅ Bug Fixes

  • (9e10862) adapter/nemo: also close alt async calls queue for regular nemo checkpoints (#106)
  • (6e1c211) replication: safely shutdown transfer service (#105)
  • (8962c0b) adapter/nemo: safely call maybe_finalize_save_checkpoint in on_train_end (#104)

♻️ Refactoring

  • (67fbe4a) checkpoint-object-manager: deprecate C++ object_manager layer for lightweight Python subprocess async deletion (#102)

📔 Documentation


Generated with: ./scripts/create_release.py

Full Changelog: v0.0.8...v0.0.9

v0.0.8

Choose a tag to compare

@g-husam g-husam released this 16 Apr 16:39
cf7264e

Release Notes: v0.0.7 -> cf7264e


🏆 Features

  • (cf7264e) adapter/nemo: adapt to NeMo's new CheckpointIO interface and fix metadata persistence (#99)
  • (569d32c) adapter/nemo: cleanup checkpoint container on_train_end (#94)
  • (ec2462a) replication: support single-node execution by disabling replication (#92)
  • (995f6d8) scripts: support ModelCheckpoint.on_train_batch_end in log parser (#86)
  • (e9eb9d6) adapter/nemo: add fully parallel save/load wrapper option (#49)

✅ Bug Fixes

  • (6aa148a) adapter/nemo: Fix buffer pool init when initial_write_buffer_size_bytes is None (#80)

🕐 Performance

  • (ceffdab) adapter/nemo: set use_fully_parallel_wrapper default to True (#93)
  • (17457aa) adapter/nemo: reduce NUM_OF_BUFFERS_PER_OBJECT to 2 to reduce memory pressure (#81)
  • (71217a4) Implement BufferPool for efficient memory reuse (#61)

🔍 Tests

  • (5d0e076) adapter/nemo: ensure None is allowed for skip_every_n_steps in checkpoint_callback (#84)

📔 Documentation

🔃 CI

  • (fe2ca6a) bifurcate nemo2.0 and nemo-rl build profiles, use ci-success aggregate check in build (#91)
  • (bf23474) run build on python 3.12 as well (#87)
  • (8f760ae) fix VERSION extraction from TAG_NAME in cloudbuild.yaml (#85)
  • (cba3c3a) fix $$VERSION env var syntax (#82)
  • (75bf47a) validate TAG_NAME and force the version used for pypi upload (#79)

🔩 Chores

  • (c0b755a) config: exclude .gemini and .worktrees from git, ruff, and pytest (#90)
  • (5ee67ae) scripts: skip first two writes for throughput averaging (#89)

Generated with: ./scripts/create_release.py

New Contributors

Full Changelog: v0.0.7...v0.0.8

v0.0.7

Choose a tag to compare

@g-husam g-husam released this 13 Mar 03:35
e5ce6e4

Release Notes: v0.0.6 -> e5ce6e4


🏆 Features

  • (e5ce6e4) adapter/nemo: Allow initial_write_buffer_size_bytes=None to use default size (#76)
  • (78f20d7) Cache checkpoint saving plan in each local rank. (#60)

🕐 Performance

  • (ae95fb6) adapter/pytorch: offload spawn manager creation to background thread (threading.Thread) (#73)

♻️ Refactoring

  • (984b718) core/loader: abstract torch.distributed APIs in CheckpointLoader (#47)

📔 Documentation

  • (7c653cb) user-guide: document use_optimized_save and use_cached_ckpt_structure (#72)

🔃 CI

  • (dcb28da) remove docker dependency from GCB pipeline (#71)

🔩 Chores

  • (d69def3) Update PULL_REQUEST_TEMPLATE.md to include description of change (#77)

Generated with: ./scripts/create_release.py

Full Changelog: v0.0.6...v0.0.7

v0.0.6

Choose a tag to compare

@g-husam g-husam released this 06 Mar 15:30
ae84f35

What's Changed

Release Notes: v0.0.5 -> ae84f35


🏆 Features

  • (c45592d) buffer_object: Add resize method to BufferIO (#57)

✅ Bug Fixes

  • (219007d) core/saver: create checkpoint_dir in each rank when initialize_checkpoint (#63)
  • (e6c2a59) core/saver: create checkpoint base dir in checkpoint saver init (#62)
  • (7075ce4) adapter/nemo: use spawn context for mp_manager to prevent OOM on NVRX restart (#59)

🕐 Performance

  • (8b9c0a3) adapter/megatron: Change the MLF AsyncCallsQueue to persistent (#42)

♻️ Refactoring

  • (f25fca6) adapter/megatron: extract local-aware megatron save into helper function (#43)

📔 Documentation

🔀 Build

  • (ae84f35) use cibuildwheels for PyPi compatible packages (#64)
  • (7bb914f) Upgrade GitHub Actions for Node 24 compatibility (#56)
  • (06ebf54) set a fallback version for installs in dirs without .git (#53)

🔃 CI

🔩 Chores


Generated with: ./scripts/create_release.py

New Contributors

Full Changelog: v0.0.5...v0.0.6

v0.0.5

Choose a tag to compare

@g-husam g-husam released this 17 Feb 19:46
85d780d

Release Notes: v0.0.4 -> 85d780d


🏆 Features

  • (150d52c) scripts: use on_train_batch_start for precise step timing (#39)
  • (06ebcbf) adapter/nemo: add EventLoggingCallback for lifecycle monitoring (#34)
  • (efd8560) core: implement optimized serialization tensor saving (#12)

🕐 Performance

  • (d64060d) core: Explicitly set PyTorch intra-op threads. (#21)

♻️ Refactoring

  • (22d8691) Move C++ tests to tests/ directory (#33)
  • (066f2a3) core: Move context recovery logic strictly to the NeMo layer (#19)

🎨 Styles

  • (4c806b3) fix clang-format violations and re-enable clang-format check (#26)

📔 Documentation

🔀 Build

🔃 CI

🔩 Chores

  • (bff1c08) scripts: Add aggregate and per-node throughput calculations (#32)
  • (e113677) add feature request issue template (#16)

Generated with: ./scripts/create_release.py

Full Changelog: v0.0.4...v0.0.5

v0.0.4 - First GitHub Release

Choose a tag to compare

@g-husam g-husam released this 23 Jan 19:59
b976758

Note that the latest internal release prior to migrating to GitHub was v0.0.3, so continuing version numbering for consistency and clarity.

Release Notes: BEGINNING -> b976758


♻️ Refactoring

  • (ebdf9ea) scripts: unify metric naming format in log parser (#6)

📔 Documentation

  • (b976758) update readme and user doc site for GitHub and public usage (#11)
  • (123596a) fix site deployment workflow (#4)

🔃 CI

  • (5d81d2b) docs: remove premature upload artifact step (#5)

🔩 Chores


Generated with: ./scripts/create_release.py

Full Changelog: https://github.com/google/ml-flashpoint/commits/v0.0.4