MultiGPU Work Units For Accelerated Sampling (CORE-184)#7063

Merged

comfyanonymous merged 173 commits into

worksplit-multigpu

May 26, 2026

Commits on Dec 29, 2024

Add 'sigmas' to transformer_options so that downstream code can know about the full scope of current sampling run, fix Hook Keyframes' guarantee_steps=1 inconsistent behavior with sampling split ac…
Kosinkadink
committed

Commits on Dec 30, 2024

Merge branch 'master' into hooks_part2
Kosinkadink
committed

Commits on Jan 4, 2025

Merge branch 'master' into hooks_part2
Kosinkadink
committed
Cleaned up hooks.py, refactored Hook.should_register and add_hook_patches to use target_dict instead of target so that more information can be provided about the current execution environment if ne…
Kosinkadink
committed
Refactor WrapperHook into TransformerOptionsHook, as there is no need to separate out Wrappers/Callbacks/Patches into different hook types (all affect transformer_options)
Kosinkadink
committed
Refactored HookGroup to also store a dictionary of hooks separated by hook_type, modified necessary code to no longer need to manually separate out hooks by hook_type
Kosinkadink
committed

Commits on Jan 5, 2025

Commits on Jan 6, 2025

Commits on Jan 8, 2025

Commits on Jan 11, 2025

Commits on Jan 12, 2025

Merge branch 'master' into multigpu_support
Kosinkadink
committed

Commits on Jan 16, 2025

Merge branch 'master' into multigpu_support
Kosinkadink
committed

Commits on Jan 17, 2025

Commits on Jan 23, 2025

Added unload_model_and_clones to model_management.py to allow unloading only relevant models
Kosinkadink
committed

Commits on Jan 24, 2025

Commits on Jan 25, 2025

Fix multigpu ControlBase get_models and cleanup calls to avoid multiple calls of functions on multigpu_clones versions of controlnets
Kosinkadink
committed

Commits on Jan 26, 2025

Commits on Jan 27, 2025

Extracted multigpu core code into multigpu.py, added load_balance_devices to get subdivision of work based on available devices and splittable work item count, added MultiGPU Options nodes to set r…
Kosinkadink
committed

Commits on Jan 28, 2025

Merge remote-tracking branch 'origin/master' into multigpu_support
Kosinkadink
committed

Commits on Jan 29, 2025

Carry over change from _calc_cond_batch into _calc_cond_batch_multigpu
Kosinkadink
committed

Commits on Feb 2, 2025

Merge branch 'master' into multigpu_support
Kosinkadink
committed

Commits on Feb 6, 2025

Commits on Feb 7, 2025

Merge branch 'multigpu_support' into worksplit-multigpu
Kosinkadink
committed

Commits on Feb 12, 2025

Merge branch 'master' into worksplit-multigpu
Kosinkadink
committed

Commits on Feb 18, 2025

Merge branch 'master' into worksplit-multigpu
Kosinkadink
committed

Commits on Feb 25, 2025

Merge branch 'master' into worksplit-multigpu
Kosinkadink
committed

Commits on Mar 4, 2025

Commits on Mar 9, 2025

Merge branch 'master' into worksplit-multigpu
Kosinkadink
committed

Commits on Mar 14, 2025

Merge branch 'master' into worksplit-multigpu
Kosinkadink
committed

Commits on Mar 15, 2025

Merge branch 'master' into worksplit-multigpu
Kosinkadink
committed

Commits on Mar 17, 2025

Commits on Mar 19, 2025

Merge branch 'master' into worksplit-multigpu
Kosinkadink
committed

Commits on Mar 27, 2025

Merge branch 'master' into worksplit-multigpu
Kosinkadink
committed

Commits on Mar 28, 2025

Commits on Apr 9, 2025

Commits on Apr 16, 2025

Commits on Apr 17, 2025

Merge branch 'master' into worksplit-multigpu
Kosinkadink
committed

Commits on Apr 18, 2025

Merge branch 'master' into worksplit-multigpu
Kosinkadink
committed

Commits on Apr 19, 2025

Commits on Apr 23, 2025

Merge branch 'master' into worksplit-multigpu
Kosinkadink
committed

Commits on May 13, 2025

Merge branch 'master' into worksplit-multigpu
Kosinkadink
committed

Commits on May 21, 2025

Merge branch 'master' into worksplit-multigpu
Kosinkadink
committed

Commits on Jun 1, 2025

Merge branch 'master' into worksplit-multigpu
Kosinkadink
committed

Commits on Jun 17, 2025

Merge branch 'master' into worksplit-multigpu
Kosinkadink
committed

Commits on Jun 24, 2025

Commits on Jul 1, 2025

Merge branch 'master' into worksplit-multigpu
Kosinkadink
committed

Commits on Jul 9, 2025

Merge branch 'master' into worksplit-multigpu
Kosinkadink
committed

Commits on Jul 22, 2025

Merge branch 'master' into worksplit-multigpu-wip
Kosinkadink
committed

Commits on Jul 27, 2025

Merge branch 'master' into worksplit-multigpu-wip
Kosinkadink
committed

Commits on Jul 28, 2025

Merge branch 'master' into worksplit-multigpu
Kosinkadink
committed

Commits on Jul 29, 2025

Merge branch 'master' into worksplit-multigpu
Kosinkadink
committed

Commits on Jul 30, 2025

Merge branch 'master' into worksplit-multigpu
Kosinkadink
committed

Commits on Jul 31, 2025

Merge branch 'master' into worksplit-multigpu
Kosinkadink
committed

Commits on Aug 1, 2025

Merge branch 'master' into worksplit-multigpu
Kosinkadink
committed

Commits on Aug 5, 2025

Merge branch 'master' into worksplit-multigpu
Kosinkadink
committed

Commits on Aug 8, 2025

Merge branch 'master' into worksplit-multigpu
Kosinkadink
committed

Commits on Aug 11, 2025

Commits on Aug 13, 2025

Merge branch 'master' into worksplit-multigpu
Kosinkadink
committed

Commits on Aug 14, 2025

Merge branch 'master' into worksplit-multigpu
Kosinkadink
committed

Commits on Aug 15, 2025

Merge branch 'master' into worksplit-multigpu
Kosinkadink
committed

Commits on Aug 17, 2025

Merge branch 'master' into worksplit-multigpu
Kosinkadink
committed

Commits on Aug 18, 2025

Merge branch 'master' into worksplit-multigpu
Kosinkadink
committed

Commits on Aug 19, 2025

Merge branch 'master' into worksplit-multigpu
Kosinkadink
committed

Commits on Aug 30, 2025

Merge remote-tracking branch 'origin/master' into worksplit-multigpu
Kosinkadink
committed

Commits on Sep 12, 2025

Merge branch 'master' into worksplit-multigpu
Kosinkadink
committed

Commits on Sep 18, 2025

Merge branch 'master' into worksplit-multigpu
Kosinkadink
committed

Commits on Sep 25, 2025

Merge branch 'master' into worksplit-multigpu
Kosinkadink
committed

Commits on Oct 14, 2025

Commits on Oct 16, 2025

Commits on Feb 17, 2026

Commits on Mar 18, 2026

Merge origin/master into worksplit-multigpu

Kosinkadink
and
Amp
committed

Commits on Mar 30, 2026

Commits on Apr 8, 2026

Commits on Apr 9, 2026

Simplify multigpu dispatch: run all devices on pool threads (#13340)
Kosinkadink
authored

Commits on Apr 16, 2026

Minor updates for worksplit_gpu with comfy-aimdo (#13419)
rattus128
authored

Commits on Apr 20, 2026

Commits on Apr 24, 2026

Commits on May 7, 2026

Add device selection on Image Only Load Checkpoint (CORE-158) (#13748)
alexisrolland
authored

Commits on May 20, 2026

Commits on May 21, 2026

Use cond_shapes in multigpu memory-fit check (parity with single-GPU path)

Kosinkadink
and
Amp
committed
Document --cuda-device comma format and MultiGPU Options relative_speed gap

Kosinkadink
and
Amp
committed
Restore prepare_state backward-compatible signature

Kosinkadink
and
Amp
committed
Free QwenFunControlNet base_model reference in cleanup

Kosinkadink
and
Amp
committed
Pass per-device model to multigpu control clones in pre_run_control

Kosinkadink
and
Amp
committed
Fix CodeRabbit findings in worksplit-multigpu (#14017)
Kosinkadink
authored
Note _calc_cond_batch and _calc_cond_batch_multigpu must stay in sync

Kosinkadink
and
Amp
committed
Simplify Hunyuan 3D 2.1 swap_cfg_halves gate to a shape check

Kosinkadink
and
Amp
committed
Backport Hunyuan 3D 2.1 attention batch-size fixes from #13699

Kosinkadink
and
Amp
committed
Merge remote-tracking branch 'origin/master' into worksplit-multigpu

Kosinkadink
and
Amp
committed
Mark non-NVIDIA multigpu gaps with TODOs in _handle_batch

Kosinkadink
and
Amp
committed
Report all torch devices from /system_stats

Kosinkadink
and
Amp
committed

Commits on May 23, 2026

Commits on May 24, 2026

multigpu: refactor deepclone_multigpu + register cached_patcher_init for CLIP/VAE; Select*Device retargets via deepclone

Kosinkadink
and
Amp
committed

Commits on May 25, 2026

Commits on May 26, 2026

multigpu: fix CPU SelectModelDevice slowness + MGCS reuse stripping is_multigpu_base_clone

Kosinkadink
and
Amp
committed