Model parallelism #267

Open

opened

on Sep 10, 2024

How to use the model parallel way, my picture resolution is very large? In my attempt to split, loss.backward no longer has the same GPU, or optim no longer has the same gpu.

Metadata

Assignees

No one assigned

Labels

No labels

No labels

Type

No type

Fields

No fields configured for issues without a type.

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests