Skip to content

Task Minima Adjustment Too Aggressive #13

@evanberkowitz

Description

@evanberkowitz

If METAQ loops through everything and fails to find any tasks to launch simply because the machine is full, it shouldn't try to adjust the minimum acceptable task size! It should celebrate that the machine is full!

eg.

Looping over tasks in /ccs/proj/lgt100/c51/x_files/project_2/q/todo/cpu_32
    Folder settings suggest tasks require at least 32 nodes.
    Folder settings suggest tasks require at least 32 gpus.
    Folder settings suggest tasks require at least 26:00 remaining wallclock time.
    Skipping tasks because folder NODE requirement 32 exceeds the available nodes 0.


Tried to launch all available tasks.
No tasks were launched on the last pass.
Minimum task size requirements may have been too big.
    New minimum node requirement: 4 NODES
    New minimum gpu requirement: 4 GPUS
Maximum task size requirements may have been too small.
    New maximum node requirement: 32 NODES
    New maximum gpu requirement: 32 GPUS

is really dumb.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions