Skip to content

Environment variables for session 5 deep speed examples #82

@marlon-tobaben

Description

@marlon-tobaben

@mszpindler asked the following questions that I transferred this to a new issue as we already merged #77 :

  • srun --cpu-bind=v,mask_cpu=$CPU_BIND_MASKS singularity run -B ../resources/ai-guide-env.sqsh:/user-software:image-src=/ \
    $SIF bash -c 'export RANK=$SLURM_PROCID; export LOCAL_RANK=$SLURM_LOCALID; python ds_visiontransformer.py --deepspeed --deepspeed_config ds_config.json'
    Here $SLURM_PROCID and $SLURM_LOCALID also need to be backslashed, aren't they?
  • srun --cpu-bind=v,mask_cpu=$CPU_BIND_MASKS singularity run -B ../resources/ai-guide-env.sqsh:/user-software:image-src=/ \
    $SIF bash -c 'export RANK=$SLURM_PROCID; export LOCAL_RANK=$SLURM_LOCALID; python ds_visiontransformer.py --deepspeed --deepspeed_config ds_config.json'
    Shouldn't there be export RANK=\$SLURM_PROCID; export LOCAL_RANK=\$SLURM_LOCALID;

Metadata

Metadata

Labels

No labels
No labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions