Bug
When starting Spider workers on multiple machines, and then starts a jobs, only a few workers starts immediately. Other workers wait a while before start executing tasks.
Spider version
fdfd8f2
Environment
Ubuntu 22.04
Reproduction steps
Start a multiple machine cluster and execute jobs with a large number of parallel tasks.
Bug
When starting
Spiderworkers on multiple machines, and then starts a jobs, only a few workers starts immediately. Other workers wait a while before start executing tasks.Spider version
fdfd8f2
Environment
Ubuntu 22.04
Reproduction steps
Start a multiple machine cluster and execute jobs with a large number of parallel tasks.