Skip to content

Remove the hard-coded number of parallel tasks for resolution #202

@houtanb

Description

@houtanb

The number of parallel tasks for resolution is hard coded to $50$, with the extra tasks being wound down.

The relevant code line is in src/nightly_update_workflow/worker/main.py#17:

resolve_forecasts = [
    [
        ("func-resolve-forecasts", True, cloud_run.timeout_1h * 3, 50),
    ]
]

This was a short-term hack.

Fix this by:

  • counting the number of folders in the forecast sets bucket
  • launching that many tasks instead of $50$

Metadata

Metadata

Assignees

Labels

enhancementa general improvementgood first issuesmaller issues that are good for starting out with the codebase

Type

No fields configured for Task.

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions