Skip to content

Update postprocessing pipeline#22

Open
adehecq wants to merge 34 commits into
mainfrom
amaury_postproc
Open

Update postprocessing pipeline#22
adehecq wants to merge 34 commits into
mainfrom
amaury_postproc

Conversation

@adehecq

@adehecq adehecq commented May 20, 2026

Copy link
Copy Markdown
Contributor

This PR updates many of the postprocessing steps to make it easier to identify errors in submissions and automatically generate a report of the main figures:

  • update file naming convention to the latest v2 requirements
  • allow team tags of 3-6 characters
  • filenaming check is done consistently across all postprocessing steps and the function parse_filename now raises FilenameParseError, which provide a clearer error.
  • check for duplicated files (from multiple archives) > the function scan_submissions include a duplicate checking.
  • add renaming step for files not following the convention > A renaming step is added to the config (work with regex), it's used when the symlinks are generated.
  • Add a CLI step "generate_pdf" which generates a pdf report by concatenating all png figures.
  • add a pipeline step to check received submissions against planned submissions
  • add verbose option to CLI subcommand run
  • add gdown dependency

TODO:

  • add Sankey diagram generation : integrate preliminary script into pipeline, using downloaded planned experiment file

adehecq and others added 30 commits May 20, 2026 13:21
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants