Skip to content

Reduced Size of SDFG Folder#2331

Open
philip-paul-mueller wants to merge 42 commits intospcl:mainfrom
philip-paul-mueller:different_dace_folder
Open

Reduced Size of SDFG Folder#2331
philip-paul-mueller wants to merge 42 commits intospcl:mainfrom
philip-paul-mueller:different_dace_folder

Conversation

@philip-paul-mueller
Copy link
Copy Markdown
Collaborator

@philip-paul-mueller philip-paul-mueller commented Apr 1, 2026

The initial idea was to reduce the size of the cache folder, by only storing the components that are needed.
To this end the code generator was modified such that different versions of build folder could be generated.
Currently there are only two versions:

  • full: Which is the old full version, i.e. everything in a single folder.
  • production: This is a reduced folder and only contains the libraries (stub and program library) as well the version.

The implementation has two parts. First generate_program_folder() was modified such that it only generates the parts that are absolutely needed, such as source files and anything else would not be generated in the first place.
Then compile_and_configure() was modified such that it would remove the parts that are no longer needed (an example would be the source files which are needed for compilation but not afterwards).

The changes are backwards compatible. Thus, caches that were generated before this PR will still work, but they should be phased out.

In Addition:

  • Also fixes that sdfg.view() fails if there are external SDFGs (727cfb1)
  • sdfg.generate_code() no longer generates the source maps as a side effect and writes them to disc. Instead they are generated by the generate_program_folder() (5e1694b).
  • Dumping of the configuration in the build folder (eb54062).
  • Miscellaneous refactoring in the ReloadableDLL, that changed its interface.

…is assumed.

This ensures full backwards compatibility.
Also now the loader no longer take the folder version argument.
It is still there but does not have any effect.
@philip-paul-mueller philip-paul-mueller changed the title WIP: Reduced Size of SDFG Folder Reduced Size of SDFG Folder Apr 7, 2026
@philip-paul-mueller
Copy link
Copy Markdown
Collaborator Author

A point of discussion is if the CACHEDIR.TAG should also be generated in production mode.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant