Skip to content

Fix devcontainer build-all dependency handling#341

Draft
bdice wants to merge 4 commits into
rapidsai:mainfrom
bdice:fix-devcontainers
Draft

Fix devcontainer build-all dependency handling#341
bdice wants to merge 4 commits into
rapidsai:mainfrom
bdice:fix-devcontainers

Conversation

@bdice
Copy link
Copy Markdown
Contributor

@bdice bdice commented May 8, 2026

Summary

  • Add the missing Boost iostreams development package required while building Presto's Facebook dependency stack (mvfst).
  • Make -j0 in the Velox and Presto wrappers resolve to CPU count instead of ulimit -Hn; the previous behavior expanded to 500000 jobs and filled the filesystem during CMake/build.
  • Force bundled s2geometry in the Presto wrapper so VELOX_DEPENDENCY_SOURCE=SYSTEM does not make the embedded Velox configure fail looking for a system s2geometry package.

Debugging Notes

  • ucxx-cu13 being installed is not necessarily wrong for CUDA 13 binary packages, but the source build path should be used for this devcontainer flow.
  • The branch already had ucxx_ROOT wiring from b7f1d00, and the live wrapper was synced so downstream CMake receives -Ducxx_ROOT=/home/coder/ucxx/cpp/build/pip/cuda-13.1/release.
  • A stale/broken installed UCXX binary wheel caused librmm editable build failures through scikit-build's cmake.prefix entry point loading (No module named 'ucxx._lib.libucxx'). Removing stale UCXX binary wheels let source UCXX rebuild normally.
  • After that, Presto exposed the missing boost_iostreams dependency, then the missing s2geometry bundled override, then the -j0 job explosion / disk pressure issue.

Validation

  • build-all -j0 completed RAPIDS, Velox, and Presto after applying these changes and cleaning/rebuilding.
  • Verified build artifacts exist:
    • /opt/velox-build/release/velox/experimental/cudf/tests/velox_cudf_config_test
    • /opt/presto-build/presto_cpp/main/presto_server
    • /opt/presto-build/presto_cpp/main/tests/presto_server_test
  • Verified source-built Python imports:
    • ucxx 0.50.00
    • rmm 26.06.00
    • cudf 26.06.00
    • kvikio 26.06.00

Known Follow-up

  • python -m pip check still reports libucxx 0.50.0 requires libucx, while this CUDA 13 environment has libucx-cu13. Runtime imports work, but editable source package metadata is not fully aligned with the suffixed UCX runtime package.

@copy-pr-bot
Copy link
Copy Markdown

copy-pr-bot Bot commented May 8, 2026

Auto-sync is disabled for draft pull requests in this repository. Workflows must be run manually.

Contributors can view more details about this message here.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant