Skip to content

[slimtensor] Introduce CUDA guard to aoti/slim/cuda #16724

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
Gasoonjia wants to merge 3 commits into
base: gh/gasoonjia/104/base
Choose a base branch
from
Open

[slimtensor] Introduce CUDA guard to aoti/slim/cuda #16724

Gasoonjia wants to merge 3 commits into from
+851 −10

Conversation

@Gasoonjia
Copy link
Contributor

@Gasoonjia Gasoonjia commented Jan 20, 2026 •
edited
Loading

Stack from ghstack (oldest at bottom):

Copy CUDAGuard and CUDAStreamGuard from cuda/runtime/ to aoti/slim/cuda/
to support slimtensor requirement while get rid of potential circular dependency:

  • cuda_backend/main_functionalities -> aoti/slimtensor -> cuda_backend/cuda_guard

This change:

  • copy guard.h, guard.cpp and test files from backend/cuda_backend to backend/aoti/slim/cuda/

Differential Revision: D91056808

@Gasoonjia
[slimtensor] Introduce CUDA guard to aoti/slim/cuda
b655367 
Copy CUDAGuard and CUDAStreamGuard from cuda/runtime/ to aoti/slim/cuda/
to support slimtensor requirement while get rid of potential circular dependency:
- cuda_backend/main_functionalities -> aoti/slimtensor -> cuda_backend/cuda_guard

This change:
- copy guard.h, guard.cpp and test files from backend/cuda_backend to backend/aoti/slim/cuda/

Differential Revision: [D91056808](https://our.internmc.facebook.com/intern/diff/D91056808/)

[ghstack-poisoned]
This was referenced Jan 20, 2026
Merged
Merged
@pytorch-bot
Copy link

pytorch-bot bot commented Jan 20, 2026 •
edited
Loading

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/16724

Note: Links to docs will display an error until the docs builds have been completed.

❌ 97 New Failures, 3 Unrelated Failures

As of commit 2cdf0e8 with merge base 3512861 (image):

NEW FAILURES - The following jobs have failed:

FLAKY - The following jobs failed but were likely due to flakiness present on trunk:

This comment was automatically generated by Dr. CI and updates every 15 minutes.

This was referenced Jan 20, 2026
Merged
Merged
Merged
Merged
Merged
Open
Open
Open
Open
Gasoonjia added a commit that referenced this pull request Jan 20, 2026
@Gasoonjia
[slimtensor] Introduce CUDA guard to aoti/slim/cuda
0bbb841 
Copy CUDAGuard and CUDAStreamGuard from cuda/runtime/ to aoti/slim/cuda/
to support slimtensor requirement while get rid of potential circular dependency:
- cuda_backend/main_functionalities -> aoti/slimtensor -> cuda_backend/cuda_guard

This change:
- copy guard.h, guard.cpp and test files from backend/cuda_backend to backend/aoti/slim/cuda/

Differential Revision: [D91056808](https://our.internmc.facebook.com/intern/diff/D91056808/)

ghstack-source-id: 334626668
Pull Request resolved: #16724
@meta-cla meta-cla bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Jan 20, 2026
@github-actions
Copy link

github-actions bot commented Jan 20, 2026

This PR needs a release notes: label

If your change should be included in the release notes (i.e. would users of this library care about this change?), please use a label starting with release notes:. This helps us keep track and include your important work in the next release notes.

To add a label, you can comment to pytorchbot, for example
@pytorchbot label "release notes: none"

For more information, see
https://github.com/pytorch/pytorch/wiki/PyTorch-AutoLabel-Bot#why-categorize-for-release-notes-and-how-does-it-work.

This was referenced Jan 21, 2026
Open
Open
Open
Open
Open
Open
Open
Open
@Gasoonjia
Update on "[slimtensor] Introduce CUDA guard to aoti/slim/cuda"
c7a628c 
Copy CUDAGuard and CUDAStreamGuard from cuda/runtime/ to aoti/slim/cuda/
to support slimtensor requirement while get rid of potential circular dependency:
- cuda_backend/main_functionalities -> aoti/slimtensor -> cuda_backend/cuda_guard

This change:
- copy guard.h, guard.cpp and test files from backend/cuda_backend to backend/aoti/slim/cuda/

Differential Revision: [D91056808](https://our.internmc.facebook.com/intern/diff/D91056808/)

[ghstack-poisoned]
This was referenced Jan 17, 2026
Open
Open
Open
This was referenced Jan 16, 2026
Open
Open
Open
@Gasoonjia
Update on "[slimtensor] Introduce CUDA guard to aoti/slim/cuda"
2cdf0e8 
Copy CUDAGuard and CUDAStreamGuard from cuda/runtime/ to aoti/slim/cuda/
to support slimtensor requirement while get rid of potential circular dependency:
- cuda_backend/main_functionalities -> aoti/slimtensor -> cuda_backend/cuda_guard

This change:
- copy guard.h, guard.cpp and test files from backend/cuda_backend to backend/aoti/slim/cuda/

Differential Revision: [D91056808](https://our.internmc.facebook.com/intern/diff/D91056808/)

[ghstack-poisoned]
This was referenced Jan 22, 2026
Open
Open
Open
Open
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. fb-exported meta-exported

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@Gasoonjia