Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Support multiple optimization streams per device #1117

Closed
nathanielsimard opened this issue Jan 4, 2024 · 0 comments · Fixed by #1149
Closed

Support multiple optimization streams per device #1117

nathanielsimard opened this issue Jan 4, 2024 · 0 comments · Fixed by #1149
Assignees
@nathanielsimard
Labels
performance Anything related to performance wgpu Related to WGPU backend

Comments

@nathanielsimard
Copy link
Member

For now, Burn-fusion supports only one optimization stream for a device. However, when a device is used by multiple concurrent threads, the stream becomes interrupted all the time, and a lot of optimizations become impossible. Also, a lot more optimizations are created, but never reused because new situations happen nondeterministically.
@nathanielsimard nathanielsimard self-assigned this Jan 4, 2024
@nathanielsimard nathanielsimard added performance Anything related to performance wgpu Related to WGPU backend labels Jan 4, 2024
This was referenced Jan 12, 2024
Merged
Merged
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@nathanielsimard nathanielsimard

Labels
performance Anything related to performance wgpu Related to WGPU backend
Projects
Burn 🔥
Status: Done
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

[burn-fusion] support multiple concurrent optimization streams tracel-ai/burn
1 participant
@nathanielsimard