ZY-Dijkstra/Disen-Forcing
Updated
Zhengyang Yu PRO
ZY-Dijkstra
AI & ML interests
None yet
Recent Activity
updated a model 29 days ago
ZY-Dijkstra/Disen-Forcing published a model 29 days ago
ZY-Dijkstra/Disen-Forcing upvoted a paper 3 months ago
All Roads Lead to Rome: Incentivizing Divergent Thinking in Vision-Language ModelsOrganizations
None yet
updated a
model 29 days ago
published a
model 29 days ago
upvoted a paper 3 months ago
upvoted a paper 6 months ago
reacted to beomi's post with 🔥 about 1 year ago
Post
11395
# PyTorch == 2.5.0 Breaks Transformers' SDPAttention!
When you encounter "RuntimeError: cuDNN Frontend error: [cudnn_frontend] Error: No execution plans support the graph."
We can use workaround like this:
but this slow downs the performance gain from PyTorch 2.5.
Although it is fixed(not "fixed" but default option is turn-off the cuDNN SDPA) at here -- https://github.com/pytorch/pytorch/pull/138587 , but not released yet. (you need to install directly from source)
Fastest way for now : pip install "torch<2.5"
Ref: https://github.com/huggingface/diffusers/issues/9704#issuecomment-2422585273
When you encounter "RuntimeError: cuDNN Frontend error: [cudnn_frontend] Error: No execution plans support the graph."
We can use workaround like this:
torch.backends.cuda.enable_cudnn_sdp(False)but this slow downs the performance gain from PyTorch 2.5.
Although it is fixed(not "fixed" but default option is turn-off the cuDNN SDPA) at here -- https://github.com/pytorch/pytorch/pull/138587 , but not released yet. (you need to install directly from source)
Fastest way for now : pip install "torch<2.5"
Ref: https://github.com/huggingface/diffusers/issues/9704#issuecomment-2422585273
updated 3
models over 2 years ago