Skip to content

add SP support for _flash_3_varlen_hub backend#13809

Open
zhtmike wants to merge 1 commit into
huggingface:mainfrom
zhtmike:fa3
Open

add SP support for _flash_3_varlen_hub backend#13809
zhtmike wants to merge 1 commit into
huggingface:mainfrom
zhtmike:fa3

Conversation

@zhtmike
Copy link
Copy Markdown
Contributor

@zhtmike zhtmike commented May 26, 2026

What does this PR do?

A follow up work for #13479. I have added _flash_3_varlen_hub support for SP forward & backward.

Tested with QwenImage pipeline, the result image is expected.
Tested with QwenImage training with SP, there is no error.
The UTs for Flux and QwenImage are passed.

Fixes # (issue)

Before submitting

Who can review?

@sayakpaul

Anyone in the community is free to review the PR once the tests have passed. Feel free to tag
members/contributors who may be interested in your PR.

@github-actions github-actions Bot added size/L PR with diff > 200 LOC models tests and removed size/L PR with diff > 200 LOC labels May 26, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant