Does SVG Support Sequence Parallelism

[sywang0111]

Thank you for your excellent work.
I was wondering, generating a video on H100 is still too long. Could we potentially achieve higher speedup by utilizing SVG + SP (Ring or Ulysses)?
If not support now, what problems may occur when integrating SVG with SP?

[haochengxi]

We currently do not support Sequence Parallel in SVG. SVG is compatible with Ring or Ulysses but we haven't implemented it yet.

[m-richa]

I have a question about this compatibility. Would we have to make 8/2/ block masks for sequence parallel using Ulysses/Ring? Based on how we do spatial sharding.