Skip to content

Update Triton extend backend interface#3309

Merged
zhyncs merged 8 commits intosgl-project:mainfrom
ispobock:triton-extend
Feb 5, 2025
Merged

Update Triton extend backend interface#3309
zhyncs merged 8 commits intosgl-project:mainfrom
ispobock:triton-extend

Conversation

@ispobock
Copy link
Copy Markdown
Collaborator

@ispobock ispobock commented Feb 5, 2025

Motivation

#3292

@ispobock
Copy link
Copy Markdown
Collaborator Author

ispobock commented Feb 5, 2025

test updated

@ispobock
Copy link
Copy Markdown
Collaborator Author

ispobock commented Feb 5, 2025

Double Sparsity backend still uses the original triton extend kernel interface. So move the original extend kernel to decode_attention.py to fix the ut.

cc: @andy-yang-1 @merrymercy

@zhyncs zhyncs merged commit de55333 into sgl-project:main Feb 5, 2025
@zhyncs zhyncs mentioned this pull request Feb 10, 2025
13 tasks
timethink pushed a commit to timethink/sglang that referenced this pull request Mar 9, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants