Skip to content

Cuda source cleanup , refactor and fixes#1328

Merged
matthewdouglas merged 9 commits intobitsandbytes-foundation:mainfrom
abhilash1910:cuda_refactor
Aug 26, 2024
Merged

Cuda source cleanup , refactor and fixes#1328
matthewdouglas merged 9 commits intobitsandbytes-foundation:mainfrom
abhilash1910:cuda_refactor

Conversation

@abhilash1910
Copy link
Copy Markdown
Contributor

This is a draft Pr for cleanup of cuda kernels, refactor template assignments and fix some AOT issues.
The cuda kernels have some scope of cleanup in terms of redundant code pathways and unused methods.
cc @matthewdouglas , @Titus-von-Koeller
@TimDettmers (pinging for awareness).

@abhilash1910 abhilash1910 marked this pull request as draft August 20, 2024 14:57
@matthewdouglas
Copy link
Copy Markdown
Member

Thanks! We actually just recently were discussing some cleanup here so this fits nicely timing-wise!

@matthewdouglas matthewdouglas self-assigned this Aug 20, 2024
@Titus-von-Koeller
Copy link
Copy Markdown
Collaborator

@abhilash1910

Thanks for the PR, really appreciate the pro-activity in helping us clean things up!

I just had a chat with Tim and he reviewed the PR and said everything looks good to him.

I see you put the PR as draft, are there any more changes coming or can wrap things up?

@abhilash1910
Copy link
Copy Markdown
Contributor Author

Hi @Titus-von-Koeller , I am planning to wrap this up in a couple of hours from now.
Will ping you . Thanks

@abhilash1910 abhilash1910 marked this pull request as ready for review August 21, 2024 20:06
@abhilash1910
Copy link
Copy Markdown
Contributor Author

abhilash1910 commented Aug 21, 2024

@Titus-von-Koeller this is ready for review now, thanks.
Some changes since last review : quantize 2d is a generic method over unused quantize quadrant, some rearrangements of template classes, removal of unused functions

@abhilash1910 abhilash1910 changed the title [WIP] Cuda source cleanup , refactor and fixes Cuda source cleanup , refactor and fixes Aug 21, 2024
Comment thread csrc/ops.cu
Copy link
Copy Markdown
Member

@matthewdouglas matthewdouglas left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good! Thanks!

@matthewdouglas matthewdouglas merged commit 6bef412 into bitsandbytes-foundation:main Aug 26, 2024
matthewdouglas pushed a commit to matthewdouglas/bitsandbytes that referenced this pull request Oct 28, 2024
Cuda source cleanup , refactor and fixes (bitsandbytes-foundation#1328)

* remove kcompress

* fix initial template call

* fix function name

* remove vector load

* cleanup reduce  & rearrange

* format
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants