Optimize the initialization method of the MonkeyChat class to add the functionality of automatically configuring data types to support different CUDA computing capabilities.#1
Conversation
… functionality of automatically configuring data types to support different CUDA computing capabilities.
|
We have merged this PR, thanks for your contribution. |
|
Thanks again! Also, could you share which GPU you were using during deployment, and whether the deployment was successful? That would help us refine support for different hardware setups and better understand potential issues. Appreciate your input! @liwenju0 |
I deployed it on my 2080ti with 22G of memory on a single card (magically modified) |
|
Thanks for your reply! |
No description provided.