[Bug]: python -m bitsandbytes Inspect the output of the command and see if you can locate CUDA libraries. You might need to add them to your LD_LIBRARY_PATH. If you suspect a bug, please take the information from python -m bitsandbytes and open an issue at: https://github.com/TimDettmers/bitsandbytes/issues

[DataClyde]

Is there an existing issue for this?

• I have searched the existing issues and checked the recent builds/commits

What happened?

---

RuntimeError Traceback (most recent call last)
Untitled-1.ipynb Cell 3 line 1
----> 1 import bitsandbytes

File c:\Users\Jerem\miniconda3\envs\pytor_init\Lib\site-packages\bitsandbytes_init_.py:6
1 # Copyright (c) Facebook, Inc. and its affiliates.
2 #
3 # This source code is licensed under the MIT license found in the
4 # LICENSE file in the root directory of this source tree.
----> 6 from . import cuda_setup, utils, research
7 from .autograd._functions import (
8 MatmulLtState,
9 bmm_cublas,
(...)
13 matmul_4bit
14 )
15 from .cextension import COMPILED_WITH_CUDA

File c:\Users\Jerem\miniconda3\envs\pytor_init\Lib\site-packages\bitsandbytes\research_init_.py:1
----> 1 from . import nn
2 from .autograd._functions import (
3 switchback_bnb,
4 matmul_fp8_global,
5 matmul_fp8_mixed,
...
python -m bitsandbytes

    Inspect the output of the command and see if you can locate CUDA libraries. You might need to add them
    to your LD_LIBRARY_PATH. If you suspect a bug, please take the information from python -m bitsandbytes
    and open an issue at: https://github.com/TimDettmers/bitsandbytes/issues

Steps to reproduce the problem

1. i've tried bitsandbytes-windows instal uninstall hwoever when i import bitsandbytes this still appears

What should have happened?

succesfully imported bitsandbytes

Sysinfo

---

RuntimeError Traceback (most recent call last)
Untitled-1.ipynb Cell 3 line 1
----> 1 import bitsandbytes

File c:\Users\Jerem\miniconda3\envs\pytor_init\Lib\site-packages\bitsandbytes_init_.py:6
1 # Copyright (c) Facebook, Inc. and its affiliates.
2 #
3 # This source code is licensed under the MIT license found in the
4 # LICENSE file in the root directory of this source tree.
----> 6 from . import cuda_setup, utils, research
7 from .autograd._functions import (
8 MatmulLtState,
9 bmm_cublas,
(...)
13 matmul_4bit
14 )
15 from .cextension import COMPILED_WITH_CUDA

File c:\Users\Jerem\miniconda3\envs\pytor_init\Lib\site-packages\bitsandbytes\research_init_.py:1
----> 1 from . import nn
2 from .autograd._functions import (
3 switchback_bnb,
4 matmul_fp8_global,
5 matmul_fp8_mixed,
...
python -m bitsandbytes

    Inspect the output of the command and see if you can locate CUDA libraries. You might need to add them
    to your LD_LIBRARY_PATH. If you suspect a bug, please take the information from python -m bitsandbytes
    and open an issue at: https://github.com/TimDettmers/bitsandbytes/issues

What browsers do you use to access the UI ?

No response

Console logs

---------------------------------------------------------------------------
RuntimeError                              Traceback (most recent call last)
Untitled-1.ipynb Cell 3 line 1
----> 1 import bitsandbytes 

File c:\Users\Jerem\miniconda3\envs\pytor_init\Lib\site-packages\bitsandbytes\__init__.py:6
      1 # Copyright (c) Facebook, Inc. and its affiliates.
      2 #
      3 # This source code is licensed under the MIT license found in the
      4 # LICENSE file in the root directory of this source tree.
----> 6 from . import cuda_setup, utils, research
      7 from .autograd._functions import (
      8     MatmulLtState,
      9     bmm_cublas,
   (...)
     13     matmul_4bit
     14 )
     15 from .cextension import COMPILED_WITH_CUDA

File c:\Users\Jerem\miniconda3\envs\pytor_init\Lib\site-packages\bitsandbytes\research\__init__.py:1
----> 1 from . import nn
      2 from .autograd._functions import (
      3     switchback_bnb,
      4     matmul_fp8_global,
      5     matmul_fp8_mixed,
...
        python -m bitsandbytes

        Inspect the output of the command and see if you can locate CUDA libraries. You might need to add them
        to your LD_LIBRARY_PATH. If you suspect a bug, please take the information from python -m bitsandbytes
        and open an issue at: https://github.com/TimDettmers/bitsandbytes/issues

Additional information

No response

[wkpark]

this is not a bug of sd-webui. bitsnbytes does not support Windows.
see also bitsandbytes-foundation/bitsandbytes#876