Skip to content
Python package

Support LLM.int8() inference with torch.compile #1208

Sign in to view logs

Support LLM.int8() inference with torch.compile

Support LLM.int8() inference with torch.compile #1208

Triggered via push April 15, 2025 14:23
@matthewdouglasmatthewdouglas
pushed 15c8c48
int8-compile
Status Success
Total duration 10m 49s
Artifacts 28

python-package.yml

on: push
Matrix: build-shared-libs-cuda
Matrix: build-shared-libs
Matrix: build-wheels
audit-wheels
12s
audit-wheels
Create release and upload artifacts
0s
Create release and upload artifacts
Publish wheels to PyPI
0s
Publish wheels to PyPI
Fit to window
Zoom out
Zoom in

Artifacts

Produced during runtime
Name Size Digest
bdist_wheel_macos-latest_aarch64 Expired
92.5 KB
sha256:277af6d69c1453af6cb95e259558492cbdedb571cd3a8d8a82d246cf4f544343
bdist_wheel_macos-latest_x86_64 Expired
92.5 KB
sha256:328b01d2f27630566c51c50eaaa7b10839c2171f53065d5d506927fb151ae81a
bdist_wheel_ubuntu-22.04_x86_64 Expired
69.9 MB
sha256:2e38c55f91d60d62fdc042e323e835e61421a4f69b307539f13ff85bf9fda736
bdist_wheel_windows-latest_x86_64 Expired
69.3 MB
sha256:8fda33ea12e116908e8399d59d6caeb3228e91ecda7344b8c2e16c14a526b8bb
shared_library_cuda_ubuntu-22.04_x86_64_11.7.1 Expired
6.19 MB
sha256:a9bbfad47d24634d5bfd2a946ecc785c04e9b63ad6a5fb9a8f898b411281d21f
shared_library_cuda_ubuntu-22.04_x86_64_11.8.0 Expired
7.48 MB
sha256:a961b9aff6df6785d17822f0a7997d8a380d499976df1d1e389fd3820b456528
shared_library_cuda_ubuntu-22.04_x86_64_12.0.1 Expired
7.27 MB
sha256:1c801b984c2b64cfe425e780b141b9d32b5cf713eb93875087cd439c8a1bcf7e
shared_library_cuda_ubuntu-22.04_x86_64_12.1.1 Expired
7.29 MB
sha256:7c1826f9ce94cdf328bcfa1c16a792c6c21c8fb26d758b1217c045fb0ba9cc91
shared_library_cuda_ubuntu-22.04_x86_64_12.2.2 Expired
7.3 MB
sha256:cdb6b6f632c160e727de06d9a6eccf64ea404d1e47a00b8373544c801b1891ce
shared_library_cuda_ubuntu-22.04_x86_64_12.3.2 Expired
7.31 MB
sha256:27ed79e5b8ded89321b5ab73b4a55535230f30dce84b30f84306b9811dc98d67
shared_library_cuda_ubuntu-22.04_x86_64_12.4.1 Expired
7.27 MB
sha256:fdb7b90710b9b714e26c836b66f49026332a1916e633b3126d571f5670499e32
shared_library_cuda_ubuntu-22.04_x86_64_12.5.1 Expired
7.29 MB
sha256:0b42fe8a35b799783fdd4c13de164541beb1f5ab68bf0777b5b4e09f4650af57
shared_library_cuda_ubuntu-22.04_x86_64_12.6.3 Expired
7.31 MB
sha256:8d64fa3daba9e23125551edeb3f6b3acc78da4eb530287ae46c871d559e04fa8
shared_library_cuda_ubuntu-22.04_x86_64_12.8.1 Expired
5.89 MB
sha256:aa3f5443f4f048f2d4f129fb6a8c508d97f852f6ccc9613f2810cfee29e7fd97
shared_library_cuda_windows-latest_x86_64_11.7.1 Expired
6.16 MB
sha256:96edb7a3ba4e000177ed37bc4a45c86bb937f9d436d0bd49614271b6fd3e7fda
shared_library_cuda_windows-latest_x86_64_11.8.0 Expired
7.44 MB
sha256:0cdc95d363a845cd8edd0e928f1bab0c24b797feb1371cf56e2a735a6491a94a
shared_library_cuda_windows-latest_x86_64_12.0.1 Expired
7.22 MB
sha256:4b4f38e97495d423ba17a870b3e3782b446810008b0352d4a33e0107d13c0ea7
shared_library_cuda_windows-latest_x86_64_12.1.1 Expired
7.23 MB
sha256:b53fdf9fc5695fbb44ee44a05e360f5bd848d4d8d549390e4a49eef3dc2d008a
shared_library_cuda_windows-latest_x86_64_12.2.2 Expired
7.24 MB
sha256:aa9573957d1abf1f2d151ddfaaba9507d47f8d49236dc3f7941cd899c28a9eca
shared_library_cuda_windows-latest_x86_64_12.3.2 Expired
7.24 MB
sha256:a49389a70658a1da52a34d13e48de134e539569644f597a377a6d52055635071
shared_library_cuda_windows-latest_x86_64_12.4.1 Expired
7.2 MB
sha256:89015a8b03f776daae94b3fb59f27306ccf1286eb4699e27670490a2b0f1386b
shared_library_cuda_windows-latest_x86_64_12.5.1 Expired
7.22 MB
sha256:e57fedb75465a4d5cffc59a29e0c8bc9f3375c803aa42c1955dd064bb5857413
shared_library_cuda_windows-latest_x86_64_12.6.3 Expired
7.23 MB
sha256:c7a70a8290d4f24a277941d16e3de6ecd1e50875a02a01d95587e049fb75b790
shared_library_cuda_windows-latest_x86_64_12.8.1 Expired
5.82 MB
sha256:85d9b46ae9457e02c2e8e096dad5dc25eb3dc84cc305e2dde3763c569d308e94
shared_library_macos-latest_aarch64 Expired
8.31 KB
sha256:e6982369361d0e60562c3f994073b22112662d64ba88dc989417def6a3f14121
shared_library_macos-latest_x86_64 Expired
8.31 KB
sha256:9538b6284c65ba7b59a305d59109f5439bf997116aef199c0c2285c94c45ecf0
shared_library_ubuntu-22.04_x86_64 Expired
10 KB
sha256:652513ee37e6ceb2282baaab5cda93fc7e8d4946db76e92e9b7d6537976c0642
shared_library_windows-latest_x86_64 Expired
16.3 KB
sha256:f3d4a62ea7f7a54a3c557c9f9468f6ac82032ef489e51b52fcfdccc4ee100d35
⚡