Skip to content

Support LLM.int8() inference with torch.compile #1209

Support LLM.int8() inference with torch.compile

Support LLM.int8() inference with torch.compile #1209

Triggered via pull request April 15, 2025 14:27
Status Success
Total duration 12m 0s
Artifacts 28

python-package.yml

on: pull_request
Matrix: build-shared-libs-cuda
Matrix: build-shared-libs
Matrix: build-wheels
audit-wheels
10s
audit-wheels
Create release and upload artifacts
0s
Create release and upload artifacts
Publish wheels to PyPI
0s
Publish wheels to PyPI
Fit to window
Zoom out
Zoom in

Artifacts

Produced during runtime
Name Size Digest
bdist_wheel_macos-latest_aarch64 Expired
92.8 KB
sha256:2ab0cc4bfc4d2541bec9cdfc0b768267d218c111d62cc969338de7650d98e31e
bdist_wheel_macos-latest_x86_64 Expired
92.8 KB
sha256:ad8a078bf3a5bf3ae0a5df8e9f63fa4d9830515b592686e5f6c6b5c62838e04a
bdist_wheel_ubuntu-22.04_x86_64 Expired
69.9 MB
sha256:07662f054800a5c00cb6db1e7eda167fb49bb9c599737ebd97284c31df22a67e
bdist_wheel_windows-latest_x86_64 Expired
69.3 MB
sha256:8d6a267eb38a857705b6d2d36717bb75019469b525e55b50f5ace072ea977b4d
shared_library_cuda_ubuntu-22.04_x86_64_11.7.1 Expired
6.19 MB
sha256:686ad903d6be2dd380c5a28a15f15afa86d2b64194e73363ba5b09a99846de90
shared_library_cuda_ubuntu-22.04_x86_64_11.8.0 Expired
7.48 MB
sha256:ed11c6c989bfd0f2cb480d140cd61d1e6bb38a1a97991aad60dca3e6091ee988
shared_library_cuda_ubuntu-22.04_x86_64_12.0.1 Expired
7.27 MB
sha256:2d629602e2291b7d67c53c4b6ff87010e800ac014925b63e0ebfa2d3aa3bfac8
shared_library_cuda_ubuntu-22.04_x86_64_12.1.1 Expired
7.29 MB
sha256:bfd77454e35e804e59cd22c4323e8a2af642b1f572da9021d49ade12159c4397
shared_library_cuda_ubuntu-22.04_x86_64_12.2.2 Expired
7.3 MB
sha256:5bcd0af3e1c1372a4d2944c38edbffca12d6eaec6c5616fa515a2936ba47cd4b
shared_library_cuda_ubuntu-22.04_x86_64_12.3.2 Expired
7.31 MB
sha256:413db8071d571ecf5aeb7e22125809cc11e08c00b61398baf3281114918c230e
shared_library_cuda_ubuntu-22.04_x86_64_12.4.1 Expired
7.27 MB
sha256:2cff7c09bd86e56f2a3b7b6d67ffaf4795eee24495eb721ab89a4a35f6f33680
shared_library_cuda_ubuntu-22.04_x86_64_12.5.1 Expired
7.29 MB
sha256:dfa63fa4a08a55264bffca9b5ee4cb1e3783a6cbea9317f6df08b314910671a6
shared_library_cuda_ubuntu-22.04_x86_64_12.6.3 Expired
7.31 MB
sha256:ea9f98a44b92f893a0748a638ad662ed9ebc177087361bcfa658aa02ee7368ed
shared_library_cuda_ubuntu-22.04_x86_64_12.8.1 Expired
5.89 MB
sha256:db23e6990b1a334c66954aa61f88ca5beb4dfc0827bcf980532e66f78c1cf969
shared_library_cuda_windows-latest_x86_64_11.7.1 Expired
6.16 MB
sha256:1a4bfdca37fead63352476181bae8a5448fe50a4076759c613668d1643cfffa0
shared_library_cuda_windows-latest_x86_64_11.8.0 Expired
7.44 MB
sha256:09f9cf54b78913a5c4d1cff8926d1753ef22b0f7f456ed66816ccd3e1d665a62
shared_library_cuda_windows-latest_x86_64_12.0.1 Expired
7.22 MB
sha256:f0d8086343014dfcceff157e7b478c21fae546a84c20770de8a424eaab134a3b
shared_library_cuda_windows-latest_x86_64_12.1.1 Expired
7.23 MB
sha256:10b2d6c05ca3439929cc21f6331576e05100929ae930340cdea5fd430b444f2b
shared_library_cuda_windows-latest_x86_64_12.2.2 Expired
7.24 MB
sha256:54f4079a3b59ea5818e4b833776ff5a023623ba7b5944ce49f7551073050f988
shared_library_cuda_windows-latest_x86_64_12.3.2 Expired
7.24 MB
sha256:f516d4f9df1854b8f973d43d8989bc13aa082158d374cf2704e1689afb24dca7
shared_library_cuda_windows-latest_x86_64_12.4.1 Expired
7.2 MB
sha256:3e0ab78e7d51665154a5dc9a6d17b9eaa62db0d9b320c68cb51d69e60ee2fc04
shared_library_cuda_windows-latest_x86_64_12.5.1 Expired
7.22 MB
sha256:19dc60d17ae15374ae30569979bcbd589f21842b544a3ccab072f57a2ba4c0ab
shared_library_cuda_windows-latest_x86_64_12.6.3 Expired
7.23 MB
sha256:925a589ed5545a30174af9ce644cfd2b9d821dd1597536fda58ebe378da3a328
shared_library_cuda_windows-latest_x86_64_12.8.1 Expired
5.82 MB
sha256:4f55cd638ab82d049a09204603d760bad969f6c1aa5355078aa44a269c9761df
shared_library_macos-latest_aarch64 Expired
8.31 KB
sha256:fd04a3a78398a26be0f180f9440882ebb1cf7137162727a09dbd707d39091fbe
shared_library_macos-latest_x86_64 Expired
8.31 KB
sha256:111f8c8b6ae53a7dd5f388d34dcd356e80c907fe9fc68f7585f4c41624ed9a0a
shared_library_ubuntu-22.04_x86_64 Expired
10 KB
sha256:e32312edd33d2c60792ebe91e22b4ac5f7ae5603ea199353776c50254bf3592d
shared_library_windows-latest_x86_64 Expired
16.3 KB
sha256:d3c2ba521eb3fb0430fb11b0fae1517e502fcdbd28397caa6496e4519c5e875e