You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: README.md
+11-12Lines changed: 11 additions & 12 deletions
Original file line number
Diff line number
Diff line change
@@ -70,7 +70,6 @@ pip install auto-round-lib
70
70
```
71
71
72
72
</details>
73
-
<br>
74
73
75
74
## Model Quantization
76
75
@@ -124,11 +123,11 @@ auto-round-fast \
124
123
``` -->
125
124
126
125
</details>
127
-
<br>
128
126
129
-
In conclusion, we recommend using **auto-round for INT4 and auto-round-best for INT2**. However, you may adjust the configuration to suit your specific requirements and available resources.
127
+
In conclusion, we recommend using **auto-round for INT4 and auto-round-best for INT2**. However, you may adjust the configuration to suit your specific requirements and available resources.
128
+
129
+
W4G128 Average Accuracy of 13 tasks and Time Cost Results(Testing was conducted on the Nvidia A100 80G using the version of PyTorch 2.6.0 with enable_torch_compile):
130
130
131
-
Average Accuracy of 13 tasks(W4G128) and Time Cost(enable_torch_compile) Results
0 commit comments