Skip to content

Conversation

@Jiang-Stan
Copy link
Collaborator

@Jiang-Stan Jiang-Stan commented Jul 30, 2023

首尾层8w8f
weight 不同Observer实验:

Model config float MinMax MSE Percentile w/ alpha=1e-3 ACIQ
ResNet18 4w8f weight per-channel-symmetric 69.76% 56.91% 57.59% 58.31% 52.95%
ResNet18 4w8f weight per-group-symmetric group_size=32 69.76% 59.64% 62.08% 59.67% 52.23%
ResNet18 4w8f weight per-group-symmetric group_size=8 69.76% 66.57% 65.99% 66.57% 50.29%

feature不同Observer实验:

Model config float MinMax MSE Percentile w/ alpha=1e-3 ACIQ
ResNet18 8w4f feature per-tensor-affine 69.76% 57.51% 67.90% 67.45% 67.71%
ResNet18 8w4f feature per-group-affine group_size=32 69.76% 60.18% 67.94% 67.49% 67.15%
ResNet18 8w4f feature per-group-affine group_size=8 69.76% 62.69% 67.68% 67.27% 65.496%

@Jiang-Stan Jiang-Stan requested a review from hych2020 July 30, 2023 14:39
@Jiang-Stan Jiang-Stan force-pushed the jst/add_groupwise_quantization branch from 80ce699 to b55dc36 Compare July 31, 2023 03:07
seems ok version

seems ok version

tested ok version

disable input quantizer of silu and upsample

rectified version

black

black

fix bug

fix bug

black
@Jiang-Stan Jiang-Stan force-pushed the jst/add_groupwise_quantization branch from b55dc36 to 61b2b5d Compare July 31, 2023 03:10
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant