Open
Description
📚 The doc issue
HI vllm team,
Could you please check and update the following quantization support for the AMD GPU, thanks so much!
Doc link:
https://docs.vllm.ai/en/latest/features/quantization/supported_hardware.html
And the test report attached, FYI.
Support Matrix
Based on the test record, the current support status of AMD GPU:
Test report :
vllm-Quantization-Test-Report.pdf
Suggest a potential alternative/fix
No response
Before submitting a new issue...
- Make sure you already searched for relevant issues, and asked the chatbot living at the bottom right corner of the documentation page, which can answer lots of frequently asked questions.