Open
Description
Your current environment
Is it possible for nightly builds to be published to the container registry?
https://hub.docker.com/r/vllm/vllm-openai/tags
According to this issue, it seems like nightly (ish) wheels are available: #4949
It would be very convenient to do the same for the Docker images.
I have tried to build myself by pulling master and performing
sudo podman build -t vllm -f docker/Dockerfile --target vllm-openai .
But this 1) takes a VERY long time and 2) ultimately fails with a CUDA error. Of course, the build failure is the fault of my machine/environment, not VLLM, but I'm saying the pain could be entirely eliminated if nightly images were available.
How you are installing vllm
No response
Before submitting a new issue...
- Make sure you already searched for relevant issues, and asked the chatbot living at the bottom right corner of the documentation page, which can answer lots of frequently asked questions.