error downloading Llama2 #876
              
                Unanswered
              
          
                  
                    
                      yalicohen12
                    
                  
                
                  asked this question in
                Q&A
              
            Replies: 0 comments
  
    Sign up for free
    to join this conversation on GitHub.
    Already have an account?
    Sign in to comment
  
        
    
Uh oh!
There was an error while loading. Please reload this page.
-
hi, i am facing an error while trying to download llm server with LLama2 7b model, would love some help.
command i used: sudo docker run --rm -it -p 3000:3000 ghcr.io/bentoml/openllm start/TheBloke/Llama-2-7B-Chat-GGUF --quantize int4
Beta Was this translation helpful? Give feedback.
All reactions