Pinned Loading

1. sgl-project/sglang sgl-project/sglang Public

   SGLang is a fast serving framework for large language models and vision language models.

   Python 16.2k 2.4k

2. sgl-project/genai-bench sgl-project/genai-bench Public

   Genai-bench is a powerful benchmark tool designed for comprehensive token-level performance evaluation of large language model (LLM) serving systems.

   Python 174 14

3. sgl-project/ome sgl-project/ome Public

   OME is a Kubernetes operator for enterprise-grade management and serving of Large Language Models (LLMs)

   Go 191 29

4. rlworkgroup/garage rlworkgroup/garage Public

   A toolkit for reproducible reinforcement learning research.

   Python 2k 319