Pinned Loading

1. sgl-project/sglang sgl-project/sglang Public

   SGLang is a fast serving framework for large language models and vision language models.

   Python 15.9k 2.3k

2. sgl-project/genai-bench sgl-project/genai-bench Public

   Genai-bench is a powerful benchmark tool designed for comprehensive token-level performance evaluation of large language model (LLM) serving systems.

   Python 168 10

3. rlworkgroup/garage rlworkgroup/garage Public

   A toolkit for reproducible reinforcement learning research.

   Python 2k 318

4. sgl-project/ome sgl-project/ome Public

   OME is a Kubernetes operator for enterprise-grade management and serving of Large Language Models (LLMs)

   Go 163 14