Pinned Loading

1. vllm vllm Public

   Forked from vllm-project/vllm

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python

2. DeepSpeed DeepSpeed Public

   Forked from deepspeedai/DeepSpeed

   DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

   Python

3. microsoft/pai microsoft/pai Public archive

   Resource scheduling and cluster management for AI

   JavaScript 2.7k 548

4. DeepSpeed-MII DeepSpeed-MII Public

   Forked from deepspeedai/DeepSpeed-MII

   MII makes low-latency and high-throughput inference possible, powered by DeepSpeed.

   Python