Popular repositories Loading

1. vllm vllm Public

   Forked from Narsil/vllm

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python

2. text-generation-inference text-generation-inference Public

   Forked from huggingface/text-generation-inference

   Large Language Model Text Generation Inference

   Python

3. opencompass opencompass Public

   Forked from open-compass/opencompass

   OpenCompass is an LLM evaluation platform, supporting a wide range of models (Llama3, Mistral, InternLM2,GPT-4,LLaMa2, Qwen,GLM, Claude, etc) over 100+ datasets.

   Python

4. RL RL Public

   Forked from NVIDIA-NeMo/RL

   Scalable toolkit for efficient model reinforcement

   Python

5. NeMo NeMo Public

   Forked from NVIDIA-NeMo/NeMo

   A scalable generative AI framework built for researchers and developers working on Large Language Models, Multimodal, and Speech AI (Automatic Speech Recognition and Text-to-Speech)

   Python

6. Megatron-Bridge Megatron-Bridge Public

   Forked from NVIDIA-NeMo/Megatron-Bridge

   Training library for Megatron-based models

   Python