Popular repositories Loading

1. LLMCompiler LLMCompiler Public

   [ICML 2024] LLMCompiler: An LLM Compiler for Parallel Function Calling

   Python 1.7k 123

2. SqueezeLLM SqueezeLLM Public

   [ICML 2024] SqueezeLLM: Dense-and-Sparse Quantization

   Python 701 49

3. TinyAgent TinyAgent Public

   [EMNLP 2024 Demo] TinyAgent: Function Calling at the Edge!

   Python 430 72

4. KVQuant KVQuant Public

   [NeurIPS 2024] KVQuant: Towards 10 Million Context Length LLM Inference with KV Cache Quantization

   Python 368 34

5. LLM2LLM LLM2LLM Public

   [ACL 2024] LLM2LLM: Boosting LLMs with Novel Iterative Data Enhancement

   Python 188 14

6. SqueezedAttention SqueezedAttention Public

   SQUEEZED ATTENTION: Accelerating Long Prompt LLM Inference

   Python 50 8