Skip to content
View DefTruth's full-sized avatar
🎯
#pragma unroll
🎯
#pragma unroll

Organizations

@vipshop @PaddlePaddle @xlite-dev

Block or report DefTruth

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Please don't include any personal information such as legal names or email addresses. Maximum 100 characters, markdown supported. This note will be visible to only you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
DefTruth/README.md

Pinned Loading

  1. xlite-dev/LeetCUDA xlite-dev/LeetCUDA Public

    📚LeetCUDA: 200+ CUDA/Tensor Cores Kernels, HGEMM, FA2 MMA.

    Cuda 4.7k 508

  2. xlite-dev/lite.ai.toolkit xlite-dev/lite.ai.toolkit Public

    🛠 A lite C++ AI toolkit: 100+🎉 models with MNN, ORT and TRT.

    C++ 4.1k 743

  3. xlite-dev/Awesome-LLM-Inference xlite-dev/Awesome-LLM-Inference Public

    📚A curated list of Awesome LLM Inference Papers with Codes.

    Python 4.1k 283

  4. PaddlePaddle/FastDeploy PaddlePaddle/FastDeploy Public

    Large Language Model Deployment Toolkit

    Cuda 3.2k 481

  5. xlite-dev/ffpa-attn xlite-dev/ffpa-attn Public

    📚FFPA: Extend FA2 with Split-D for large headdim, 2x↑ vs SDPA.

    Cuda 185 8

  6. vllm-project/vllm vllm-project/vllm Public

    A high-throughput and memory-efficient inference and serving engine for LLMs

    Python 49.3k 7.9k