Skip to content
@Dao-AILab

Dao AI Lab

We are an AI research group led by Prof. Tri Dao

Popular repositories Loading

  1. flash-attention flash-attention Public

    Fast and memory-efficient exact attention

    Python 18.4k 1.8k

  2. causal-conv1d causal-conv1d Public

    Causal depthwise conv1d in CUDA, with a PyTorch interface

    Cuda 516 115

  3. quack quack Public

    A Quirky Assortment of CuTe Kernels

    Python 347 29

  4. fast-hadamard-transform fast-hadamard-transform Public

    Fast Hadamard transform in CUDA, with a PyTorch interface

    C 208 29

  5. grouped-latent-attention grouped-latent-attention Public

    Python 121 2

  6. gemm-cublas gemm-cublas Public

    Python 22

Repositories

Showing 7 of 7 repositories
  • causal-conv1d Public

    Causal depthwise conv1d in CUDA, with a PyTorch interface

    Dao-AILab/causal-conv1d’s past year of commit activity
    Cuda 516 BSD-3-Clause 115 26 10 Updated Jul 18, 2025
  • quack Public

    A Quirky Assortment of CuTe Kernels

    Dao-AILab/quack’s past year of commit activity
    Python 347 Apache-2.0 28 5 0 Updated Jul 17, 2025
  • flash-attention Public

    Fast and memory-efficient exact attention

    Dao-AILab/flash-attention’s past year of commit activity
    Python 18,447 BSD-3-Clause 1,818 780 67 Updated Jul 15, 2025
  • cutlass Public Forked from NVIDIA/cutlass

    CUDA Templates for Linear Algebra Subroutines

    Dao-AILab/cutlass’s past year of commit activity
    C++ 1 1,346 0 0 Updated Jun 8, 2025
  • Dao-AILab/grouped-latent-attention’s past year of commit activity
    Python 121 MIT 2 4 0 Updated May 29, 2025
  • gemm-cublas Public
    Dao-AILab/gemm-cublas’s past year of commit activity
    Python 22 Apache-2.0 0 0 0 Updated May 5, 2025
  • fast-hadamard-transform Public

    Fast Hadamard transform in CUDA, with a PyTorch interface

    Dao-AILab/fast-hadamard-transform’s past year of commit activity
    C 208 BSD-3-Clause 29 7 3 Updated May 24, 2024

Most used topics

Loading…