Skip to content

llama模型支持 #52

Open
Open
@miaobyte

Description

@miaobyte

代码除了import torch,需要和和transformers保持一致。但需要精简掉分布式、kvcache的后端配置

https://github.com/huggingface/transformers/blob/main/src/transformers/models/llama/modeling_llama.py

Metadata

Metadata

Assignees

No one assigned

    Labels

    model_todo待增加的内置模型结构

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions