Skip to content

Experimental GPU support

Choose a tag to compare

View all tags
@LLukas22 LLukas22 released this 27 Jun 13:31
· 19 commits to main since this release
0.2.12
3eef549

Adds support for Metal/CUDA and OpenCL acceleration for LLama-based models.

Adds CI for the different acceleration backends to create prebuild binaries

Assets 4
Loading