- Using a local LLM to classify queries.
- Using grammar files to constrain LLM output.
Using Meta-Llama-3-8B-Instruct-Q5_K_M.gguf but any decent smallish param should
suffice. Prompt is setup for Llama2 chat structure.
-
Notifications
You must be signed in to change notification settings - Fork 0
aldarisbm/classifier
Folders and files
| Name | Name | Last commit message | Last commit date | |
|---|---|---|---|---|
Repository files navigation
About
No description, website, or topics provided.
Resources
Stars
Watchers
Forks
Releases
No releases published
Packages 0
No packages published