Skip to content

Commit 4132085

Browse files
authored
chore(model gallery): add ibm-granite_granite-4.0-h-micro (#6375)
Signed-off-by: Ettore Di Giacinto <[email protected]>
1 parent c14f1ff commit 4132085

File tree

1 file changed

+14
-0
lines changed

1 file changed

+14
-0
lines changed

gallery/index.yaml

Lines changed: 14 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -35,6 +35,20 @@
3535
- filename: ibm-granite_granite-4.0-h-tiny-Q4_K_M.gguf
3636
sha256: 33a689fe7f35b14ebab3ae599b65aaa3ed8548c393373b1b0eebee36c653146f
3737
uri: huggingface://bartowski/ibm-granite_granite-4.0-h-tiny-GGUF/ibm-granite_granite-4.0-h-tiny-Q4_K_M.gguf
38+
- !!merge <<: *granite4
39+
name: "ibm-granite_granite-4.0-h-micro"
40+
urls:
41+
- https://huggingface.co/ibm-granite/granite-4.0-h-micro
42+
- https://huggingface.co/bartowski/ibm-granite_granite-4.0-h-micro-GGUF
43+
description: |
44+
Granite-4.0-H-Micro is a 3B parameter long-context instruct model finetuned from Granite-4.0-H-Micro-Base using a combination of open source instruction datasets with permissive license and internally collected synthetic datasets. This model is developed using a diverse set of techniques with a structured chat format, including supervised finetuning, model alignment using reinforcement learning, and model merging. Granite 4.0 instruct models feature improved instruction following (IF) and tool-calling capabilities, making them more effective in enterprise applications.
45+
overrides:
46+
parameters:
47+
model: ibm-granite_granite-4.0-h-micro-Q4_K_M.gguf
48+
files:
49+
- filename: ibm-granite_granite-4.0-h-micro-Q4_K_M.gguf
50+
sha256: 48376d61449687a56b3811a418d92cc0e8e77b4d96ec13eb6c9d9503968c9f20
51+
uri: huggingface://bartowski/ibm-granite_granite-4.0-h-micro-GGUF/ibm-granite_granite-4.0-h-micro-Q4_K_M.gguf
3852
- &ernie
3953
url: "github:mudler/LocalAI/gallery/chatml.yaml@master"
4054
name: "baidu_ernie-4.5-21b-a3b-thinking"

0 commit comments

Comments
 (0)