Skip to content

Commit a7c7a0e

Browse files
authored
Merge pull request #76 from quotient-ai/deanna/remove-0.5B
removing 0.5B model version
2 parents 534caa4 + b507dcf commit a7c7a0e

File tree

1 file changed

+3
-3
lines changed

1 file changed

+3
-3
lines changed

steering/quotient-mcp.mdx

Lines changed: 3 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -21,7 +21,7 @@ Evaluates whether an AI agent correctly used available tools in a conversation c
2121
**Parameters:**
2222
- `available_tools`: Array of tool definitions with schemas
2323
- `message_history`: Array of conversation messages
24-
- `model_size`: One of "0.5B", "3B", or "7B"
24+
- `model_size`: One of "3B" or "7B"
2525

2626
**Returns:**
2727
- `score`: `"correct"`, `"incorrect_tool"`, `"incorrect_parameter_names"`, or `"incorrect_parameter_values"`
@@ -71,7 +71,7 @@ Evaluates whether an AI agent correctly used available tools in a conversation c
7171
]
7272
}
7373
],
74-
"model_size": "0.5B"
74+
"model_size": "7B"
7575
}
7676
```
7777

@@ -85,7 +85,7 @@ Evaluates whether an AI agent correctly used available tools in a conversation c
8585

8686
### Underlying Model
8787

88-
The evaluation is powered by the [Limbic Tool Use Evaluator](https://huggingface.co/quotientai/limbic-tool-use-0.5B-32K), a fine-tuned Qwen 2.5 model specifically designed for MCP function call evaluation. There are 0.5B, 3B, and 7B versions of this model.
88+
The evaluation is powered by the Limbic Tool Use Evaluators, fine-tuned Qwen 2.5 models specifically designed for MCP function call evaluation. There are 3B and 7B versions of this model. You may also use the open-sourced [0.5B model](https://huggingface.co/quotientai/limbic-tool-use-0.5B-32K) if you prefer to run this locally.
8989

9090
## Integration Examples
9191

0 commit comments

Comments
 (0)