- 
                Notifications
    You must be signed in to change notification settings 
- Fork 4
Open
Labels
needs-priorityIndicates a PR lacks a  label and requires one.Indicates a PR lacks a  label and requires one.needs-triageIndicates an issue or PR lacks a  label and requires one.Indicates an issue or PR lacks a  label and requires one.
Description
Before we hope to implement llmlite as the proxy for different models, this is replaced by the inference engines today. But we found that there're a bunch of model arenas out there, like the lmarena.ai, however, people just want to use the best model for different use cases, I hope to make llmlite the smart router for different models on different scenarios. Also some agents like alphaevolve would like to balance the exploration and exploitation by different models, which is also a good usecase for llmlite.
Metadata
Metadata
Assignees
Labels
needs-priorityIndicates a PR lacks a  label and requires one.Indicates a PR lacks a  label and requires one.needs-triageIndicates an issue or PR lacks a  label and requires one.Indicates an issue or PR lacks a  label and requires one.