Observe, Evaluate & Optimize your LLM performance LangWatch is an end-to-end evaluation and observability platform, helping teams ship their AI agents reliably and >8x faster!
Get started (free!) | Documentation | LangEvals Documentation
Welcome to LangWatch, the all-in-one open-source LLMops platform
LangWatch allows you to track, monitor, guardrail and evaluate your LLMs apps for measuring quality and alert on issues.
For domain experts, it allows you to easily sift through conversations, see topics being discussed and annotate and score messages for improvement in a collaborative manner with the development team.
For developers, it allows you to debug, build datasets, prompt engineer on the playground and run batch evaluations or DSPy experiments to continuously improve the product.
Finally, for the business, it allows you to track conversation metrics and give full user and quality analytics, cost tracking, build custom dashboards and even integrate it back on your own platform for reporting to your customers.
You can sign up and already start the integration on our free tier by following the guides bellow:
- đź“š Read the Documentation for
- đź’» Use our SDKs to start building:
Language of choice missing? 📧 Email us, or 💬 join our Discord and let us know!
- Clone the relevant repository
-
git clone https://github.com/langwatch/langwatch.git
-
# or if you use the GitHub CLI gh repo clone langwatch/langwatch
- Follow the documentation for setup and usage
- Contribute by opening issues, submitting pull requests, or discussing ideas.
- LangWatch The core platform for LLM Ops, integrating monitoring, analytics, and optimization tools.
- LangEvals A unified framework for evaluating language models, aggregating multiple scoring methods and LLM guardrails.
- Docs Comprehensive documentation to help users set up and utilize LangWatch tools.
đź“ş Short video (3 min) for a sneak peak of LangWatch and a brief introduction to the concepts.
Contributions are what make the open-source community such an amazing place to learn, inspire, and create. Any contributions you make are greatly appreciated.
Please read our Contribution Guidelines for details on our code of conduct, and the process for submitting pull requests.
If you have questions or need help, join our community: