PromptTuna

Auto-optimize your prompts using local LLMs — with scoring, ranking, and feedback

What is PromptTuna?

PromptTuner helps you refine your prompts by:

• Generating multiple variations of a given base prompt
• Sending them to a local LLM (e.g., TinyLLaMA or Phi via Ollama or LM Studio)
• Collecting outputs and scoring them against a reference output
• Ranking the most effective prompt variants

Stack

• Python 3.10+
• Ollama or LM Studio
• Local LLMs: TinyLLaMA / Phi / Mistral
• Sentence Transformers (for scoring)
• Streamlit (coming soon)

How to Run

1. Clone the repo
2. Set up virtualenv
3. Install dependencies: pip install -r requirements.txt
4. Start: python main.py

LICENSE

MIT - Free to use, improve, and contribute.

Contribute

PRs welcome! Mode models, scoring metrics, and UI coming soon.