Improve Small Model Compatibility

[athulchandroth]

Description

Smaller Ollama models (below 32B parameters) are failing to properly handle function calling, causing loops and hallucinations in the summarization process.

Impact

• Users with limited resources cannot use smaller models
• Inconsistent behavior with different model sizes
• Poor summarization quality with smaller models

Acceptance Criteria

1. Identify minimum model requirements
2. Add model compatibility checking
3. Clear error messages for incompatible models
4. Documentation of supported models
5. Fallback options for lower-resource systems

Priority

Medium - Affects subset of users using smaller models

[sujithatzackriya]

We have decided to try and experiment fine tuning a small language model for better and accurate summary generation