Help Needed: LLM Model for Summarization

Beginners
1

Hi all,

I’m a beginner in working with LLMs and I’m looking to integrate a summarization feature into my analytics dashboard. The dashboard displays KPI results, charts, benchmarking data, and anomalies. My goal is to generate summaries that are easy for both technical and non-technical users to understand.

I’m planning to use Ollama to process the results and generate the summaries.

Could you please suggest which LLM model would be best suited for this kind of summarization task?

Thanks in advance!

1 Like
2

I think that any LLM can handle commands if given the right prompts. The output will reflect the model’s unique characteristics rather than its overall performance.
With Ollama, almost any model can be used. The rest depends on the computer’s performance.

For longer context length, PHI-3 is a good choice. If you’re looking for something small but powerful, SmolLM3 might be worth considering.

For a more detailed search, utilize leaderboards.

2 Likes
3

SmolLM would be a very good option, you can also check out flan-t5

2 Likes