LLM are cool, but SLM are enough

I was very skeptical about the whole concept of local models, and i cannot explain how wrong i was.

Let me share this very nice money saver for small tasks.

LMStudio acts as your repository for local models.

Continue is the opensource agentic workforce that allows you to replicate most of the copilot features

when you combine the local models with your agentic code builder it's basically copilot for free.

The only limits are the resources you can allocate, and in my case are not much...

that is why i use https://lmstudio.ai/models/mistralai/ministral-3-3b which is likely one of the best trade off between size and quality i have seen so far.

And the next step... is to leverage ollama to build your own batch llm service and ditch api call costs.

1 comment

skool.com/data-alchemy

Your Community to Master the Fundamentals of Working with Data and AI — by Datalumina®

Leaderboard (30-day)

+203

+76

+32

+28

+22