Ollama, LM Studio, vLLM or Llama.cpp? · Open Source AI Builder's Club

Ollama, LM Studio, vLLM or Llama.cpp?

Classic question I get all the time.

It's like asking whether I should have mcdonalds, kfc, taco bell or burger king for lunch?

really depends on your levels of:

It's the same with choosing your go to AI engine:

Hunger - Pick the engine that speaks out to you the most. The one you can't stop thinking about.
Comfort - Pick the engine that speaks to your comfort zone rather than making you feel out of your depth.
Trust - Pick the engine that YOU trust the most. Not what the community trusts.
Convenience - Pick the engine that is so simple and easy for you to use that you can do it in your sleep (and most likely will at some point lol).

For me, it's always llama.cpp. For you it might be something different.

The reality is, it doesn't matter what burger you use.

So long as it satisfies your needs

2 comments