Hey everyone,
I’m currently working on setting up a local, company-internal AI solution for a small team (30 people), and I’m trying to keep it as lean and cost-efficient as possible.
The goal is to build something that can securely use internal company knowledge (documents, processes ...) without relying heavily on external APIs or expensive infrastructure.
Ideally, it should run locally or on minimal cloud resources.
I’d really appreciate any guidance, especially on:
- Recommended open-source models / frameworks (I would use Gemma 4 atm)
- Best approaches for integrating internal data (RAG?)
- Practical setups that actually work in production
If anyone here has already built something similar or can point me in the right direction, that would be super helpful.
Thanks in advance 🙌