Ran across this project and looks interesting so going to give it a try. Posting it here if anyone else wants to try it. https://www.projectnomad.us/ https://github.com/Crosstalk-Solutions/project-nomad
I saw the video on YouTube by the project creator a couple weeks ago. I plan to try it but haven't gotten to that part of my ever growing to-do list yet.
I've tried setting it up today and not had much success. Everything I try to do, such as update Pegaprox or add a cluster results in it saying what I'm doing is unauthorized. I'm thinking. I set it up by downloading their pre-made lxc container. I'm going to delete that and start over with a Debian container where I'll run the install script and see if that works any better.
What am I self-hosting? - OpenWebUI - Ollama - llama3, codellama, gemini, phi3, etc - Kubectl-AI (***New!***) just dropped from Google Paid tools that I think are good? - Windsurf (paid product with free tier) - WarpAI (paid product with free tier) Tell me what I am missing from my list. Let me know what you are using.
@Brandon Lee So this isn't as successful as I originally thought. Admittedly I'm running this on a less than optimal setup. Sometimes under load from using the AI the lxc just shuts off as if someone pulled the virtual plug. I'm going to start over with a full VM instead of the lxc and see how that goes.
I unfortunately do not have any good GPU cards to use but I'm still playing with AI some. I have one Proxmox container running llama.ccp and have 3 nodes connected to it with RPC server, including a container on another Proxmox host, an old Intel NUC and a Dell desktop with an I5 CPU and 16 gb RAM. I've tried several models on that setup. It does pretty well but it's far from fast. I'd love to have a better setup but I've got what I've got. I'm also hosting Ollama with a couple models that normally only get started up when Karakeep signals them to generate tags for a new link I've added.
This looks awesome. Maybe just what I'm needing that will let me kill off the lone remaining Windows machine in my home. I kept it for a few Windows only apps I need from time to time. I need to spend more time reading through the site before I'm sure I can do this.
Proxmox Cluster Operations Every Home Labber Hopes They Never Need (Until They Do) https://www.virtualizationhowto.com/2026/02/proxmox-cluster-operations-every-home-labber-hopes-they-never-need-until-they-do/