Local computer or VPS hosted

I am looking at running Hermes with Ollama as a starting framework. My old Windows workstation had to be upgraded to a system with a TPM, so I am looking into installing Linux on it and using it as my AI system.

The computer is an old Lenovo workstation running a 10-core Xeon CPU with 32GB of RAM and 1 GB of drive space. It has an NVIDIA video card (GPU). It should make for a fairly robust system.

My question is then: is this plan sound, or should I be looking at running my AI infrastructure on a VPS?

Looking for things I should consider and recommendations.

Thanks for your input.

13 comments