Hardware spec for a capable local LLM?

I'm looking for real-world experience here. I'm considering building a machine to serve a local LLM. I have a custom built machine with a Ryzen 5 and 32Gb of DDR5 sitting here unused for six months after a non-AI project was cancelled. Based on your own experience, what would I need to add to get decent local performance and what would be the best way to access remotely? What model should I use. I have a max budget of €3K additional

2 comments