17h • Build Logs & Demos
Building a new local stack on an AMD-based mini-pc
Hey all. I did set up a small local stack on my laptop, but I want to have a local LLM server, so this week I'm installing a new mini-pc with AMD Strix Halo and 64GB (that's all my budget can stretch to in these days of killer inflation) under linux. I'm looking for your recommendations and suggestions how to "build it right" from the ground up.
If there's enough interest, I'll post updates whenever I make progress so others can learn from my mistakes and wiser people can correct my steering.
The goal is to be able to have an always-on, secure LLM and workspace with toolsets that let me host/test projects and invoke both frontier and local models as needed, without needing to have my laptop open all the time, yet able to be remotely invoked by my laptop on demand, too.
2
1 comment
Building a new local stack on an AMD-based mini-pc
skool.com/join-dlag
Build practical local AI systems with serious builders. Free news and discussions. Builder adds calls, implementation help, demos, and recordings.
Leaderboard (30-day)
1
+3
2
+3
3
+3
4
+2
5
+2
Powered by