Local model runners. What hardware are you using?

I don't have good hardware right now for local model running. I am thinking about setting up an actual good box for this purpose. I will probably end up getting a graphics card and putting on some older hardware. but I also hear good things about some other setups. (Mac mini, etc.) want to get people's thoughts

5 comments

Local model runners. What hardware are you using?