Jun 17 • 💬 General
2× RTX 4090 (24GB each) OR 1× RTX 6000 Ada (48GB)
Hi all, which GPU would you recommend? I am building a multi-agent on local with multiple LLM Models. I can start with small open source models but i want to build a machine enough for 70B GGUF or 33B full precision in the future. Does anyone consider this type of hardware? Or you use all on Cloud Services? Any suggestion appreciated.
2
9 comments
2× RTX 4090 (24GB each) OR 1× RTX 6000 Ada (48GB)
skool.com/data-alchemy
Your Community to Master the Fundamentals of Working with Data and AI — by Datalumina®
Leaderboard (30-day)
1
+203
2
+74
3
+33
4
+32
5
+28
Powered by