Feb 6 โข ๐ค General
Local LLM
๐ Running DeepSeek R1 Distill Qwen &7b 8bit (mlx community) on my M1 Mac with 16gb memory - getting almost 23.139 tokens per second! Not bad for a 2-year-old Mac. No internet, No data leak risk, so total privacy. Plus there's no limit on the output, which is great. Planning to switch to using local code generation so that I can have unlimited generations. Anyone still paying for tokens?
#DeepSeek #LocalAI #PrivacyFirst #UnlimitedAI #M1Performance
12
6 comments
Local LLM
skool.com/netregie-ai-2617
๐ง๐ฟ๐ฎ๐ป๐๐ณ๐ผ๐ฟ๐บ ๐๐ผ๐๐ฟ ๐๐ผ๐บ๐ฝ๐ฎ๐ป๐ ๐ฆพ Unlock #๐๐ for your ๐ฏ๐๐๐ถ๐ป๐ฒ๐๐! ๐ค ๐ฆ๐ง๐๐ฅ๐ง ๐ฌ๐ข๐จ๐ฅ ๐๐ข๐จ๐ฅ๐ก๐๐ฌ ๐ก๐ข๐ช โคต๏ธ
Leaderboard (30-day)
1
+4
Powered by