The r/LocalLLM subreddit is currently buzzing with discussions about hardware optimization, benchmarking small models, and the rising dominance of Chinese open-source models. Users are actively comparing high-end setups like the RTX 5090 and MacBook Pro M5 Max, while sharing technical breakthroughs in running models locally. The overall mood is highly technical, collaborative, and enthusiastic about the capabilities of local, open-source AI.
What's the smallest model that can audit a webpage without inventing findings? I tested 4 on CPU (Qwen2.5-1.5B → Qwen3.5-9B) — u/Annual_Manner_5901
The author tested four small models on a MacBook M3 Pro to see which could audit a webpage without hallucinating. Qwen3.5-9B performed perfectly, while smaller models either invented findings or made arithmetic errors.
If you had to choose ONE: RTX 5090 Workstation vs DGX Spark (or 2-node cluster) vs MacBook Pro M5 Max 128GB for AI development? — u/PuzzleheadedCard757
A user asks for advice on choosing a long-term AI development machine, comparing a high-end RTX 5090 PC, a DGX Spark cluster, and a MacBook Pro M5 Max.
Best local open-source AI model for a MacBook Pro M5 Max (128GB)? — u/knightprey21
The author is seeking recommendations for local open-source models to replace ChatGPT and Claude on a high-end MacBook Pro. They are currently testing Qwen3-Coder-Next and Qwen3.6 models.
Time to pop off with our favorite model, GPT2 — u/snarkyalyx
A brief post showing a Raspberry Pi running the classic GPT-2 model.
Tried running GLM 5.2 on my locale 64GB ram — u/Strange_Chair_4051
A short post about trying to run the GLM 5.2 model locally with 64GB of RAM.
Chinese AI Models Seize OpenRouter’s Top Five as OpenAI and Google Vanish From the Top 10 — u/etherd0t
This post discusses how Chinese AI models have taken over the top five spots on OpenRouter's monthly token-usage leaderboard, leaving OpenAI and Google out of the top ten.
Like music to my ears — u/JolluxFraction
The author shares their experience hearing the physical sound of electricity moving through V100 SXM2 cards while running local LLMs.
Update: I Fixed My “Half-Speed” EPYC Build— It Was the Kernel — u/farcryjohn
The author shares an update on fixing a performance issue with their multi-GPU AMD EPYC build, which was resolved by enabling specific peer-to-peer options in the Linux kernel.
