community
Reddit LocalLLaMA
2026-07-22T02:42
正文 error
Properly done this time. Models as the GIFs are displayed: Qwen3.6-27B - 4bit Qwen3.6-MoE - 6bit Ornith-35B - 6bit Gemma-4-26B - 6bit Qwen3.6-MoE - 4bit HuiHui-Qwen3.6-MoE - 6bit Agents-A1 - 6bit Inference parameters: Qwen3.6 & HuiHui Abliterated: temperature 0.6 - top_p 0.95 - top_k 20 - m
community
Reddit LocalLLaMA
2026-07-22T02:33
正文 thin
Nanbeige Lab released Nanbeige4.2-3B, and if the benchmark claims hold up, the numbers are pretty crazy for a model this small. It’s built on a "Looped Transformer" architecture that reuses transformer layers to increase effective depth without inflating the parameter footprint. With just 3B n
community
Reddit LocalLLaMA
2026-07-22T02:11
正文 thin
Announcement tweet here. Direct link: Language Model Builder From the site: "Using the default settings, you’ll get a model that writes coherent, grammatical multi-paragraph text in as little as a day. On a MacBook Pro M5 Max you could train a GPT-2-small-class model (~100–150M parameters on
community
Reddit LocalLLaMA
2026-07-21T23:08
正文 thin
submitted by /u/Thrumpwart [link] [comments]
community
Reddit LocalLLaMA
2026-07-21T21:40
正文 thin
submitted by /u/Qwen30bEnjoyer [link] [comments]
community
Reddit LocalLLaMA
2026-07-21T20:29
正文 thin
Laguna-S-2.1 dropped few hours ago and as I am in the market for an upgrade to trusty qwen3.6 dense and the current daily 122B, I ran it through the same eval harness I use to pick the model that runs my local agent stack. Posting because the results don't fit the usual "benchmaxed or king" bi
community
Reddit LocalLLaMA
2026-07-21T18:58
正文 thin
Kind of unexpected. Happy for Gemma-4/Google, big win for us, LocalLLMers. Yet Qwen3.6 still does better in Hermes than Gemma-4 somehow. We need Gemma-4.1 fine-tuned on Agentic-tasks. That would be killer. submitted by /u/JLeonsarmiento [link] [comments]
community
Reddit LocalLLaMA
2026-07-21T17:39
正文 thin
Model Size Terminal-Bench 2.1 SWE-bench Multilingual SWE-Bench Pro (Public Dataset) DeepSWE SWE Atlas (Codebase QnA) Toolathlon Verified Laguna S 2.1 118B-A8B 70.2% 78.5% 59.4% 40.4% 46.2% 49.7% Finally the banger we've been waiting from Laguna. probably will be great for 64GB+ RAM and
community
Reddit LocalLLaMA
2026-07-21T16:21
正文 thin
https://huggingface.co/Nanbeige/Nanbeige4.2-3B Nanbeige4.2-3B is a compact agentic model built on Nanbeige4.2-3B-Base, designed to combine strong agentic behavior with broad reasoning and alignment capabilities. Its Looped Transformer architecture reuses the transformer layers to increase mode
community
Reddit LocalLLaMA
2026-07-21T15:00
正文 thin
$1.5 billion settlement largest known payout in U.S. copyright case Case part of a wave of lawsuits from copyright holders against AI companies Some authors and publishers opted out and continue separate cases against Anthropic submitted by /u/Terminator857 [link] [comments]
community
Reddit LocalLLaMA
2026-07-21T12:10
正文 thin
I've been working on this project that makes LLM distributions decentralized and fast using torrents. Read more about tech on Github. Website: https://llama.garden Suggested client: Transmission News: - Added more web seed URLs that go through our API that will increase speeds thanks to HTTP being f
community
Reddit LocalLLaMA
2026-07-21T11:55
正文 thin
From clem 🤗 on 𝕏: https://x.com/ClementDelangue/status/2079301434357456931 Fortune: Hugging Face says it resorted to a Chinese AI model to battle a fully autonomous cyberattack because U.S. model guardrails stymied its defense: https://fortune.com/2026/07/20/hugging-face-turns-to-chinese-open-
community
Reddit LocalLLaMA
2026-07-21T09:29
正文 thin
submitted by /u/Informal-Trouble2183 [link] [comments]
community
Reddit LocalLLaMA
2026-07-21T02:12
正文 thin
Nearly a year later, we've had safeguard fine-tunes but no general-purpose base model or successor. Will Kimi, Qwen and GLM force their hand? submitted by /u/prescorn [link] [comments]
community
Reddit LocalLLaMA
2026-07-21T00:46
正文 thin
https://huggingface.co/Motif-Technologies/Motif-3-Beta Motif-Technologies is one of the tech company participated South Korea's AI Foundation Model project. Upstage(Solar Series), LG AI Research(EXAONE Series), and SKT(A.X Series) are the competitors. Deepseek V4 Pro: 1.6T-A49B MiniMax-M3: 428
community
Reddit LocalLLaMA
2026-07-20T22:41
正文 thin
Kimi-K3’s release, while impressive, is still months behind the closed-source frontier, so all the “it’s over for Anthropic” talk feels overblown. According to Artificial Analysis, though, Kimi-K3 has brought the open-source frontier to just 1.5 months behind closed-source, putting it right on
community
Reddit LocalLLaMA
2026-07-20T21:48
正文 thin
(Slides because why not) I've been building a serverless post-quantum group-encryption protocol for the last few weeks, mostly with Opus 4.8 and Fable, with GPT-5.6 Sol running adversarial review on the most challenging part (a recovery/finality mechanism). It went through four rounds of revie
community
Reddit LocalLLaMA
2026-07-20T21:15
正文 thin
I asked myself where the Bonsai models actually land, so I ran them and compared to the results I already have for qwen-3.6-35b-a3b and qwen-3.5-9b on the same harness. Thought it might interest more people. Setup: little-coder harness via the harbor adapter, all 89 tasks of terminal-bench 2.0
community
Reddit LocalLLaMA
2026-07-20T20:44
正文 thin
My testing with android suggest it is below that. Vision on Opus is the reason. But I don't doubt that for non vision tasks Kimi k3 is on par. submitted by /u/Terminator857 [link] [comments]
community
Reddit LocalLLaMA
2026-07-20T14:48
正文 thin
Hey r/LocalLLaMA folks! Unsloth now officially supports AMD hardware for local inference, fine-tuning, reinforcement learning, and deployment! It's been in the works for quite some time, but it works on Windows, Linux & WSL devices (+ technically Mac) with AMD GPUs! Unsloth Studio is fully ope
community
Reddit LocalLLaMA
2026-07-20T14:43
正文 thin
https://np.reddit.com/r/DeepSeek/s/skO7urrE2C DS4 sort of came and went from the spotlight. The consensus seemed to be that its most notable feature is its price, and then we got distracted by the next big releases. However, people seem to forget this was only the preview version, and I think we may
community
Reddit LocalLLaMA
2026-07-20T12:27
正文 thin
David Sacks on 𝕏: https://x.com/DavidSacks/status/2078984980588531855 calle on 𝕏: https://x.com/callebtc/status/2078574362316165611 clem 🤗 on 𝕏: https://x.com/ClementDelangue/status/2078987852495364398 https://huggingface.co/blog/security-incident-july-2026 submitted by /u/Nunki08 [lin
community
Reddit LocalLLaMA
2026-07-20T12:14
正文 thin
I'm looking to run a very lightweight local model that acts as the brain, handling the logic and comprehension, while hooking it up to a web search tool to act as its memory and knowledge base. submitted by /u/chucrutcito [link] [comments]
community
Reddit LocalLLaMA
2026-07-20T11:42
正文 thin
submitted by /u/pscoutou [link] [comments]
community
Reddit LocalLLaMA
2026-07-20T09:14
正文 thin
🚀 MiniCPM enters the physical world — enabling robots to understand, remember, and act. We open-source MiniCPM-Robot, our first embodied AI model series, including: 🤖 MiniCPM-RobotManip — a 1.5B general-purpose Vision-Language-Action (VLA) model for robotic manipulation. 🐕 MiniCPM-RobotTrac
community
Reddit LocalLLaMA
2026-07-20T00:57
正文 thin
Some of you may remember my post about the research project behind this: a trained fast-weight memory, with the paper and the full research log at github.com/kkuette/thought-bank. This is the follow-up. The first public model of the series is out. Quick context: solo researcher, one RTX 3090 for eve
community
Reddit LocalLLaMA
2026-07-20T00:52
正文 thin
I haven't kept up since around February so I'm just not even sure... and there are quite a few options. I don't care about parameter size, from tiny to huge, what matters most is performance, I just want all the best safely locally stored, I'll worry about running them later. So, what do you conside
community
Reddit LocalLLaMA
2026-07-20T00:39
正文 thin
So, im 50 and autistic. I learned C++ in college when I was young and didnt really ever use it that much. I also learned a bit of assembly from using cheat engine for game hacking (dont worry! single player or private servers!) which meant I got a little LUA experience. I've always disliked coding.
community
Reddit LocalLLaMA
2026-07-19T23:52
正文 thin
the open ai exec in his "ai communism" post suggested a fraudulent FUD campaign and trump executice order against open source / chinese models. unfortunately that seems pretty likely to happen. i have always use huggingface for downloading models and they would be forced to comply. are there any es
community
Reddit LocalLLaMA
2026-07-19T19:00
正文 thin
Earlier this week, we detected and responded to an intrusion into part of our production infrastructure. This one was different from anything we had handled before in one important way: it was driven, end to end, by an autonomous AI agent system - and we detected and dissected it largely with