community
Reddit LocalLLaMA
2026-07-19T18:08
正文 thin
Fable got blocked because it was too dangerous in cybersecurity. Does k3 has the same "power"? I'mm only seeing people vibe coding games, 3d scenarios, front end stuff. What about the guard rails? submitted by /u/Stock-Union6934 [link] [comments]
community
Reddit LocalLLaMA
2026-07-19T17:56
正文 thin
I've tested the new Qwen3.8 Next model (via their web app) and found that it is often getting stuck in thinking loops and the fronend/design capabilities are not as good as advertised. Hope things are going to improve for the final release. Examples here: https://www.youtube.com/watch?v=bZr3Bb0N2dk
community
Reddit LocalLLaMA
2026-07-19T14:12
正文 thin
Imma write some fan fiction for a second here if you indulge me. What we are seeing from the Chinese open models could have been Meta. As you can see from the name of this sub, they were the stars of open-source models, and the consistently poor decisions by their senior leadership just fumbled it
community
Reddit LocalLLaMA
2026-07-19T12:58
正文 thin
Hey, I’ve been really excited to see the latest models being released, but I keep wondering: what are we actually supposed to do with them? I have 4× RTX 6000 Max-Q GPUs, 7× RX 7900 XTXs, 5× modded 48GB RTX 4090s, and a lot of DDR5 RAM.... and honestly, I can’t even imagine running Kimi K3 at a genu
community
Reddit LocalLLaMA
2026-07-19T12:46
正文 thin
Ok i'm sort of getting desperate here. So i am currently running Qwen 3.6 27B locally at Q8_K_XL and with only ~105k CTX at q8_0. Before i tried it at Q8_0 but with F16 KV cache. Of course i also tried lower quants down to Q6 and bigger context sizes up to 256k at F16 For a harness i use Opencode wi
community
Reddit LocalLLaMA
2026-07-19T11:02
正文 thin
This seems awesome meetup. Within a day, Qwen started the move with 3.8 version. Hoping for more moves from others soon. Tweet : https://xcancel.com/RenLeanna/status/2078144481812185186#m submitted by /u/pmttyji [link] [comments]
community
Reddit LocalLLaMA
2026-07-19T10:23
正文 thin
https://chat.qwen.ai/ submitted by /u/Nunki08 [link] [comments]
community
Reddit LocalLLaMA
2026-07-19T09:17
正文 thin
ASCIITermDraw-Bench: Can a Model Actually Draw in ASCII? Do we really need a image generator to relay our thoughts about - an architecture? a topology? a cluster og N nodes? Is it possible to let our AI assistants, easily absorb and understand and make possible changes easily relayed to the
community
Reddit LocalLLaMA
2026-07-19T08:12
正文 thin
https://preview.redd.it/0l8w2j67a5eh1.png?width=581&format=png&auto=webp&s=cae9d3ef7cf80cea780e0670f7dede73d1c02d49 https://x.com/Alibaba_Qwen/status/2078754377473601787?s=20 submitted by /u/Lowkey_LokiSN [link] [comments]
community
Reddit LocalLLaMA
2026-07-19T07:45
正文 thin
I Went through the Inkling model card and the Bridgewater/Tinker case study instead of the press coverage. Coverage mostly quoted the 97.1% AIME 2026 number; the rest of the table tells a more mixed story. AIME 2026: Inkling 97.1%, GLM 5.2 99.2%, Fable 5 and GPT-5.6 Sol both 99.9%. Everyone on the l
community
Reddit LocalLLaMA
2026-07-19T02:47
正文 thin
I am using unsloth Q8 Deepseek v4 Flash. So far I am able to run properly with the following command CUDA_DEVICE_ORDER=PCI_BUS_ID CUDA_VISIBLE_DEVICES=0,2,1 \ llamacpp/llama.cpp/build/bin/llama-server \ --model unsloth/DeepSeek-V4-Flash-GGUF/UD-Q8_K_XL/DeepSeek-V4-Flash-UD-Q8_K_XL-00001-of-00005.ggu
community
Reddit LocalLLaMA
2026-07-19T01:45
正文 thin
Hi! Been doing some local LLM stuff, and I can't help but notice: despite vastly-superior benchmark scores, Qwen 3.6 35a3B feels... substantially less intelligent than Gemma 4 26a4B (QAT). In terms of prompt adherence, output coherence, and just general "sanity", Gemma seems head-and-shoulders ahead
community
Reddit LocalLLaMA
2026-07-19T01:15
正文 thin
Dean W. Ball analyzes China's Kimi model, noting its strong performance while expressing surprise that the Chinese government permits open-sourcing such capable AI due to potential risks. He argues that open-weight models ultimately slow down AI capital expenditure and could lead to a state-co
community
Reddit LocalLLaMA
2026-07-18T23:10
正文 thin
It a single file 20k lines ;P https://github.com/illsk1lls/MiniBot (i previously posted v1 of this, which was not WPF) This is for local models only. Although it is OpenAI compatible. Have your favorite AI scan it to make sure its safe enough for you... Tools are enabled as needed, automatical
community
Reddit LocalLLaMA
2026-07-18T21:06
正文 thin
I am in the middle of considering an upgrade to my Home Server. I want to get a decent GPU for LocalAI. I mean, I have an RTX 4060 TI 16GB, I know that is much more than most people have, but even though it has a lot of cram the bus width is really slowing it down - I get ~23 tok/s on Gemma 4 26b A4
community
Reddit LocalLLaMA
2026-07-18T19:26
正文 thin
Hi LocalLLaMA! I've been building a small CLI tool for managing agent skills. I wanted a quick way to add and switch between different skill sets without manually copying folders around or losing track of which revision was installed (I tend to try different variations of the same skill and try to
community
Reddit LocalLLaMA
2026-07-18T18:49
正文 thin
Repository: https://github.com/fredconex/Arandu Hello Guys, This is Arandu a open source app to easily launch models using llama.cpp, it tries to integrate all in one place with easy multi version management of llama.cpp, HuggingFace models search/download, intuitive arguments with presets and
community
Reddit LocalLLaMA
2026-07-18T15:50
正文 thin
submitted by /u/Charuru [link] [comments]
community
Reddit LocalLLaMA
2026-07-18T09:17
正文 thin
I like to use the MoE modles qwen3.6-35B and Gemma-4-26B. I noticed differences in result quality between versions from different providers, like bartowski, unsloth, lm-studio, google, etc. My tests dont give me a clear answer to though. Is there a rule if thumb which provider to prefer for 1) codin
community
Reddit LocalLLaMA
2026-07-18T08:58
正文 thin
I was taking a look at Kimi K3 scores on the Artificial analysis leaderboard and was quite baffled when I saw this chart. Granted, Deepseek has always been the king of price to performance, but this is still incredible. Is it just API subsidization or have they optimized their models truly thi
community
Reddit LocalLLaMA
2026-07-18T06:35
正文 thin
We’re building a robotics data platform with a lot of images, video, and text metadata. For search, we use SigLIP 2. GPUs handle batched asynchronous image/video embedding and indexing, while this small Rust + ONNX Runtime service handles live text queries on CPU. Both land in the same embedding spa
community
Reddit LocalLLaMA
2026-07-18T06:33
正文 thin
one-shot. 3.5 hrs. that's insane. play with it here: https://macos27.kimi.page/ Original X post: https://x.com/mweinbach/status/2077878247920951400 that's insane. submitted by /u/AsejereDaDeje [link] [comments]
community
Reddit LocalLLaMA
2026-07-18T04:54
正文 thin
I have three Radeon AI PRO R9700s. I wanted to know if I could tune a quant for this specific hardware instead of just using the generic upstream formats. Came across the Github project for ROCmFPX by the wonderful Carlo Pasquale and started digging in. The fastest variant I've used is the MTP versi
community
Reddit LocalLLaMA
2026-07-18T01:50
正文 thin
New day new model....... can't wait to see in a few weeks how Minimax 3 Pro (2.7T parameters) and GLM 5.3 reinforces the narrative. As a group, all of them are accelerating their progress. THAT is the strength of open source. Meanwhile less enterprises are going to trust Anthropic and OpenAI. Why?
community
Reddit LocalLLaMA
2026-07-18T00:43
正文 thin
so part of what inspired my benchmark post was that it does seem like folks here are generally converging on "unless you are able to operate at very large scales with a lot of system RAM and VRAM, the best model for code work is generally Qwen3.6-27B." what I'm hoping is that we have some good place
community
Reddit LocalLLaMA
2026-07-18T00:28
正文 thin
submitted by /u/Qwen30bEnjoyer [link] [comments]
community
Reddit LocalLLaMA
2026-07-17T23:47
正文 thin
I've seen the benchmarks, they supposedly right up there with Fable 5 and Sol 5.6. Howerver I'm skeptical of benchmarks and the kimi k3 creators even mentioned the user experience isn't quite on par. How is K3 doing on coding? How is the personality? Does it's thinking and train of thought feel hi
community
Reddit LocalLLaMA
2026-07-17T19:58
正文 thin
TL;DR: I ran DeepSeek-V4-Flash through the same 89-task Terminal-Bench 2.1 suite on two very different local setups: an aggressively quantized 80.8 GiB GGUF on one 128 GB M5 Max MacBook; the native mixed FP8/FP4 checkpoint with DSpark speculative decoding on 2× DGX Spark. The Mac finished at 47/87
community
Reddit LocalLLaMA
2026-07-17T19:48
正文 thin
submitted by /u/Charuru [link] [comments]
community
Reddit LocalLLaMA
2026-07-17T18:34
正文 thin
TL;DR: This post is part update, mostly thank you for your support :)) Observer is an open-source app that lets local LLMs watch your screen and notify you (WhatsApp/SMS/email/Discord) when something happens. A year of your feedback later, setup went from "flaky and very manual" (your words, and fai