独立 AI 资讯库

AI 前沿动态、原文归档与媒体镜像

从自动抓取数据库实时读取,适合快速浏览、检索和后续扩展成完整资讯站。

12005资讯
11873正文归档
75817媒体
community Reddit LocalLLaMA 2026-07-19T18:08 正文 thin

Kimi k3 on cybersecurity

Fable got blocked because it was too dangerous in cybersecurity. Does k3 has the same "power"? I'mm only seeing people vibe coding games, 3d scenarios, front end stuff. What about the guard rails? submitted by /u/Stock-Union6934 [link] [comments]

详情 原文 相关 2 · 机会 0
community Reddit LocalLLaMA 2026-07-19T17:56 正文 thin

Tested the new Qwen 3.8 model (2.4T parameters)

I've tested the new Qwen3.8 Next model (via their web app) and found that it is often getting stuck in thinking loops and the fronend/design capabilities are not as good as advertised. Hope things are going to improve for the final release. Examples here: https://www.youtube.com/watch?v=bZr3Bb0N2dk

详情 原文 相关 2 · 机会 0
community Reddit LocalLLaMA 2026-07-19T14:12 正文 thin

It could have been Meta

Imma write some fan fiction for a second here if you indulge me. What we are seeing from the Chinese open models could have been Meta. As you can see from the name of this sub, they were the stars of open-source models, and the consistently poor decisions by their senior leadership just fumbled it

详情 原文 相关 2 · 机会 2
community Reddit LocalLLaMA 2026-07-19T12:58 正文 thin

How do we benefits from 2+ T models?

Hey, I’ve been really excited to see the latest models being released, but I keep wondering: what are we actually supposed to do with them? I have 4× RTX 6000 Max-Q GPUs, 7× RX 7900 XTXs, 5× modded 48GB RTX 4090s, and a lot of DDR5 RAM.... and honestly, I can’t even imagine running Kimi K3 at a genu

详情 原文 相关 2 · 机会 0
community Reddit LocalLLaMA 2026-07-19T12:46 正文 thin

Qwen 3.6 27B + Opencode: what am i doing wrong?

Ok i'm sort of getting desperate here. So i am currently running Qwen 3.6 27B locally at Q8_K_XL and with only ~105k CTX at q8_0. Before i tried it at Q8_0 but with F16 KV cache. Of course i also tried lower quants down to Q6 and bigger context sizes up to 256k at F16 For a harness i use Opencode wi

详情 原文 相关 2 · 机会 0
community Reddit LocalLLaMA 2026-07-19T11:02 正文 thin

OSS gathering in Shanghai

This seems awesome meetup. Within a day, Qwen started the move with 3.8 version. Hoping for more moves from others soon. Tweet : https://xcancel.com/RenLeanna/status/2078144481812185186#m submitted by /u/pmttyji [link] [comments]

详情 原文 相关 2 · 机会 0
community Reddit LocalLLaMA 2026-07-19T08:12 正文 thin

Ahem! Qwen is on the move again

https://preview.redd.it/0l8w2j67a5eh1.png?width=581&format=png&auto=webp&s=cae9d3ef7cf80cea780e0670f7dede73d1c02d49 https://x.com/Alibaba_Qwen/status/2078754377473601787?s=20 submitted by /u/Lowkey_LokiSN [link] [comments]

详情 原文 相关 2 · 机会 0
community Reddit LocalLLaMA 2026-07-19T07:45 正文 thin

Thinking Machines' best public Tinker result used Qwen3-235B, not Inkling. is the base model actually that important?

I Went through the Inkling model card and the Bridgewater/Tinker case study instead of the press coverage. Coverage mostly quoted the 97.1% AIME 2026 number; the rest of the table tells a more mixed story. AIME 2026: Inkling 97.1%, GLM 5.2 99.2%, Fable 5 and GPT-5.6 Sol both 99.9%. Everyone on the l

详情 原文 相关 2 · 机会 0
community Reddit LocalLLaMA 2026-07-19T02:47 正文 thin

Deepseek v4 Flash on 80 GB VRAM and 128 GB DDR4 RAM

I am using unsloth Q8 Deepseek v4 Flash. So far I am able to run properly with the following command CUDA_DEVICE_ORDER=PCI_BUS_ID CUDA_VISIBLE_DEVICES=0,2,1 \ llamacpp/llama.cpp/build/bin/llama-server \ --model unsloth/DeepSeek-V4-Flash-GGUF/UD-Q8_K_XL/DeepSeek-V4-Flash-UD-Q8_K_XL-00001-of-00005.ggu

详情 原文 相关 2 · 机会 0
community Reddit LocalLLaMA 2026-07-19T01:45 正文 thin

Qwen vs Gemma

Hi! Been doing some local LLM stuff, and I can't help but notice: despite vastly-superior benchmark scores, Qwen 3.6 35a3B feels... substantially less intelligent than Gemma 4 26a4B (QAT). In terms of prompt adherence, output coherence, and just general "sanity", Gemma seems head-and-shoulders ahead

详情 原文 相关 5 · 机会 0
community Reddit LocalLLaMA 2026-07-19T01:15 正文 thin

head of strategic futures from openai on open-weight chinese models.

Dean W. Ball analyzes China's Kimi model, noting its strong performance while expressing surprise that the Chinese government permits open-sourcing such capable AI due to potential risks. He argues that open-weight models ultimately slow down AI capital expenditure and could lead to a state-co

详情 原文 相关 2 · 机会 0
community Reddit LocalLLaMA 2026-07-18T23:10 正文 thin

Sharing MiniBot v2, this is what I'm currently using I gave it a major update so I thought I'd share. I make things that do work for me, always have... and this is the latest.

It a single file 20k lines ;P https://github.com/illsk1lls/MiniBot (i previously posted v1 of this, which was not WPF) This is for local models only. Although it is OpenAI compatible. Have your favorite AI scan it to make sure its safe enough for you... Tools are enabled as needed, automatical

详情 原文 相关 2 · 机会 3
community Reddit LocalLLaMA 2026-07-18T21:06 正文 thin

How are y’all stomaching the “AI Boom” prices?

I am in the middle of considering an upgrade to my Home Server. I want to get a decent GPU for LocalAI. I mean, I have an RTX 4060 TI 16GB, I know that is much more than most people have, but even though it has a lot of cram the bus width is really slowing it down - I get ~23 tok/s on Gemma 4 26b A4

详情 原文 相关 2 · 机会 0
community Reddit LocalLLaMA 2026-07-18T19:26 正文 thin

Tool for reproducible management of agent skills

Hi LocalLLaMA! I've been building a small CLI tool for managing agent skills. I wanted a quick way to add and switch between different skill sets without manually copying folders around or losing track of which revision was installed (I tend to try different variations of the same skill and try to

详情 原文 相关 3 · 机会 2
community Reddit LocalLLaMA 2026-07-18T18:49 正文 thin

Arandu v0.6.5 available

Repository: https://github.com/fredconex/Arandu Hello Guys, This is Arandu a open source app to easily launch models using llama.cpp, it tries to integrate all in one place with easy multi version management of llama.cpp, HuggingFace models search/download, intuitive arguments with presets and

详情 原文 相关 2 · 机会 4
community Reddit LocalLLaMA 2026-07-18T09:17 正文 thin

Qwen and Gemma providers

I like to use the MoE modles qwen3.6-35B and Gemma-4-26B. I noticed differences in result quality between versions from different providers, like bartowski, unsloth, lm-studio, google, etc. My tests dont give me a clear answer to though. Is there a rule if thumb which provider to prefer for 1) codin

详情 原文 相关 2 · 机会 0
community Reddit LocalLLaMA 2026-07-18T08:58 正文 thin

What kind of dark magic is Deepseek using?

I was taking a look at Kimi K3 scores on the Artificial analysis leaderboard and was quite baffled when I saw this chart. Granted, Deepseek has always been the king of price to performance, but this is still incredible. Is it just API subsidization or have they optimized their models truly thi

详情 原文 相关 4 · 机会 2
community Reddit LocalLLaMA 2026-07-18T06:35 正文 thin

SigLIP 2 text embedding on CPU with Rust + ONNX

We’re building a robotics data platform with a lot of images, video, and text metadata. For search, we use SigLIP 2. GPUs handle batched asynchronous image/video embedding and indexing, while this small Rust + ONNX Runtime service handles live text queries on CPU. Both land in the same embedding spa

详情 原文 相关 3 · 机会 0
community Reddit LocalLLaMA 2026-07-18T06:33 正文 thin

Kimi K3 recreating macOS27 in web browser

one-shot. 3.5 hrs. that's insane. play with it here: https://macos27.kimi.page/ Original X post: https://x.com/mweinbach/status/2077878247920951400 that's insane. submitted by /u/AsejereDaDeje [link] [comments]

详情 原文 相关 2 · 机会 0
community Reddit LocalLLaMA 2026-07-18T04:54 正文 thin

I tuned a custom Q8 for my AMD R9700s. My benchmark said 12.5% faster.

I have three Radeon AI PRO R9700s. I wanted to know if I could tune a quant for this specific hardware instead of just using the generic upstream formats. Came across the Github project for ROCmFPX by the wonderful Carlo Pasquale and started digging in. The fastest variant I've used is the MTP versi

详情 原文 相关 2 · 机会 2
community Reddit LocalLLaMA 2026-07-18T01:50 正文 thin

Kimi moment. I think the writing is on the wall for Anthropic and OpenAi

New day new model....... can't wait to see in a few weeks how Minimax 3 Pro (2.7T parameters) and GLM 5.3 reinforces the narrative. As a group, all of them are accelerating their progress. THAT is the strength of open source. Meanwhile less enterprises are going to trust Anthropic and OpenAI. Why?

详情 原文 相关 4 · 机会 2
community Reddit LocalLLaMA 2026-07-18T00:43 正文 thin

"recipes" for reliable code work with Qwen3.6-27B?

so part of what inspired my benchmark post was that it does seem like folks here are generally converging on "unless you are able to operate at very large scales with a lot of system RAM and VRAM, the best model for code work is generally Qwen3.6-27B." what I'm hoping is that we have some good place

详情 原文 相关 2 · 机会 0
community Reddit LocalLLaMA 2026-07-17T23:47 正文 thin

How does Kimi k3 feel? Does it match up where it stands on benchmarks?

I've seen the benchmarks, they supposedly right up there with Fable 5 and Sol 5.6. Howerver I'm skeptical of benchmarks and the kimi k3 creators even mentioned the user experience isn't quite on par. How is K3 doing on coding? How is the personality? Does it's thinking and train of thought feel hi

详情 原文 相关 2 · 机会 0
community Reddit LocalLLaMA 2026-07-17T18:34 正文 thin

A year ago you told me my open-source screen-watching app was flaky. You were right, so I spent the year fixing it with your feedback. Thank you r/LocalLLaMA c: !!

TL;DR: This post is part update, mostly thank you for your support :)) Observer is an open-source app that lets local LLMs watch your screen and notify you (WhatsApp/SMS/email/Discord) when something happens. A year of your feedback later, setup went from "flaky and very manual" (your words, and fai

详情 原文 相关 3 · 机会 2