独立 AI 资讯库

AI 前沿动态、原文归档与媒体镜像

从自动抓取数据库实时读取,适合快速浏览、检索和后续扩展成完整资讯站。

11910资讯
11778正文归档
75366媒体
community Reddit LocalLLaMA 2026-10-14T22:47 正文 thin

Strata performance finetuning - try it out

As strata is somewhat new, I assume that some people din't yet learn how to finetune it for best performance on their machine. I find documentation a bit hard to navigate (use your agents for this!), which doesn't help. After some serious testing, I've tweaked pretty much every parameter available.

详情 原文 相关 3 · 机会 1
community Reddit LocalLLaMA 2026-10-14T21:01 正文 thin

Sabi-Noema: A capability and efficiency focused fine-tune of Qwen 3.8 27B

tl;dr: new qwen finetune that simultaneously pushes the frontiers of small model capability and reasoning efficiency. Hey everyone, We publish two post-trained versions of Qwen 3.8 27B called Sabi-Noema and Sabi-Noema-MLA. These models push the capability frontier on <30B models with 2x redu

详情 原文 相关 9 · 机会 3
community Reddit LocalLLaMA 2026-10-14T20:18 正文 thin

Qwen 3.8 Flash Next, DeepSeekV4 Flash and Time

MacStudio 128GB M1 ultra I'm curious how people who can run both models are deciding which one to work with. DeepSeekv4 benchmarks right below GPT 5.5 high. Flash Next benchmarks right above 5.4/5.5 xhigh Both seem capable but it seems like Qwen 3.8 Flash next is taking much longer to actual

详情 原文 相关 2 · 机会 0
community Reddit LocalLLaMA 2026-10-14T17:10 正文 thin

GPT-Image-style photo editing on your own GPU (12 GB+): I built a zero-setup app for Qwen-Image 2.1 on stable-diffusion.cpp

Every local setup I tried for Qwen-Image 2.1 meant a Python env, a node graph and an evening of picking quantization, offloading and resolution for my card. Kokon is a free, open-source desktop app that does all of that for you and gives you a plain photo editor on top. Zero setup: first run

详情 原文 相关 4 · 机会 2
community Reddit LocalLLaMA 2026-10-14T16:47 正文 thin

New model from Telperion: Qwen3.8-27B-MLA & Qwen3.8-27B-GLA-g2. 4x smaller KV cache, smarter, and more efficient reasoning.

Hello! We've been busy at Telperion with a lot of experimental research (more coming soon). Today, we're announcing the release of our latent attention variants of Qwen3.8-27B. Our latent attention variants (quants calibrated to FP8 KV cache) compress the KV cache by 4×, enabling a near 4× increase

详情 原文 相关 2 · 机会 0
community Reddit LocalLLaMA 2026-10-14T12:10 正文 thin

The AI race: China's open-weight models trail US closed models by just 7 months

Source: whatmodel.sh, an open source AI leaderboard I built (and launched here yesterday). Every point comes from published benchmark results: 22,113 of them across 987 benchmarks, from 1,011 sources, each one linked to where it was published. This chart uses data for the text models: 18,755

详情 原文 相关 4 · 机会 2
community Reddit LocalLLaMA 2026-10-14T10:44 正文 thin

Anthropic Executive Says Open-Source AI Models Are Higher Risk

https://www.bloomberg.com/news/articles/2026-10-14/anthropic-executive-says-open-source-ai-models-are-higher-risk https://www.business-standard.com/technology/artificial-intelligence/open-source-ai-models-carry-more-cybersecurity-risks-anthropic-executive-126101400731_1.html submitted by /u/Ex

详情 原文 相关 4 · 机会 2
community Reddit LocalLLaMA 2026-10-13T23:43 正文 thin

Real downsides of Strata?

Trying to read on what the real tested downsides have been but information seems to go both ways, some proclaim no loss, others pretty huge ones. I had some weird looping issue in their chat, and some engine port misunderstandings, seemingly the models likes to use ports already in use, didn't reall

详情 原文 相关 5 · 机会 0
community Reddit LocalLLaMA 2026-10-13T23:07 正文 thin

My local Qwen3.8FN agent is significantly cheaper than cloud

tl;dr: running Qwen3.8FN Q4 locally is cheaper for me than every cloud model except Luna and the newer Haiku at mid-peak and peak electricity pricing where I live, and becomes the absolute cheapest model at off peak pricing. An agentic run that spans these different pricing points or at least choose

详情 原文 相关 5 · 机会 3
community Reddit LocalLLaMA 2026-10-13T22:54 正文 thin

Claude CoWork for Local LLMs that runs on your Phone

Hi Friends, I am a solo developer. Ever since I had Qwen 3.8 running on my RTX4090, I had an itch to use it on my phone for everything. That gave me the idea to build SteerClaw Mobile - a complete agentic experience on the Phone where the entire agent loop runs on it. We just connect our model

详情 原文 相关 9 · 机会 2
community Reddit LocalLLaMA 2026-10-13T17:14 正文 thin

LiquidAI/LFM2.5-24B-A2B

Gguf's: https://huggingface.co/LiquidAI/LFM2.5-24B-A2B-GGUF Free Demo: https://playground.liquid.ai "LFM2.5-24B-A2B is a 24B-parameter reasoning model with only 2B active parameters, built for fast, private agents on-device. It is the largest and final model in the LFM2.5 family, which now spa

详情 原文 相关 5 · 机会 3
community Reddit LocalLLaMA 2026-10-13T14:49 正文 thin

4x 6000 Pro for the company

Here is how i serve 40 people (10 of them developers) with local AI services. n8n for automatisation whisper and Vexa AI, a bot joins Teams and makes transcripts, n8n later extracts decisions and todos OpenWebUI, ChatGPT-like webinterface for everyone, most agentic features are disabled, webs

详情 原文 相关 7 · 机会 3
community Reddit LocalLLaMA 2026-10-13T13:49 正文 thin

Built an open-source Cotypist/Granola hybrid: autocomplete on Gemma 4 E2B (~50 ms/suggestion on M4 Max) using your own meeting notes as context

I built a desktop app harness that keeps local meeting notes and can use them to autocomplete my typing as well as complement my dictation with additional context via reading my screen or using the previous meetings notes. It's been a bit of a struggle to get it to work well and also to not be

详情 原文 相关 2 · 机会 2
community Reddit LocalLLaMA 2026-10-13T11:50 正文 thin

Horsey challenge | Strata Fork | Qwen 3.8 FN NVFP4

So I wanted to try the horsey challenge myself on the latest engine i been testing which is a strata fork by sergqwer. https://github.com/sergqwer/strata-nvfp4. I seen a post earlier and seen i believe it was a iq3 i think and it was pretty dope so i thought i try out the NVFP4. I wasn't expec

详情 原文 相关 2 · 机会 2
community Reddit LocalLLaMA 2026-10-13T11:11 正文 thin

Got 2x DGX Sparks. Excited and confused!

Got this couple. It was difficult purchase in this economy but paid only roughly $6100 equivalent for each in my country. I justified the purchase for learning (so I try to convince myself) and coding workflow improvements. I started looking into recipes for GLM 5.3 flash but surprisingly ther

详情 原文 相关 2 · 机会 1
community Reddit LocalLLaMA 2026-10-13T09:57 正文 thin

Based on advice from LocalLLama implemented a n+2 lookahead prediction for ssd streaming Qwen Flash Next - and it worked!

My project is optimising qwen flash next on Mac Mini m5 64gb through SSD streaming. I recently asked LocalLLama for guidance on how to optimise token output. Today a popular method to do this is a lookahead guesser which fetches experts one layer ahead of the current layer. One popular suggest

详情 原文 相关 2 · 机会 0
community Reddit LocalLLaMA 2026-10-13T04:23 正文 thin

Anyone feel like reverse-engineering CUDA?

I've been reading about all these modders using AI to reverse-engineer games and software. I've been trying out photocraft and gridcraft and have just watched a GTA5 mod featuring Sonic. It's pretty damn impressive. As a struggling AMD Radeon owner I'd love to see AI generated open source CUDA imple

详情 原文 相关 2 · 机会 2
community Reddit LocalLLaMA 2026-10-13T01:01 正文 thin

How far are we from a local model being able to optimize it's own runtime stack?

A lot of projects have come up recently consisting of specific hardware config specialized forks of existing conferencing engines, but they all seem to be made using Claude or OpenAI's biggest frontier models. So given that open source is about 4-6 months behind, can we reasonably expect that local

详情 原文 相关 4 · 机会 2
community Reddit LocalLLaMA 2026-10-12T23:18 正文 thin

Qwen 3.8 Flash Next Q3 S - Benchmark creation

After running a benchmark test on Exo in Opencode and being amazed by the result, I thought I'd try other models on Opencode. Many were surprisingly terrible. Especially some mid level models. Earlier posts: https://www.reddit.com/r/opencode/comments/1wzm1ah/exo_free_frontier_level_wow/ https:

详情 原文 相关 4 · 机会 2
community Reddit LocalLLaMA 2026-10-12T18:26 正文 thin

Qwen3.8-27B vs Frontier vs Others

Here're results from my final test of coding, coding (panda/numpy), data analysis, data-driven decision-making, and local RAG domains I interact with most often. This test, which is refined from a 500+ pack, now provides a differentiating signal between models after having weeded out tests all

详情 原文 相关 5 · 机会 2