独立 AI 资讯库

AI 前沿动态、原文归档与媒体镜像

从自动抓取数据库实时读取,适合快速浏览、检索和后续扩展成完整资讯站。

11910资讯
11778正文归档
75366媒体
community Reddit LocalLLaMA 2026-10-29T14:38 正文 thin

I think local AI cost me a job

Got headhunted by a VC-backed AI-focused company, ended up skipping past two levels of their application/interview process because of that. Got 15 minute call with the co-founder, hit it off well, but it all seemed to go sour when he asked about my AI setup and I told him I run qwen locally on a gra

详情 原文 相关 2 · 机会 0
community Reddit LocalLLaMA 2026-10-29T14:13 正文 thin

mistralai/Mistral-Large-4-1T-A52B · Hugging Face

https://huggingface.co/ggml-org/Mistral-Large-4-1T-A52B-GGUF https://huggingface.co/ggml-org/Mistral-Large-4-1T-A52B-NVFP4-GGUF https://huggingface.co/unsloth/Mistral-Large-4-1T-A52B-GGUF from Mistral: Mistral Large 4 - Le Chonk Mistral Large 4 is our largest and most capable model to date: a

详情 原文 相关 3 · 机会 0
community Reddit LocalLLaMA 2026-10-29T09:48 正文 thin

Worried about Qwen 4 License

After Alibaba moved from Permissive OSS licenses to its own custom license with IMO ambiguous terms in models like Qwen3.8-Flash-Next, is there any indication this will carry forward into Qwen4? While that license at first reads permissive for local/internal use, fine-tuning and derivatives, it’s de

详情 原文 相关 2 · 机会 0
community Reddit LocalLLaMA 2026-10-29T09:27 正文 thin

HemmingwayAI/Hemmingway-1.5 (Qwen finetune)

https://huggingface.co/bartowski/HemmingwayAI_Hemmingway-1.5-GGUF from hemmingwayAI: Hemmingway-1.5 The undetectable AI. Writing indistinguishable from a human's. 27B parameters, open weights, free for non-commercial use. hemmingway.io → · Model card → · Try it → · API → · API docs → · Mac, Wi

详情 原文 相关 4 · 机会 2
community Reddit LocalLLaMA 2026-10-29T07:06 正文 thin

Qwen 3.8 Flash Next Creative Writing Ability

I use a dual MI50 32gb Rig for an alliterated version of IQ3_S Qwen 3.8 Flash Next. I have seen some people say tha creative writing is good on Flash NeXT but in my experience, it has just been the absolute worst at it. I’m talking like nothing in the story makes any sense at all. Gemma 3 is better

详情 原文 相关 2 · 机会 0
community Reddit LocalLLaMA 2026-10-29T03:57 正文 thin

[Update Benchmark] Basalt's new PRs (Strata fork) new record IQ3_S Qwen3.8 Flash Next on single RTX 5080 and 51 GB RAM with 5500 tok/s prompt processing and up to 275 tok/s peak generation (during opencode coding live session)

Code and tool calls can peak up to 275 tok/s - Reasoning traces up to 190 tok/s Hardware: 5080 16GB PCIe gen5x16, 64 DDR5 6400, Core Ultra 9 285K https://github.com/jesdga95/basalt Some PRs for the optimizations under my name are still pending (xyehya) but upstream already have solid gains

详情 原文 相关 2 · 机会 3
community Reddit LocalLLaMA 2026-10-29T01:10 正文 thin

5 Frontier LLM's grade 39 local LLM's on 50 prompts

This is just something i had running for about 10-20 hours (kept adding models), various tests/benchmarks and had 4 (Claude kind of graded, his tokens are too precious) frontier LLM's grade the answers of the local LLM's. Big models got about 44 and smaller models got 66 prompt/tests. Some wri

详情 原文 相关 9 · 机会 1
community Reddit LocalLLaMA 2026-10-29T00:37 正文 thin

Fine, I’ll read it myself - local audiobook producer

I vibe-coded an app to turn my favorite webnovels chapters into multi-voice audio with acceptable quality. What was funny is that Opus completely refused to write site scraping part due to “legal reasons“. Well, qwen 3.8 FN had no such reservations. submitted by /u/SwimmerJazzlike [li

详情 原文 相关 2 · 机会 0
community Reddit LocalLLaMA 2026-10-28T22:24 正文 thin

I ran Doom inside the Qwen model weights!

Inspired by the qwenputer project posted in this sub earlier today, I managed to get a basic version of Doom running on the virtual machine created in the post. It's quite slow, but here we are. Doom running on an LLM. Project repo: https://github.com/mapestree/qwenputer-doom submitted by

详情 原文 相关 3 · 机会 2
community Reddit LocalLLaMA 2026-10-28T17:19 正文 thin

A small step for man, a GIANT step for LOCAL AI

Shoutout to the Unsloth AI team for constantly pushing the needle forward for local ai worldwide. While many of us already had features such as this via other means, it is more what this means for entry level ai enthusiasts & accessibility. It is clear as day! We are in "the age of the agent."

详情 原文 相关 3 · 机会 1
community Reddit LocalLLaMA 2026-10-28T16:48 正文 thin

List of suggestions for Gemma 5.

Recently Omar Sanseviero asked for suggestions on Twitter for future Gemma models. Here is my take on this: Gemma 5 should be a looped transformer. Being a looped transformer with configurable loop depth will address one of the biggest Gemma 4 weaknesses - reasoning ability. Don't get me wr

详情 原文 相关 2 · 机会 0
community Reddit LocalLLaMA 2026-10-28T15:06 正文 thin

Alternative to artificialanalysis for assessing latest models?

AA no longer lists GLM5.3 flash (despite clearly being one of the best models - and probably the cheapest per intelligence) , they seem to have been doing all sorts of changes to push US models and hiding good cost effective models, including qwen 3.8 flash, so that table is no good. I need a better

详情 原文 相关 2 · 机会 0
community Reddit LocalLLaMA 2026-10-28T13:41 正文 thin

Used Qwen 3.8 flash next on underspeced PC to Root and gut LG TV of spy and adware

I post this because I was honestly quite impressed by the capabilities of this model from a opencode harness and wanted to share my experience. So i've been playing about for a bit wit Strata and Qwen 3.8 flash for a bit and was looking for a new kind of test. One that would also (if succesfull..) g

详情 原文 相关 2 · 机会 0
community Reddit LocalLLaMA 2026-10-28T13:23 正文 thin

I took EmbeddingGemma-2 (577M) from Rank #26 to #1 on the MTEB Audio leaderboard (MAEB), beating 9B models by adding a 2.4 MB PCA head with zero training

Model & weights: BrunoHays/embeddinggemma-2-nullspace-audio MAEB (Massive Audio Embedding Benchmark) is the main MTEB leaderboard benchmark for audio and text-to-audio embeddings, currently dominated by 8B-9B multimodal models. I took Google's edge-sized google/embeddinggemma-2 (577M params, 768d ve

详情 原文 相关 5 · 机会 0
community Reddit LocalLLaMA 2026-10-28T08:43 正文 thin

Diffuspace/Clover-35B-A3B-Preview · Hugging Face

Clover-35B-A3B-Preview is the first model released by DiffuSpace, delivering state-of-the-art performance among open-source diffusion language models at release on the benchmarks reported in our launch blog. Clover combines a 35B-parameter mixture-of-experts backbone with approximately 3B acti

详情 原文 相关 2 · 机会 2
community Reddit LocalLLaMA 2026-10-28T00:39 正文 thin

DeepSeek-V4.1-Flash-1017 at 41 tok/s on one 3090

No, this is not a lobotomized 1-bit squeeze, its full Q2 nazeshinjite's DeepSeek-V4.1-Flash-1017 Q2 GGUF on a single 3090, natively on Windows no WSL. On an RTX 3090 with 192 GB of RAM I'm writing at 41 tok/s (average across multiple prompts) and the output agrees with DeepSeek's own API on th

详情 原文 相关 4 · 机会 2
community Reddit LocalLLaMA 2026-10-27T22:35 正文 thin

I built a local GPU benchmark server for 4B to 35B models because I was tired of synthetic cloud leaderboards and tiny sample tests

Hi everyone, whenever I looked at existing LLM leaderboards I was missing practical numbers for running quantized open weight models on affordable local hardware. Most tables only copy vendor cloud scores or run tiny subsets of a benchmark, and none of them tell you how long a model actually sits th

详情 原文 相关 3 · 机会 0
community Reddit LocalLLaMA 2026-10-27T21:14 正文 thin

New audio model: LFM3-Audio-2B

One more great model from Liquid AI! Good for edge: LFM3-Audio-2B is a compact, fully featured audio model that runs locally on laptops and edge devices. It takes text or audio as input and responds with text, speech, or both. Voice chat: ask questions aloud and receive streaming replies in t

详情 原文 相关 2 · 机会 0
community Reddit LocalLLaMA 2026-10-27T20:47 正文 thin

OpenAI's major results over the last 3 months came from scaling test-time compute with agent swarms. I've been building an open-source equivalent for the past year, and I'd love for you guys to try it.

I have been working on test-time scaling for quite some time now. Posted some of my previous work on this sub-reddit before. Recently, I made significant simplifications to the core system-design and it finally felt like now anybody can understand and directly use this on their hardest problem

详情 原文 相关 8 · 机会 3
community Reddit LocalLLaMA 2026-10-27T17:04 正文 thin

LiquidAI/LFM3-1.7B · Hugging Face

https://huggingface.co/LiquidAI/LFM3-1.7B-GGUF from liquidAI: LFM3-1.7B is a text model for local agents and specialized applications, based on our new tri-hybrid architecture. Agentic training: post-trained for agentic harnesses such as Hermes Agent, Pi, and OpenClaw, with a 256K-token conte

详情 原文 相关 3 · 机会 3
community Reddit LocalLLaMA 2026-10-27T17:01 正文 thin

I am a King, but local 😂

I am feeling like a mighty local King spinning two Strata engines with 70tps each whole day and using 12M tokens a day. Also me scrolling twitter and stumbling upon a post saying that poteto uses 34M tokens per minute 🤪 Upd: Guys are interested who is she and what she is doing with all these t

详情 原文 相关 2 · 机会 0
community Reddit LocalLLaMA 2026-10-27T13:15 正文 thin

4 coding agents on one RTX 3090: ~290 tok/s total from a custom CUDA engine for Qwen3.8-27B (3-4x llama-server --parallel)

I've been building OpenJet, a local coding agent with its own CUDA megakernel engine for Qwen3.8-27B Q4_K_M. Until now it served one conversation at a time. The new release serves several agents at once on a single GPU. https://reddit.com/link/1xgs8hp/video/p0zd2rxse0yh1/player Numbers (RTX 30

详情 原文 相关 6 · 机会 2
community Reddit LocalLLaMA 2026-10-27T11:12 正文 thin

inclusionAI/Ling-3.1-flash-1019 · Hugging Face

from inclusionAI: We introduce Ling-3.1-flash-1019, an upgraded version of Ling-3.1-flash, with 560B total parameters, 25B active parameters per token, and a 1M-token context window. With further post-training optimizations, Ling-3.1-flash-1019 demonstrates significant improvements in reasonin

详情 原文 相关 5 · 机会 0
community Reddit LocalLLaMA 2026-10-27T10:19 正文 thin

Debunking Cohere's claim of Qwen 3.8 Flash Next uploading to Alibaba remote URL

HF traces: https://huggingface.co/datasets/CohereLabs/10-2026-qwen-investigation-traces 1. Understand the Python script: ids ids = dataset[0]["token_ids"] if len(ids) < 2323: raise ValueError("The trace is shorter than the required 2,323-token prefix.") ids = ids[:2323] # stop just before the URL,

详情 原文 相关 2 · 机会 0