community Reddit LocalLLaMA 2026-07-29T09:14 正文 thin 0 words

I built a GBNF grammar compiler that makes 8B models reliably call tools - here's how it works (deep dive)

英文标题:I built a GBNF grammar compiler that makes 8B models reliably call tools - here's how it works (deep dive)

I've been building a local agent in Rust (Eris) that runs on llama.cpp and uses an Obsidian-compatible vault as memory. ~50 tools (vault read/write, memory, reminders, web fetch, email, calendar, vision). The biggest pain was getting small models to emit valid tool-calling JSON. You all know the dri
打开原文相关 3 · 机会 3

中文

I've been building a local agent in Rust (Eris) that runs on llama.cpp and uses an Obsidian-compatible vault as memory. ~50 tools (vault read/write, memory, reminders, web fetch, email, calendar, vision). The biggest pain was getting small models to emit valid tool-calling JSON. You all know the dri

中文全文翻译正在补齐,可先查看下方英文原文。

English / 原文

I've been building a local agent in Rust (Eris) that runs on llama.cpp and uses an Obsidian-compatible vault as memory. ~50 tools (vault read/write, memory, reminders, web fetch, email, calendar, vision). The biggest pain was getting small models to emit valid tool-calling JSON. You all know the dri