I built a GBNF grammar compiler that makes 8B models reliably call tools - here's how it works (deep dive)
英文标题:I built a GBNF grammar compiler that makes 8B models reliably call tools - here's how it works (deep dive)
I've been building a local agent in Rust (Eris) that runs on llama.cpp and uses an Obsidian-compatible vault as memory. ~50 tools (vault read/write, memory, reminders, web fetch, email, calendar, vision). The biggest pain was getting small models to emit valid tool-calling JSON. You all know the dri
打开原文相关 3 · 机会 3
中文
I've been building a local agent in Rust (Eris) that runs on llama.cpp and uses an Obsidian-compatible vault as memory. ~50 tools (vault read/write, memory, reminders, web fetch, email, calendar, vision). The biggest pain was getting small models to emit valid tool-calling JSON. You all know the dri
中文全文翻译正在补齐,可先查看下方英文原文。
English / 原文
I've been building a local agent in Rust (Eris) that runs on llama.cpp and uses an Obsidian-compatible vault as memory. ~50 tools (vault read/write, memory, reminders, web fetch, email, calendar, vision). The biggest pain was getting small models to emit valid tool-calling JSON. You all know the dri