community Reddit LocalLLaMA 2026-09-15T08:09 正文 thin 0 words

jinfer: An open-source AI inference engine for the JVM. Finally, AI in jar.

英文标题:jinfer: An open-source AI inference engine for the JVM. Finally, AI in jar.

For years, the JVM has watched the AI revolution from the bench. Every model, AI framework, every breakthrough, built with/for Python. jinfer is an inference engine built for the JVM from first principles: chat, vision, audio transcription, embeddings, reranking, and TTS. No Python runtime, no ONNX,
打开原文相关 2 · 机会 2

中文

For years, the JVM has watched the AI revolution from the bench. Every model, AI framework, every breakthrough, built with/for Python. jinfer is an inference engine built for the JVM from first principles: chat, vision, audio transcription, embeddings, reranking, and TTS. No Python runtime, no ONNX,

中文全文翻译正在补齐,可先查看下方英文原文。

English / 原文

For years, the JVM has watched the AI revolution from the bench. Every model, AI framework, every breakthrough, built with/for Python. jinfer is an inference engine built for the JVM from first principles: chat, vision, audio transcription, embeddings, reranking, and TTS. No Python runtime, no ONNX,