Replacing Large Language Models with Jev Decision Models for Low-Latency Edge Service Orchestration
- 类型：arxiv
- 标识：2609.22753
- 链接：https://arxiv.org/abs/2609.22753
- 主分类：engineering
- 形态：application
- TLDR：Natural-language service requests can require a language-model decision before execution starts, consuming part of the request's latency budget. We integrate Jev's decision-oriented application programming interface (API) into edge service orchestration to reduce this overhead while retaining service completion. The integration extracts four to eight bounded intent fields and applies a shared validator, admission policy, and scheduler, accounting for decision waiting throughout the request timeline. We compare Jev, two self-hosted decision models, and three hosted large language models (LLMs)
- 待LLM分类：是
- 来源文件：
- /inbox/tom/_candidates/2026-10-03-agent-rag-longcontext-candidates.json