The Semantic Bottleneck: Leveraging Semantic Representations for Non-Invasive Speech Decoding

  • 类型:arxiv
  • 标识:2609.10296
  • 链接:https://arxiv.org/abs/2609.10296
  • 主分类:multimodal
  • 形态:method
  • TLDR:Non-invasive speech decoding remains constrained by the low signal-to-noise ratio of neural recordings, which makes fine-grained reconstruction of phonemes or individual words difficult. Motivated by neuroscientific evidence that high-level semantic representations are distributed across cortical regions and evolve over slower temporal scales, we hypothesize that semantic content may provide a more suitable target for non-invasive decoding than low-level acoustic or lexical features. We introduce Brain2Semantics2Text, a method that reconstructs text through an intermediate semantic embedding s
  • 待LLM分类:否
  • 来源文件
  • /inbox/tom/_candidates/2026-09-10-agent-rag-longcontext-candidates.json