Institutional Newspapers Pipeline: Deriving billions of high quality tokens from historical newspapers

  • 类型：arxiv
  • 标识：2608.18972
  • 链接：https://arxiv.org/abs/2608.18972
  • 主分类：engineering
  • 形态：method
  • 被引：0
  • 被引来源：Semantic Scholar + OpenAlex
  • S2被引：0
  • OpenAlex被引：0
  • 影响力被引：0
  • TLDR：The Institutional Newspapers Pipeline is presented, a modular system designed to extract high-quality, structured datasets from historical newspaper scans that was architected so that each step remains interpretable and customizable, and so that the pipeline as a whole remains computationally frugal enough to run on workstation-level hardware.
  • OpenAlex ID：W7203883793
  • OpenAlex DOI：10.48550/arxiv.2608.18972
  • DOI：10.48550/arxiv.2608.18972
  • DOI来源：OpenAlex
  • 开放获取：green
  • 开放获取链接：https://arxiv.org/pdf/2608.18972
  • OpenAlex更新：2026-09-05
  • 待LLM分类：否
  • 成熟度：production
  • 场景：数据处理、OCR、历史文档
  • 标题中文：机构报纸流水线：从历史报纸中提炼数十亿高质量 token
  • TLDR中文：本文提出 Institutional Newspapers Pipeline，一个模块化系统，旨在从历史报纸扫描件中提取高质量、结构化的数据集；其架构设计使每个步骤都保持可解释和可定制，并使整个 pipeline 在计算上足够精简，可在工作站级硬件上运行。
  • 来源文件：
  • /inbox/tom/_candidates/2026-09-03-agent-rag-longcontext-candidates.json
  • [OpenAlex backfill]
  • [S2 enrich]