Institutional Newspapers Pipeline: Deriving billions of high quality tokens from historical newspapers
- 类型：arxiv
- 标识：2608.18972
- 链接：https://arxiv.org/abs/2608.18972
- 主分类：engineering
- 形态：method
- TLDR：Historical newspapers are an abundant record of public life, but their dense, irregular and sometimes noisy layouts make computational access to these materials both challenging and limited. We present the Institutional Newspapers Pipeline, a modular system we jointly designed with Boston Public Library to extract high-quality, structured datasets from historical newspaper scans. It was architected so that each step remains interpretable and customizable, and so that the pipeline as a whole remains computationally frugal enough to run on workstation-level hardware. The pipeline runs each scan
- 待LLM分类：是
- 来源文件：
- /inbox/tom/_candidates/2026-09-03-agent-rag-longcontext-candidates.json