LLM Inference

LoPT: Lossless Parallel Tokenization Acceleration for Long Context Inference of Large Language Model

ACL 2026 main conference long paper. Exact-output parallel tokenization for long-context inference through character-position matching and adaptive chunk expansion.

Wei Shao, Zheng Lingchao, Pengyu Wang, Peizhen Zheng, Li Jun, Yuwei Fan