LoPT: Lossless Parallel Tokenization Acceleration for Long Context Inference of Large Language Model

Abstract

Lossless parallel tokenization for long-context inference, using character-position matching and adaptive chunk expansion to preserve exact sequential outputs.

Peizhen Zheng

AI Infrastructure Researcher

LLM training, inference and data infrastructure, with a focus on efficient serving and agent-driven optimization.