Inference engineer finds tokenization time non-negligible for long contexts, fixes it for Kimi K3

An inference engineer notes that tokenization time, usually negligible, becomes significant for 100K-1M token inputs with prefix cache hits. Michael fixed it for Kimi K3.

• tokenization
• Optimization
• inference
• Kimi K3