Paper at Tokshop
We have a paper accepted at Tokenization Workshop @ ICML 2025.
Marco Cognetta, David Pohl, Junyoung Lee, and Naoaki Okazaki. Pitfalls, Subtleties, and Techniques in Automata-Based Subword-Level Constrained Generation. In Tokenization Workshop (TokShop), page (16 pages), Vancouver, Canada, July 2025.