FLEXITOKENS: Flexible Tokenization for Evolving Language Models
Published in preprint, also presented at Tokenization Workshop @ICML 2025, 2025
Recommended citation: Abraham Toluwase Owodunni, Orevaoghene Ahia, Sachin Kumar. (2025). “FLEXITOKENS: Flexible Tokenization for Evolving Language Models.” preprint, also presented at Tokenization Workshop @ICML 2025.
Recommended citation: Abraham Toluwase Owodunni, Orevaoghene Ahia, Sachin Kumar. (2025). "FLEXITOKENS: Flexible Tokenization for Evolving Language Models." preprint, also presented at Tokenization Workshop @ICML 2025.
Download Paper