To Memorize or to Retrieve: Scaling Laws for RAG-Considerate Pretraining

Published in preprint, 2026

Karan Singh, Michael Yu, Varun Gangal, Zhuofu Tao, Sachin Kumar, Emmy Liu, Steven Y. Feng

Citation

Karan Singh, Michael Yu, Varun Gangal, Zhuofu Tao, Sachin Kumar, Emmy Liu, Steven Y. Feng. (2026). To Memorize or to Retrieve: Scaling Laws for RAG-Considerate Pretraining. preprint.