Understanding Data Storage and Ingestion for Large-Scale Deep Recommendation Model Training

Abstract

and 2.3×, respectively, addressing the substantial power requirements of data ingestion. We close with lessons learned and cover the important remaining challenges and opportunities surrounding data ingestion at scale.