papers
Publications (4)
cs.LG2018
Mesh-TensorFlow: Deep Learning for Supercomputers
Noam Shazeer, Youlong Cheng, Niki Parmar +9
cs.CV2019
GPipe: Efficient Training of Giant Neural Networks using Pipeline Parallelism
Yanping Huang, Youlong Cheng, Ankur Bapna +8
cs.LG2018
Image Classification at Supercomputer Scale
Chris Ying, Sameer Kumar, Dehao Chen +2
cs.LG2019
Lingvo: a Modular and Scalable Framework for Sequence-to-Sequence Modeling
Jonathan Shen, Patrick Nguyen, Yonghui Wu +88