Archai: Platform for Neural Architecture Search
Archai is a platform for Neural Network Search (NAS) with a goal to unify several recent advancements in research and making them accessible to non-experts so that anyone can leverage this research to generate efficient…
Pythia: AI-assisted Code Completion System
Accessible Information Seeking
Slides from ACM CHIIR 2020 closing keynote on Accessible Information Seeking.
Access Publication Publication Publication Publication Publication
ZeRO & Fastest BERT: Increasing the scale and speed of deep learning training in DeepSpeed
The latest trend in AI is that larger natural language models provide better accuracy; however, larger models are difficult to train because of cost, time, and ease of code integration. With the goal of advancing…