Yifan Xiong의 초상화

Yifan Xiong

Senior Researcher

뉴스 & 기능

Research Focus: August 5, 2024
Microsoft Research 블로그

In this issue: Research Forum Ep. 4 explores multimodal AI. Registration is now open; Surveying developers’ AI needs; SuperBench improves cloud AI infrastructure reliability; Virtual Voices: Exploring factors influencing participation in virtual meetings.

어워드 | USENIX ATC 2024

Best Paper Award at USENIX ATC 2024 

Our paper titled "SuperBench: Improving Cloud AI Infrastructure Reliability with Proactive Validation" received the Best Paper Award at the 2024 USENIX Annual Technical Conference (USENIX ATC '24).

A line graph comparing the end-to-end performance of Meta’s MoE language model using Azure NDm A100 v4 VMs with and without Tutel. The x-axis is the number of A100 (80GB) GPUs, beginning at 8 and going up to 512, and the y-axis is the throughput (K tokens/s), beginning with 0 and going up to 1,000 in intervals of 100. Tutel always achieves higher throughput than fairseq.
Microsoft Research 블로그

| Wei Cui, Yifan Xiong, Peng Cheng, 그리고 Rafael Salas

Mixture of experts (MoE) is a deep learning model architecture in which computational cost is sublinear to the number of parameters, making scaling easier. Nowadays, MoE is the only approach demonstrated to scale deep learning models to trillion-plus parameters, paving…