OasisKV: Scaling In-Decode KV Cache Beyond HBM with Lookahead Sparse Prefetching
Can Xiao, Sukmin Cho, Junbong We, Zhixiong Niu, Jianyi Cheng, Yiren Zhao, Youngjin Kwon, Yongqiang Xiong, Rui Ma, Junyi Liu
August 2026
arXiv | August 2026
Zhixiong Niu
Senior Researcher
Publications
-
-
-
OptiFlow: Towards LLM-Driven Optimization of Collective Communication Algorithms
Fei Long, Ziyue Yang, Kaihui Gao, Shuai Wang, Li Chen, Zhixiong Niu, Ran Shu, Wenxue Cheng, Peng Cheng, Yongqiang Xiong, Dan Li
Proceedings of the 10th Asia-Pacific Workshop on Networking | August 2026
Asia-Pacific Workshop on Networking
-
SlimeMold: Scaling Distributed Hardware Load Balancers via a Unified Giant Connection Table
Ziyuan Liu, Zhixiong Niu, Ran Shu, Jianqin Zhang, Guohong Lai, Liang Gao, Na Wang, Zongying He, Jacob Nelson, Dan R. K. Ports, Lihua Yuan, Peng Cheng, Yongqiang Xiong
ACM SoCC 2026
-
Offloading Cloud Network Services at Production Scale with SONiC DASH SmartSwitch
Shaofeng Wu, Zhixiong Niu, Riff Jiang, Lawrence Lee, Junhua Zhai, Ze Gan, Vasundhara Volam, Prabhat Aravind, Prince Sunny, Prince George, Qi Luo, Evan Langlais, Soumya Tiwari, Venkat Satish Katta, Weixi Chen, Rishiraj Hazarika, Sachin Jain, Deven Jagasia, Michal Zygmunt, Avijit Gupta, Neeraj Motwani, Pranjal Shrivastava, Qiang Su, Anil Reddy Pannala, Kristina Moore, James Grantham, Anupam Pandey, Xin Liu, Guohan Lu, Gerald De Grace, Rishabh Tewari, Lihua Yuan, Erica Lan, Deepak Bansal, Dave Maltz, Yongqiang Xiong, Hong Xu
May 2026
Community Award
-
-
-
Mina: Fine-Grained In-network Aggregation Resource Scheduling for Machine Learning Service
Shichen Dong, Zhixiong Niu, Mingchao Zhang, Zhiying Xu, Chuntao Hu, Pengzhi Zhu, Qingchun Song, Lei Qu, Peng Cheng, Cam-Tu Nguyen, Shaoling Sun, Xiaohu Xu, Yongqiang Xiong, Wei Wang, Xiaoliang Wang
IEEE INFOCOM 2025 - IEEE Conference on Computer Communications | May 2025, pp. 1-10
-
-
-
ACM MMSys 2024 Bandwidth Estimation in Real Time Communications Challenge
Sami Khairy, Gabriel Mittag, Vishak Gopal, Francis Y. Yan, Zhixiong Niu, Ezra Ameri, Scott Inglis, Mehrsa Golestaneh, Ross Cutler
ACM Multimedia Systems Conference (MMSys ’24) | April 2024
-
-
-
A Disaggregate Data Collecting Approach for Loss-Tolerant Applications
Ziyuan Liu, Zhixiong Niu, Ran Shu, Peng Cheng, Wenxue Cheng, Yongqiang Xiong, Lihua Yuan, Jacob Nelson, Dan R. K. Ports
6th Asia-Pacific Workshop on Networking (APNet '22) | July 2022
-
OpenNetLab: Open Platform for RL-based Congestion Control for Real-Time Communications
Jeongyoon Eo, Zhixiong Niu, Wenxue Cheng, Francis Y. Yan, Rui Gao, Jorina Kardhashi, Scott Inglis, Michael Revow, Byung-Gon Chun, Peng Cheng, Yongqiang Xiong
Asia-Pacific Workshop on Networking (APNet ’22) | July 2022
Best Paper Award
-
-
-
OasisKV: Scaling In-Decode KV Cache Beyond HBM with Lookahead Sparse Prefetching
Can Xiao, Sukmin Cho, Junbong We, Zhixiong Niu, Jianyi Cheng, Yiren Zhao, Youngjin Kwon, Yongqiang Xiong, Rui Ma, Junyi Liu
August 2026
arXiv | August 2026
-
OptiFlow: Towards LLM-Driven Optimization of Collective Communication Algorithms
Fei Long, Ziyue Yang, Kaihui Gao, Shuai Wang, Li Chen, Zhixiong Niu, Ran Shu, Wenxue Cheng, Peng Cheng, Yongqiang Xiong, Dan Li
Proceedings of the 10th Asia-Pacific Workshop on Networking | August 2026
Asia-Pacific Workshop on Networking
-
ACM MMSys 2024 Bandwidth Estimation in Real Time Communications Challenge
Sami Khairy, Gabriel Mittag, Vishak Gopal, Francis Y. Yan, Zhixiong Niu, Ezra Ameri, Scott Inglis, Mehrsa Golestaneh, Ross Cutler
ACM Multimedia Systems Conference (MMSys ’24) | April 2024
-
OpenNetLab: Open Platform for RL-based Congestion Control for Real-Time Communications
Jeongyoon Eo, Zhixiong Niu, Wenxue Cheng, Francis Y. Yan, Rui Gao, Jorina Kardhashi, Scott Inglis, Michael Revow, Byung-Gon Chun, Peng Cheng, Yongqiang Xiong
Asia-Pacific Workshop on Networking (APNet ’22) | July 2022
Best Paper Award
-
-
-
OptiFlow: Towards LLM-Driven Optimization of Collective Communication Algorithms
Fei Long, Ziyue Yang, Kaihui Gao, Shuai Wang, Li Chen, Zhixiong Niu, Ran Shu, Wenxue Cheng, Peng Cheng, Yongqiang Xiong, Dan Li
Proceedings of the 10th Asia-Pacific Workshop on Networking | August 2026
Asia-Pacific Workshop on Networking
-
SlimeMold: Scaling Distributed Hardware Load Balancers via a Unified Giant Connection Table
Ziyuan Liu, Zhixiong Niu, Ran Shu, Jianqin Zhang, Guohong Lai, Liang Gao, Na Wang, Zongying He, Jacob Nelson, Dan R. K. Ports, Lihua Yuan, Peng Cheng, Yongqiang Xiong
ACM SoCC 2026
-
Offloading Cloud Network Services at Production Scale with SONiC DASH SmartSwitch
Shaofeng Wu, Zhixiong Niu, Riff Jiang, Lawrence Lee, Junhua Zhai, Ze Gan, Vasundhara Volam, Prabhat Aravind, Prince Sunny, Prince George, Qi Luo, Evan Langlais, Soumya Tiwari, Venkat Satish Katta, Weixi Chen, Rishiraj Hazarika, Sachin Jain, Deven Jagasia, Michal Zygmunt, Avijit Gupta, Neeraj Motwani, Pranjal Shrivastava, Qiang Su, Anil Reddy Pannala, Kristina Moore, James Grantham, Anupam Pandey, Xin Liu, Guohan Lu, Gerald De Grace, Rishabh Tewari, Lihua Yuan, Erica Lan, Deepak Bansal, Dave Maltz, Yongqiang Xiong, Hong Xu
May 2026
Community Award
-
Mina: Fine-Grained In-network Aggregation Resource Scheduling for Machine Learning Service
Shichen Dong, Zhixiong Niu, Mingchao Zhang, Zhiying Xu, Chuntao Hu, Pengzhi Zhu, Qingchun Song, Lei Qu, Peng Cheng, Cam-Tu Nguyen, Shaoling Sun, Xiaohu Xu, Yongqiang Xiong, Wei Wang, Xiaoliang Wang
IEEE INFOCOM 2025 - IEEE Conference on Computer Communications | May 2025, pp. 1-10
-
ACM MMSys 2024 Bandwidth Estimation in Real Time Communications Challenge
Sami Khairy, Gabriel Mittag, Vishak Gopal, Francis Y. Yan, Zhixiong Niu, Ezra Ameri, Scott Inglis, Mehrsa Golestaneh, Ross Cutler
ACM Multimedia Systems Conference (MMSys ’24) | April 2024
-
A Disaggregate Data Collecting Approach for Loss-Tolerant Applications
Ziyuan Liu, Zhixiong Niu, Ran Shu, Peng Cheng, Wenxue Cheng, Yongqiang Xiong, Lihua Yuan, Jacob Nelson, Dan R. K. Ports
6th Asia-Pacific Workshop on Networking (APNet '22) | July 2022
-
OpenNetLab: Open Platform for RL-based Congestion Control for Real-Time Communications
Jeongyoon Eo, Zhixiong Niu, Wenxue Cheng, Francis Y. Yan, Rui Gao, Jorina Kardhashi, Scott Inglis, Michael Revow, Byung-Gon Chun, Peng Cheng, Yongqiang Xiong
Asia-Pacific Workshop on Networking (APNet ’22) | July 2022
Best Paper Award
-
-
-
OasisKV: Scaling In-Decode KV Cache Beyond HBM with Lookahead Sparse Prefetching
Can Xiao, Sukmin Cho, Junbong We, Zhixiong Niu, Jianyi Cheng, Yiren Zhao, Youngjin Kwon, Yongqiang Xiong, Rui Ma, Junyi Liu
August 2026
arXiv | August 2026
-
-
-
OptiFlow: Towards LLM-Driven Optimization of Collective Communication Algorithms
Fei Long, Ziyue Yang, Kaihui Gao, Shuai Wang, Li Chen, Zhixiong Niu, Ran Shu, Wenxue Cheng, Peng Cheng, Yongqiang Xiong, Dan Li
Proceedings of the 10th Asia-Pacific Workshop on Networking | August 2026
Asia-Pacific Workshop on Networking
-
Mina: Fine-Grained In-network Aggregation Resource Scheduling for Machine Learning Service
Shichen Dong, Zhixiong Niu, Mingchao Zhang, Zhiying Xu, Chuntao Hu, Pengzhi Zhu, Qingchun Song, Lei Qu, Peng Cheng, Cam-Tu Nguyen, Shaoling Sun, Xiaohu Xu, Yongqiang Xiong, Wei Wang, Xiaoliang Wang
IEEE INFOCOM 2025 - IEEE Conference on Computer Communications | May 2025, pp. 1-10
-
-
-
OptiFlow: Towards LLM-Driven Optimization of Collective Communication Algorithms
Fei Long, Ziyue Yang, Kaihui Gao, Shuai Wang, Li Chen, Zhixiong Niu, Ran Shu, Wenxue Cheng, Peng Cheng, Yongqiang Xiong, Dan Li
Proceedings of the 10th Asia-Pacific Workshop on Networking | August 2026
Asia-Pacific Workshop on Networking
-
-
-
SlimeMold: Scaling Distributed Hardware Load Balancers via a Unified Giant Connection Table
Ziyuan Liu, Zhixiong Niu, Ran Shu, Jianqin Zhang, Guohong Lai, Liang Gao, Na Wang, Zongying He, Jacob Nelson, Dan R. K. Ports, Lihua Yuan, Peng Cheng, Yongqiang Xiong
ACM SoCC 2026
-
ACM MMSys 2024 Bandwidth Estimation in Real Time Communications Challenge
Sami Khairy, Gabriel Mittag, Vishak Gopal, Francis Y. Yan, Zhixiong Niu, Ezra Ameri, Scott Inglis, Mehrsa Golestaneh, Ross Cutler
ACM Multimedia Systems Conference (MMSys ’24) | April 2024
-
A Disaggregate Data Collecting Approach for Loss-Tolerant Applications
Ziyuan Liu, Zhixiong Niu, Ran Shu, Peng Cheng, Wenxue Cheng, Yongqiang Xiong, Lihua Yuan, Jacob Nelson, Dan R. K. Ports
6th Asia-Pacific Workshop on Networking (APNet '22) | July 2022
-
OpenNetLab: Open Platform for RL-based Congestion Control for Real-Time Communications
Jeongyoon Eo, Zhixiong Niu, Wenxue Cheng, Francis Y. Yan, Rui Gao, Jorina Kardhashi, Scott Inglis, Michael Revow, Byung-Gon Chun, Peng Cheng, Yongqiang Xiong
Asia-Pacific Workshop on Networking (APNet ’22) | July 2022
Best Paper Award
-
-
-
Offloading Cloud Network Services at Production Scale with SONiC DASH SmartSwitch
Shaofeng Wu, Zhixiong Niu, Riff Jiang, Lawrence Lee, Junhua Zhai, Ze Gan, Vasundhara Volam, Prabhat Aravind, Prince Sunny, Prince George, Qi Luo, Evan Langlais, Soumya Tiwari, Venkat Satish Katta, Weixi Chen, Rishiraj Hazarika, Sachin Jain, Deven Jagasia, Michal Zygmunt, Avijit Gupta, Neeraj Motwani, Pranjal Shrivastava, Qiang Su, Anil Reddy Pannala, Kristina Moore, James Grantham, Anupam Pandey, Xin Liu, Guohan Lu, Gerald De Grace, Rishabh Tewari, Lihua Yuan, Erica Lan, Deepak Bansal, Dave Maltz, Yongqiang Xiong, Hong Xu
May 2026
Community Award
-