About Me

I am an Assistant Professor in the Department of Computer Science at the University of Illinois Urbana-Champaign (UIUC). Prior to UIUC, I worked at Systems Research@Google and Meta AI, focusing on practical systems for GenAI.

Research Interests: ML System & Algorithm, Cloud Computing, Networked Systems

Our research brings together ML algorithms, systems, and computer networking to develop practical AI systems and algorithms for efficient ML and data analytics, from the cloud to the planetary scale. Our systems have been adopted by big companies including Google, Meta, LinkedIn, and Cisco. Our current topics of interests include:

  • Cloud ML Systems and Algorithms: LLMs, dLLMs (Image/VideoGen), reasoning models, DLRMs
  • Systems for Collaborative Learning: edge-cloud ML, hyperscale training, federated learning
  • (Systems for) ML for Systems: deployable learning-based systems

Prospective student: I am looking for highly self-motivated MS & PhD students and (remote) interns who are excited about ML and Systems research. Join us to work on exciting projects together!

News

  • [07/2026] I-DLM (Diffusion LM) accepted to COLM'26 (with unanimously positive review!). Congrats to Yifan and our collaborators!
  • [05/2026] EMA (ML4Sys) accepted to SIGCOMM'26. Congrats to Daiyang, Yihan, and Xinyu!
  • [04/2026] XRPO (RLHF reasoning) and CORRECT (Multi-Agent Debugging) accepted to ICML'26. Congrats to Yifan, Minghao, and Udbhav!
  • [04/2026] Compass (Compound AI Serving) accepted to VLDB'26. Congrats to Banruo, Wei-Yu, Minghao and Hunter!
  • [01/2026] OPPO (Efficient RLHF) accepted to ICLR'26. Congrats to Kaizhuo and Yingjie!
  • [12/2025] JITServe (LLM Agentic Serving) accepted to NSDI'26. Congrats to Wei and Zhiyu!
  • [09/2025] Three papers accepted to NeurIPS'25!
  • [07/2025] IC-Cache (LLM Serving) accepted to SOSP'25. Congrats to Yifan and our Google collaborators!
  • [07/2025] NetZip (LLM Training Compression) accepted to MICRO'25
  • [02/2025] Venn (On-device AI) accepted to MLSys'25
  • [01/2025] (Fall) UIUC List of Teachers Ranked as Excellent (CS 598)
  • [11/2024] Honorable Mention for ACM SIGOPS Doctoral Dissertation Award!
  • [09/2024] LTE (LLM sparsity) accepted to NeurIPS'24
  • [08/2024] Sequoia (distributed ML) accepted to SIGMOD'25
  • [02/2024] FedTrans (personalized on-device ML) accepted to MLSys'24
  • [10/2023] Wins David J. Kuck CSE Dissertation Prize!
  • [09/2023] Auxo (clustered federated learning) accepted to SoCC'2023
  • [05/2023] Selected as ML and Systems Rising Stars!
  • [03/2023] AdaEmbed (efficient large model pruning) accepted to OSDI'2023!
  • [03/2023] Fed-ensemble (personalized federated learning) accepted to IEEE ASE'23
  • [03/2023] Win the Towner Prize for Distinguished Academic Achievement!
  • [01/2023] CCS (efficient ML training) accepted to ICLR'23
  • [01/2023] Egeria (efficient ML training) accepted to EuroSys'2023

Recent Publications

(Full List; Underlined are the students I supervise(d).)

Professional Service

  • Program Committee
    • 2026: SOSP, SIGCOMM, ASPLOS, EuroSys, MLSys, HotNets
    • 2025: OSDI, NSDI, EuroSys, ICDCS
    • 2024: ATC, APSys, HotInfra
    • 2023: DistributedML, FL workshop@ICML
  • Reviewer for NeurIPS, ICML, CVPR

Teaching

Students

I am very fortunate to work with many wonderful students (incomplete list):

Prior Students (Staying for more than six months):
  • Jianli Jin (MS'26 → UIUC PhD)
  • Zhiyu Wu (MS'26 → UIUC PhD)
  • Rui Ning (BS'26 → MIT PhD)
  • Qilong Feng (BS'26 → CMU PhD)
  • Ziyang Lin (BS'26 → UIUC MS)
  • Minghao Fang (BS'26 → UIUC MS)
  • Yingjie Yu (BS'25 → CMU MSML)
  • Chengsong Zhang (MS'25 → NVIDIA)
  • Phillip Wang (MS'25 → WeRide.ai)
  • Yihan Zhang (MS'25 → UCD PhD)
  • Xinyu Chen (BS'25 → Purdue PhD)
  • Wei-Yu Lin (MS'24 → Google)