Luo Mai

Luo Mai is an Assistant Professor at the University of Edinburgh's School of Informatics, with an upcoming promotion to Associate Professor (UK Reader) in August 2025. He leads the Large-Scale Machine Learning Systems Group and co-leads the UK EPSRC Centre for Doctoral Training in Machine Learning Systems and an ARIA Project on Scaling AI Compute by 1000X.

• PhD in Computer Science (Imperial College London, 2018)
• MRes in Advanced Computing (Imperial College London, 2012)

His research focuses on the intersection of computer systems, machine learning, and data management. Key contributions include award-winning systems like WaferLLM (wafer-scale LLM inference), Tenplex (elastic ML), and ServerlessLLM (serverless LLM serving), published at top venues (OSDI, SOSP, ICML, NeurIPS, JMLR).

Recent publications demonstrate trends in GPU-based distributed systems, LLM optimization, and adaptive machine learning. His team has developed groundbreaking open-source projects including TensorLayer, TorchOpt, and ServerlessLLM.

Awarded Microsoft Research StarTrack Scholar (2024), secured ARIA grant (2024) with Imperial College & Cambridge University, and received Google Fellowship during PhD (2012-2016).

As an educator, he designed Edinburgh's popular Machine Learning Systems course (150+ students). His group supervises multiple PhD students including Yao Fu (recognized as 2024 Rising Star in ML & Systems) and Leyang Xue.