Hao LiuView profile
Assistant Professor
Hao Liu is an incoming Assistant Professor of Machine Learning at Carnegie Mellon University and currently works as a research scientist at Google DeepMind. Previously, he completed his Ph.D. in Computer Science at UC Berkeley under the supervision of Pieter Abbeel. He also spent two years part-time at Google as part of the Google Brain team. His educational background includes: Ph.D. in Computer Science from UC Berkeley Hao Liu's research focuses on solving intelligence through deep learning, neural networks, and innovative learning objectives. His work spans multiple areas including large language models, reinforcement learning, world models, and attention mechanisms for long context processing. He has made significant contributions to making transformer models more efficient and capable of handling extremely long sequences through techniques like Ring Attention and Blockwise Transformers. His recent publications demonstrate a strong focus on extending the capabilities of language and vision models, particularly in handling long sequences and multimodal data. Key themes include attention optimization, tokenization efficiency, and alignment techniques. His work bridges theoretical advances with practical implementations for real-world AI systems, with multiple papers at top conferences including NeurIPS, ICML, and ICLR, often receiving spotlight or oral presentations. Hao is actively involved in open-source AI research, having contributed to projects like Koala and OpenLLaMa, which aim to make advanced language models more accessible to the research community. His work on RingAttention has been implemented as a Python package available on GitHub, demonstrating his commitment to practical implementations and community sharing.
