Find Academic Supervisors

Jean Oh is a Researcher at the Robotics Institute of Carnegie Mellon University (CMU) , leading the interdisciplinary Bot Intelligence Group (BIG) . Her work focuses on developing persistent robots that co-exist and collaborate with humans in shared environments, emphasizing continuous improvement through training, exploration, and human interaction. Education: Ph.D. in Language and Information Technologies, CMU M.S. in Computer Science, Columbia University B.S. in Biotechnology, Yonsei University Oh's research integrates vision, language, and planning systems in robotics, with applications in human-robot teaming , self-driving cars , disaster response , eldercare , and creative robotics . She has pioneered projects like socially-compliant robot navigation in human crowds and AI-driven robotic painting systems. Recent publication trends highlight her work in vision-language planning , social navigation , computational creativity , and human-robot collaboration . Notable contributions include the StyleCLIPDraw algorithm for text-to-art generation and Social-PatteRNN for human-like trajectory prediction. Scientific Awards: Best Paper Award in Cognitive Robotics (ICRA'18, ICRA'15) Best Systems Paper Finalist (HRI'25) Best Oral Paper Finalist (Humanoids'24) Best Paper in Entertainment (IROS'24) Argoverse Challenge Winner (CVPR'24) Best Student Paper (AIAA'24) Best Demo Finalist (RoboSoft'24) Oh mentors a diverse team of PhD, MS, and undergraduate students from CMU departments including Robotics, Computer Science, and Mechanical Engineering. Her research is funded by US Army Research Lab , DiDi Chuxing , and DARPA , with collaborations across industry and academia .

• Robotics
• Artificial Intelligence
• Human-Robot Interaction
• +5 more

Deva Kannan Ramanan is a Professor at the Robotics Institute of Carnegie Mellon University , focusing on computer vision , machine learning , and human-centered robotics . His work bridges neurorobotics and visual perception , with applications in autonomous driving and 4D reconstruction . Research Topics Computer Vision 3-D Vision and Recognition Visual Servoing Neurorobotics Human-Centered Robotics Graphics & Creative Tools His recent publications in CVPR , ICRA , and ICCV emphasize 4D human reconstruction , neural rendering , and vision-language models for autonomous systems. He serves as General Chair of CVPR 2027 and Program Chair of CVPR 2018 , with IARPA funding for aerial-ground rendering (2023-2027). Current students include PhD candidates Sally Chen, Kangle Deng, and Zhiqiu Lin, while past advisees like Arun Vasudevan and Olga Russakovsky now hold positions at Amazon and Meta respectively.

• Computer Vision
• 3-D Vision and Recognition
• Visual Servoing and Tracking
• +8 more

Michael Kaess is an Associate Professor at the Robotics Institute, Carnegie Mellon University (CMU), within the School of Computer Science. He leads the Robot Perception Lab (RPL) and contributes to the Field Robotics Center (FRC) and Computer Vision Group (CV). His research focuses on efficient perception algorithms for mobile robots, particularly in 3D mapping, SLAM, and sensor fusion using vision, LiDAR, inertial, and sonar data. Kaess holds a PhD in Computer Science from Georgia Tech and was a postdoc at MIT's Marine Robotics Lab. Education: Georgia Institute of Technology, PhD in Computer Science (2008) MIT, Postdoctoral Associate (2008–2010) Research Interests: Kaess develops algorithms for robust and efficient inference in robotics, emphasizing factor graphs and linear algebra. His work spans underwater robotics, aerial systems, tactile SLAM, and multi-sensor integration. Key areas include SLAM with planes/lines, imaging sonar reconstruction, and neural field methods for LiDAR-visual fusion. Publications: Over 145 papers, including work on EDPLVO (visual odometry), HoloOcean (underwater simulation), and neural radiance fields with LiDAR. Recent trends focus on robust incremental smoothing, acoustic-optical fusion, and real-time volumetric mapping. Awards: Recognized with the RSS Test of Time Award (2020), Outstanding Associate Editor (2022), and paper awards at ICRA/ICRA. Active in conference organization (IROS/ICRA program committees). Advising & Grants: Supervises 10+ current PhD/MSc students, with past advisees contributing to CoRL/ICRA work. Manages grants in perception, autonomy, and marine robotics. Teaches courses like Robot Localization and Mapping (16-833). Labs/Teams: Directs RPL, collaborates with FRC on field robotics. Develops open-source tools like GTSAM (GNU Toolkit for Smoothing and Mapping).

• Robotics
• Computer Vision
• SLAM (Simultaneous Localization and Mapping)
• +6 more

Lerrel Pinto is an Assistant Professor of Computer Science at the Courant Institute of Mathematical Sciences at New York University (NYU), where he leads the General-purpose Robotics and AI Lab (GRAIL) as part of the CILVR research group. His work bridges the gap between theoretical machine learning and practical robotics applications, with a focus on enabling robots to generalize and adapt in real-world environments. Dr. Pinto received his undergraduate degree from IIT Guwahati, followed by a PhD from the Robotics Institute at Carnegie Mellon University (CMU). He then completed a postdoctoral fellowship at the University of California, Berkeley before joining NYU as faculty. His research program centers on robot learning and decision making, with several key thrusts that demonstrate his innovative approach to robotics. Pinto's work emphasizes large-scale learning techniques that leverage both extensive data and sophisticated model architectures. A significant portion of his research focuses on representation learning for sensory data, particularly developing methods that enable robots to make sense of visual, tactile, and auditory inputs. His lab has made notable contributions to reinforcement learning algorithms that allow robots to adapt to new scenarios with minimal retraining. Pinto also champions open-source robotics , developing affordable robot platforms that democratize access to robotics research. Analysis of Pinto's recent publications reveals a strong trend toward multimodal perception in robotics, integrating visual, tactile, and auditory information to create more robust robot systems. His work increasingly focuses on zero-shot and few-shot learning capabilities, enabling robots to handle novel situations without extensive retraining. There's also a clear progression toward general-purpose robotics , moving away from task-specific solutions toward more flexible systems that can handle diverse real-world challenges. Dr. Pinto's scientific contributions have been recognized with several prestigious awards: Sloan Research Fellowship (2025) NSF CAREER Award (2024) RAL Early Career Award (2024) Best Student Paper Award at ICRA (2016) Outstanding Paper Award at MFM-EAI workshop at ICML (2024) Best Paper Award at NGSM workshop at ICML (2024) Best Student Paper Award at RSS (2023) As an advisor, Pinto has mentored numerous students who have gone on to impactful careers in both academia and industry. His former PhD student Denis Yarats co-founded Perplexity.AI, while Mahi Shafiullah became a postdoc at UC Berkeley and Meta AI. Many of his Masters students have pursued PhDs at top institutions like CMU, MIT, and Stanford, or joined leading robotics companies including 1X, Fauna Robotics, and NVIDIA. Pinto's lab has secured significant research funding, including the NSF CAREER award and likely other grants supporting his robotics research program. The General-purpose Robotics and AI Lab (GRAIL) that Pinto leads brings together a diverse team of researchers working on cutting-edge robotics challenges. The lab maintains strong collaborations with industry partners and other academic institutions, facilitating technology transfer and real-world impact. GRAIL's research spans multiple robotics platforms and focuses on developing algorithms that enable robots to learn from diverse experiences and generalize across environments.

• Robotics
• Robot Learning
• Machine Learning
• +7 more

Katerina Fragkiadaki is the JPMorgan Chase Associate Professor of Computer Science in the Machine Learning Department at Carnegie Mellon University. She works at the intersection of Artificial Intelligence, Computer Vision, Machine Learning, Language Understanding, and Robotics. PhD from GRASP Lab, University of Pennsylvania Postdoctoral researcher at UC Berkeley (with Jitendra Malik) and Google Research Recipient of NSF CAREER, DARPA Young Investigator, Amazon, Google, Sony, UPMC, and AFOSR awards Organizer of CoRL 2023 Workshop on Generalist Robots ICLR 2024 Program Chair, multiple area chair roles Her research group focuses on developing machines that autonomously improve world models through human-environment interactions, with specific emphasis on: Representation learning and video understanding 2D/3D unified vision-language models Generative simulation and reinforcement learning Real2Sim/Sim2Real robot learning Continual learning and spatial common sense 3D scene reconstruction and dynamics Recent publications highlight advancements in: 3D mesh generation with compositional transformers Unified 2D/3D perception frameworks Physics-aware generative models Diffusion-based robotic manipulation policies Embodied agents with memory prompting Awards include: 2024: DARPA Young Investigator Award 2023: Amazon Faculty Award 2022: Sony Faculty Research Award 2021: UPMC Faculty Research Award 2020: NSF CAREER Award 2019: Google Faculty Award Key collaborations span institutions including UC Berkeley, Google Research, Stanford, MIT, and University of Tsukuba. Her work bridges theoretical innovation with practical applications in: Autonomous robot manipulation 4D world modeling Language-grounded perception Visual dynamics prediction Embodied program synthesis Physics-based simulation engines

• Artificial Intelligence
• Computer Vision
• Machine Learning
• +8 more

Sanjiv Singh is a Research Professor at the Robotics Institute within Carnegie Mellon University's School of Computer Science. His academic journey at CMU spans from Systems Scientist (1995-2001), to Senior Research Scientist (2001-2003), Associate Research Professor (2003-2007), and finally Research Professor since 2007. He also holds an adjunct faculty position in Mechanical Engineering since 2009. Singh serves as Editor-in-Chief of the Journal of Field Robotics, demonstrating his leadership in the robotics community. His educational background includes a Ph.D. and M.S. in Robotics from Carnegie Mellon University (1995, 1992), an M.S. in Electrical Engineering from Lehigh University (1985), and a B.S. in Computer Science from the University of Denver (1983). Dr. Singh's research focuses on three primary themes: Autonomous Navigation (developing motion planning and control for ground and air vehicles with applications in agriculture, exploration, and low-flying aircraft), Coordinated Multi-Robots (examining team-based tasks like structure assembly and search/rescue operations), and Forceful Interaction with the world (using physical models to enable robots to handle complex, high-force interactions). His work spans aerial robotics, agricultural and forestry robotics, mining robotics, 3D vision, sensing and perception, visual servoing, motion planning, and field service robotics. Analysis of his recent publications (2016-2020) reveals a strong focus on collision avoidance algorithms, sensor fusion techniques, and real-time navigation systems. His research demonstrates consistent advancement in SLAM (Simultaneous Localization and Mapping) technologies, particularly in GPS-denied environments, with increasing sophistication in handling complex aerial maneuvers and multi-robot coordination. Editor-in-Chief of Journal of Field Robotics Dr. Singh has advised numerous graduate students throughout his career, with current advisees including Matt Aasted (Ph.D), Andrew Chambers (M.S), Hugh Cover (M.S), Michael Dille (Ph.D), and Justin Haines (M.S). His past students include prominent researchers like Sebastian Scherer, Joe Djugash, Fred Heger, Geoff Hollinger, and Ji Zhang who have gone on to make significant contributions in robotics. His research has been supported through various projects including CASC (agricultural applications), Riverine, Transformer, Trestle, and Ember. His laboratory work focuses on developing practical robotic systems capable of operating in challenging real-world environments, with particular emphasis on agricultural applications, search and rescue operations, and coordinated multi-robot teams that can work effectively alongside humans.

• Aerial Robotics
• Robotics in Agriculture and Forestry
• Mining Robotics
• +11 more

Chris Atkeson is a Professor at the Robotics Institute of Carnegie Mellon University. His research focuses on achieving human-level competence in machines through humanoid robotics and human-aware environments. He explores machine learning techniques such as reinforcement learning, nonparametric methods, and memory-based learning to develop robots capable of complex tasks like manipulation, locomotion, and perception. His work emphasizes bridging the gap between simulation and real-world applications (sim2real transfer), with contributions to tactile sensing (e.g., FingerVision), dynamic walking control, and human-robot collaboration. Notable projects include participation in the DARPA Robotics Challenge with Team WPI-CMU, where his team developed reliable humanoid behavior for disaster response scenarios. Atkeson’s research spans robotics, computer vision, and control systems, with a focus on enabling robots to perceive, learn, and act in unstructured environments. His recent work includes advancements in 3D scene capture, soft robotics, and energy-based planning for compositional tasks.

• Robotics
• Humanoid Robotics
• Human-Aware Environments
• +7 more

Oliver Kroemer is an Associate Professor at Carnegie Mellon University's Robotics Institute (RI), affiliated with the Intelligent Autonomous Manipulation (IAM) Lab. His research focuses on enabling robots to learn versatile manipulation skills through lifelong frameworks, with applications in elder care, environmental maintenance, and hazardous operations. Developed methods for robot learning via physical interaction and reinforcement learning Created representations for contact states and motor primitives to improve skill generalization Research Interests: Spanning robot learning, tactile sensing, force-velocity control, and lifelong skill acquisition. Projects include Agile and Dynamic Interactions for Mobile Manipulation and Integrated Planning and Learning (Pillar project). Scientific Awards: Finalist, Georges Giralt Ph.D. Award (2015) Education: Masters & Bachelors in Engineering, University of Cambridge (2008) Ph.D., Technische Universitaet Darmstadt (2014) Students & Affiliates: Current PhD: Mark Lee, Sarvesh Patil, Saumya Saxena, Yunus Seker, Zilin Si Past PhD: Alex LaGrassa, Tabitha Lee, Qiao Liang, Shivam Vats, Kevin Zhang

• Robot Learning for Manipulation
• Motion Planning for Manipulation Tasks
• Learning and Classification Algorithms
• +4 more

Deva Ramanan is a Professor at the Robotics Institute of Carnegie Melllon University, where he leads research in computer vision and machine learning. His work focuses on modeling human visual perception, leveraging large-scale visual data, and developing systems for 3D understanding, neural rendering, and autonomous systems. He advises a large group of PhD students and has mentored numerous postdoctoral researchers now in leading roles across industry and academia. His research interests include computer vision, machine learning, human perception modeling, 3D scene understanding, neural rendering, autonomous driving, video understanding, and multimodal foundation models. These areas reflect his focus on both foundational models and their application to real-world problems in robotics and AI. The recent publications highlight a strong trend toward multimodal and 3D-aware models, with increasing use of diffusion models, neural fields, and large vision-language systems. Key themes include scene flow, 3D reconstruction from monocular video, autonomous driving perception, and robust evaluation of vision-language models. There is a clear emphasis on both methodological innovation and practical deployment in dynamic environments. Marr Prize, Honorable Mention (ICCV 2021) Best Paper, Honorable Mention (ECCV 2020) Best Paper Finalist (WACV 2024) Best Paper Award (WACV 2016) Best Industrial Paper, Honorable Mention (BMVC 2017) Marr Prize winner (ICCV 2009) Deva Ramanan has advised numerous PhD and master’s students, many of whom are now at top institutions and companies including Apple, Meta, Google, Nvidia, OpenAI, and Princeton. He has received substantial funding from IARPA, DARPA, NSF, Intel, Google, and Facebook for projects in video analytics, dispersed computing, visual cloud systems, and multi-task recognition. His group has developed influential datasets and benchmarks used widely in the community. He leads a vibrant research lab focused on advancing computer vision through deep learning and multimodal integration. His team works on core challenges in perception, including 3D reconstruction, motion modeling, object detection, and scene understanding, with applications in robotics and autonomous systems.

• Computer Vision
• Machine Learning
• Human Perception Modeling
• +5 more

Matthew O'Toole is an Associate Professor at Carnegie Mellon University's School of Computer Science, holding joint appointments in the Robotics Institute and Computer Science Department. His research focuses on computational imaging, integrating optics, electronics, and computational processing to innovate visual information capture and display. Education: PhD (Computer Science, University of Toronto, 2016), MSc (2009), BSc (Honors Computer Science and Mathematics, University of British Columbia, 2007). Prior roles include Banting Postdoctoral Fellow at Stanford University and visiting scholar at MIT Media Lab's Camera Culture group. Research interests emphasize programmable imaging systems, transient imaging, non-line-of-sight sensing, and holographic displays. Key innovations include vibration sensing via dual-shutter optics and radar super-resolution for autonomous vehicles. Awards include runner-up best paper recognitions at ICCV 2007, CVPR 2014, and SIGGRAPH 2017 dissertation honors. Advisees include Dorian Chan and Arjun Teh. Grants supported by Canadian Banting Fellowships. Active in workshop organization (CVPR Computational Cameras 2016-2017) and course development on computational imaging at SIGGRAPH 2014. Labs/Teams: Leads research in computational imaging and robotics at CMU, collaborating with industry partners like NVIDIA and MDA. Current projects explore LiDAR-radar fusion, holographic projection systems, and dynamic scene reconstruction.

• Computer Graphics
• Robotics
• Computer Vision
• +5 more

Shubham Tulsiani is an Assistant Professor at Carnegie Mellon University's Robotics Institute, where he leads the Computer Vision group and the Physical Perception Lab. His research focuses on inferring physically and spatially grounded representations from perceptual inputs, with applications in 3D vision, robot manipulation, and neural scene reconstruction. He directs an active research group with multiple PhD and Master's students. Research interests center on 3D scene understanding , robot learning , and generative modeling , with specific emphasis on: self-supervised perception, neural rendering, multi-view geometry, manipulation from visual inputs, and physics-based reasoning. The lab develops methods that leverage physical world constraints as supervisory signals. Recent publications demonstrate strong focus on diffusion models for 3D tasks , sparse-view reconstruction , and robotic manipulation transfer . Key trends include neural inverse rendering, view synthesis from limited observations, and translating human interactions to robot actions. Awards include: Best Student Paper Award at CVPR 2015 Advising includes supervision of 5 PhD students, 4 MS students, and undergraduates. Lab alumni hold positions at Google, Stanford, Meta, and Princeton. The Physical Perception Lab collaborates with FAIR Pittsburgh and the CMU Computer Vision group.

• Computer Vision
• 3D Vision
• Robot Learning
• +4 more

Sebastian Scherer is an Associate Research Professor at the Robotics Institute (RI), Carnegie Mellon University (CMU), where he leads cutting-edge research in autonomous aerial systems and robotics. His work focuses on enabling unmanned rotorcraft to operate safely and efficiently in cluttered, low-altitude, and extreme environments. Education: Ph.D. in Robotics, Carnegie Mellon University (2010) MS in Robotics, Carnegie Mellon University (2007) BS in Computer Science (Minor in Robotics), Carnegie Mellon University (2004) His research interests span robotics, artificial intelligence, autonomous navigation, obstacle avoidance, SLAM, visual-inertial odometry, energy infrastructure, and public policy . He has made seminal contributions to UAV autonomy, including the first obstacle avoidance for micro aerial vehicles in natural environments (2008) and the first automatic landing zone detection and landing on a full-size helicopter (2010). His recent publications (2023–2025) demonstrate a strong focus on resilient autonomy, multi-robot exploration, foundation models for robotics, and large-scale dataset development. His team has released key datasets like TartanGround , BETTY , and SubT-MRS , and simulation tools like Pegasus Simulator , indicating a systems-level approach to advancing real-world autonomy. The research trends emphasize self-supervised learning, robust perception, risk-aware planning, and multi-modal fusion for off-road and urban environments. Scientific Awards: Popular Science Best of What's New 2010 Award AIAA@Infotech Best Paper Runner-up Award (2010) Siebel Scholar Dr. Scherer has advised numerous students and leads a vibrant research group focused on high-impact robotics applications. He has secured significant grants related to UAV autonomy, energy infrastructure, and urban air mobility. His lab develops experimental infrastructure such as AIrTonomy for testing next-generation autonomous aerial vehicles. He is actively involved in advancing SLAM and localization in extreme environments, notably through participation in the DARPA Subterranean Challenge. His team develops large-scale datasets and benchmarking frameworks to push the boundaries of robustness and generalization in mobile robotics.

• Robotics
• Unmanned Aerial Vehicles
• Autonomous Navigation
• +13 more

James McCann is an Associate Professor at the Carnegie Mellon Robotics Institute, where he leads the Carnegie Mellon Textiles Lab. He has been a faculty member since May 2017 after working at Disney Research Pittsburgh. McCann's academic journey includes a PhD from Carnegie Mellon advised by Nancy Pollard, followed by a postdoc at Adobe Research and a period developing video games. McCann's research focuses on building creative tools that operate in real-time and build user intuition, with particular emphasis on textiles fabrication and machine knitting. His work spans computer-aided fabrication, simulation, graphics, and creative tools development. He has pioneered systems for machine knitting design, including compilers for knitting instructions and tools for automatic conversion of 3D meshes to knitting patterns. His recent publications demonstrate a strong trend toward computational textiles, with significant contributions to knitting semantics, deployable textile structures, and applications of machine knitting in healthcare and robotics. McCann's work bridges computer science, robotics, and textile arts, creating practical systems for once-off manufacturing with industrial knitting machines. McCann actively mentors students, with current PhD candidates working on solid knitting machines, knit calibration, and assistive devices. His teaching portfolio includes courses on Real-Time Graphics, Algorithmic Textiles Design, and Game Programming. He has taught at CMU since 2017, developing innovative courses that blend computer science with physical fabrication. As director of the Textiles Lab, McCann oversees research projects spanning machine knitting, robotic painting, and real-time graphics systems. His lab develops practical tools for creators, emphasizing intuitive interfaces and real-time feedback that lower barriers to advanced fabrication techniques.

• Textiles Manufacturing
• Computer-Aided Fabrication
• Real-time Systems
• +5 more

Yonatan Bisk is an Assistant Professor at Carnegie Mellon University within the Language Technologies Institute (with courtesy appointment in Robotics Institute). His research bridges Natural Language Processing , Robotics , and Embodied AI , focusing on language grounding, theory of mind, and multimodal interaction. Education : Ph.D. in Computer Science from University of Illinois at Urbana-Champaign Postdoctoral Experience : USC ISI, University of Washington, Allen Institute for AI Industry Appointments : Microsoft Research, Meta AI His research emphasizes embodied language systems and social intelligence in AI . Recent projects include WebArena for autonomous agents, SOTOPIA for social reasoning, and HomeRobot for open-vocabulary manipulation. He leads the REAL Center (Robotics, Embodied AI, and Learning) to foster interdisciplinary collaboration. Key scientific awards include selection for the DARPA ISAT Study Group (2024). He teaches courses like "Talking to Robots" and "Multimodal Machine Learning" while serving as area chair/editor across NLP, Robotics, and ML communities.

• Embodied Artificial Intelligence
• Natural Language Processing
• Robotics
• +3 more

Steve Chase is a Professor at Carnegie Mellon University , affiliated with the Biomedical Engineering , Electrical and Computer Engineering , Neuroscience Institute , and Robotics Institute departments. His research spans Computational Neuroscience , Neural Engineering , and Systems Neuroscience , with a focus on neural circuits, motor control, and brain-computer interfaces (BCI). Research Areas: Sensation & Perception, Methods Development, Diseases & Disorders, Physiological & Anatomical Methods. Lab Highlights: Development of the RotaWheel, memory trace studies in the motor cortex, and investigations into BCI stabilization and learning dynamics. Scientific Contributions: His lab has published extensively in journals like Neuron , Nature Computational Science , eLife , and PNAS , with notable works on neural activity patterns, dimensionality reduction in calcium imaging, and sensory constraints on motor cortex modulation. Students and postdocs in his lab have received awards, including the CNBC best paper award.

• Computational Neuroscience
• Neural Engineering and Technology
• Systems Neuroscience
• +4 more