Find Academic Supervisors

• Speech and Audio Processing
• Behavioral Signal Processing
• Real-Time MRI of Speech Production
• +4 more

Shrikanth (Shri) Narayanan is a University Professor and holder of the Niki and Max Nikias Chair in Engineering at the University of Southern California (USC), serving as the inaugural Vice President for Presidential Initiatives. He leads the Signal Analysis and Interpretation Lab (SAIL) and holds joint appointments in Computer Science, Linguistics, Psychology, Neuroscience, Pediatrics, and Otolaryngology-Head and Neck Surgery. His research focuses on speech and audio processing, behavioral signal processing, and real-time MRI of speech production, with applications in healthcare, education, and technology. Education: B.E. in Electrical Engineering from College of Engineering, Guindy (Chennai, India, 1988); M.S., Engineer, and Ph.D. in Electrical Engineering from UCLA (1990, 1992, 1995). Research interests span computational linguistics, machine learning, and multimodal human behavior analysis. He pioneered technologies for speech biomarkers in mental health, real-time MRI of speech production, and wearable sensor systems for longitudinal health studies. His work in speech emotion recognition, forensic interviews, and clinical applications has been recognized through over 40 awards, including the IEEE Flanagan Award and ISCA Medal. He has published extensively in journals like Proceedings of the IEEE , Journal of the Acoustical Society of America , and PLOS One . Key Grants: NSF CAREER, Okawa Research, IBM Faculty, Google/Amazon awards. Labs/Teams: Signal Analysis & Interpretation Lab (SAIL), USC Information Sciences Institute (ISI), Google Visiting Faculty Researcher.

Chris DonahueView profile

Assistant Professor

• Artificial Intelligence
• Machine Learning
• Music Technology
• +5 more

Chris Donahue is an Assistant Professor in the Computer Science Department at Carnegie Mellon University . He also serves as a part-time Research Scientist at Google DeepMind on the Magenta team. His work focuses on leveraging generative AI to enhance human creativity, particularly in music. Education: PhD in Computer Science (UC San Diego), Postdoctoral Scholar (Stanford University) His research spans controllable generative modeling of music and audio , with a focus on real-time interactive systems. Projects like Piano Genie , Beat Sage , and Copilot Arena demonstrate his commitment to real-world deployment. His Generative Creativity Lab (G-CLef) explores AI applications beyond music, including programming and natural language. Recent publications highlight advancements in multimodal music evaluation , real-time adaptation , and AI-driven sound morphing . He co-developed Magenta RealTime , an open-weight real-time music generation model, and MusicFX DJ Mode . Scientific Awards: Best Paper Award (top 1) at NAACL Student Research Workshop 2025 Best Paper Award (top 1% of submissions) at CHI 2025 Best Paper Runner-up at ISMIR 2021 He co-advises PhD students like Wayne Chi (NDSEG Fellow) and mentors Irmak Bukey . His lab receives support from the AIxArts incubator fund at CMU .

Adriana KovashkaView profile

Associate Professor

• Computer Vision
• Machine Learning
• Natural Language Processing
• +7 more

Adriana Kovashka is an Associate Professor at the University of Pittsburgh , affiliated with the School of Computing and Information and serving as Department Chair . Her academic journey began with BA degrees in Computer Science and Media Studies from Pomona College (2008) and a PhD in Computer Science from The University of Texas at Austin (2014). Joined Pitt’s faculty in January 2015 NSF CAREER awardee (2021) Google Faculty Research Award recipient Dr. Kovashka’s research spans Computer Vision , Machine Learning , and Natural Language Processing , focusing on visual rhetoric, weak multimodal supervision, and domain adaptation. She pioneered techniques for analyzing political imagery, developing robust object detection frameworks, and exploring the intersection of visual and textual persuasion through large-scale annotated datasets. Her recent work emphasizes geographic diversity in vision-language systems, audio-visual fusion for domain generalization, and shape-texture bias mitigation in CNNs. Key publications include groundbreaking studies on symbolic reasoning, multimodal dialogue systems, and ethical AI applications in education. Scientific honors include: NSF CRII Award (2016) NSF CAREER Award (2021) Pitt CRDF Award (2016, 2018) Best Paper at ECV Workshop (2021) Google Faculty Research Award (2016, 2018) Dr. Kovashka actively mentors students in multimodal learning projects and collaborates with interdisciplinary teams on NSF-funded initiatives. She co-organizes workshops like the first CVPR workshop on advertisement understanding and leads research groups exploring human-AI co-learning systems.

Olga Sorkine-HornungView profile

Professor

• Digital Content Creation
• Geometry Processing
• Shape Representation and Editing
• +5 more

Olga Sorkine-Hornung is a Professor of Computer Science at ETH Zurich and head of the Institute of Visual Computing. She leads the Interactive Geometry Lab, focusing on theoretical and practical advancements in digital content creation, geometry processing, and shape modeling. Current position: ETH Zurich, Department of Computer Science Previous roles: Courant Institute (NYU), Technical University of Berlin Education: BSc and PhD from Tel Aviv University, postdoc at TU Berlin Her research spans shape representation, digital fabrication, computer animation, and fundamental geometry processing. Key contributions include Laplacian surface editing, as-rigid-as-possible deformation, and generalized winding numbers. She works on applications in VR, AR, and autonomous systems. Awards include Test of Time Awards (2024), ACM Fellow (2020), ERC Consolidator Grant (2020), and EUROGRAPHICS Young Researcher Award (2008). She has supervised numerous students and co-developed software libraries like libigl and Instant Meshes . Co-chair roles for SIGGRAPH, Eurographics, and Pacific Graphics Editorial board member for ACM Transactions on Graphics and other journals Keynote speaker at VMV, CVPR, and SIAM conferences Her work bridges mathematical rigor with practical implementation, advancing computer graphics and geometry processing through intuitive algorithms that maintain surface detail while enabling efficient computation.

Alexander SchwingView profile

Associate Professor

• Machine Learning
• Computer Vision
• Structured Prediction
• +7 more

Alexander Schwing is an Associate Professor in the Department of Electrical and Computer Engineering and Computer Science at the University of Illinois at Urbana-Champaign, affiliated with the Coordinated Science Laboratory. His research focuses on machine learning and computer vision with applications in 3D scene understanding, generative modeling, and multi-agent systems. Education: Diploma in Electrical Engineering and Information Technology, Technical University of Munich (TUM) PhD in Computer Science, ETH Zurich Postdoctoral Fellow, University of Toronto Research Interests: Structured prediction in deep learning Generative adversarial networks and stability Multi-modal vision-language models 3D scene reconstruction from single images Embodied agent collaboration Semantic segmentation with temporal coherence Recent Publications: Highlight trends in neural rendering, video object segmentation, and reinforcement learning with applications to 3D modeling and multi-agent systems. Notable innovations include SAIL-VOS dataset for amodal segmentation and NeRFDeformer for single-view scene transformation. Scientific Awards: NSF CAREER Award, 3M and Amazon research awards, multiple student recognition awards, ETH Zurich PhD medal, and best paper at Intelligent Tutoring Systems 2014. Teaching: Offers graduate courses in Pattern Recognition (ECE 544) and Machine Learning (CS 446/ECE 449). Previously taught at University of Toronto and ETH Zurich. Labs & Collaborations: Leads research at Coordinated Science Laboratory (UIUC) with collaborations across University of Toronto, ETH Zurich, and industry partners like Samsung SAIT and Amazon.

• Computer Vision
• Artificial Intelligence
• Machine Learning
• +4 more

Andrew Zisserman is a Royal Society Research Professor at the University of Oxford's Department of Engineering Science, affiliated with the Visual Geometry Group (VGG). His research focuses on computer vision, artificial intelligence, and neural networks, with significant contributions to multimodal learning, video understanding, and 3D scene analysis. He leads projects exploring visual-language models, audio-visual synchronization, and clinical imaging applications. Key research areas include: Video analysis and temporal modeling Multimodal systems for sign language translation and action recognition 3D shape estimation and physical property inference Foundation models and cross-modal retrieval Recent work highlights: Developed Flamingo and Tapir models for video-language tasks Advancements in spinal MRI analysis and clinical imaging Leadership in EGO4D and VoxCeleb challenges Honors include Fellowship of the Royal Society (FRS) and the ISSLS Prize in Clinical Science 2023 for spinal analysis innovations. His lab collaborates globally, emphasizing real-world applications in healthcare and autonomous systems.

Xavier SerraView profile

Professor

• Audio Signal Processing
• Sound and Music Computing
• Music Information Retrieval
• +5 more

Xavier Serra is a Full Professor at the Department of Engineering at Universitat Pompeu Fabra (UPF), Barcelona. He is the founder and director of the Music Technology Group (MTG), and leads the UPF-BMAT Chair on AI and Music. He also coordinates the Master in Sound and Music Computing and serves as President of the Phonos Foundation. His research focuses on audio signal processing, sound and music computing, and computational musicology, emphasizing open science and open innovation. Education: BSc in Biology, University of Barcelona (1981) Master in Music, Florida State University (1983) PhD in Computer Music, Stanford University (1989) Research Interests: Audio Signal Processing Data-Driven and Knowledge-Driven Methodologies Music Information Retrieval Cultural Music Analysis (e.g., Carnatic/Turkish/Andalusian Music) Music Education Technology Notable Projects: CompMusic (ERC Advanced Grant, 2010-2017): Multicultural computational music analysis Open datasets: Freesound, Saraga, FSD50K Technologies: Reactable, Vocaloid, Essentia API Recent Trends in Articles: Focus on AI-driven audio processing (neural fingerprints, generative models), cross-cultural music analysis, and explainable music difficulty estimation. Awards: ERC Advanced Grant (2010) for CompMusic Project. Labs/Teams: Director of MTG, Phonos Foundation, and UPF-BMAT Chair. Active in open-source projects and international collaborations.

Nima MesgaraniView profile

Associate Professor

• Acoustic Signal Processing
• Computational Neuroscience
• Brain-Machine Interface
• +3 more

Nima Mesgarani is an Associate Professor of Electrical Engineering at Columbia Engineering, Columbia University, affiliated with the Sense, Collect and Move Data Committee. His research bridges engineering and neuroscience through reverse-engineering neural signal processing mechanisms, leading to advancements in brain-machine interfaces, neural prosthetics, and speech processing algorithms. He received his PhD in Electrical Engineering from the University of Maryland and completed postdoctoral training at Johns Hopkins University's Center for Language and Speech Processing and UC San Francisco's Neurosurgery Department. Research Focus Professor Mesgarani's lab integrates computational neuroscience and engineering to study acoustic signal processing. Key areas include: Neural decoding of speech and auditory attention in multi-talker environments Development of brain-controlled hearing technologies Novel speech separation and synthesis algorithms inspired by cortical processing Cross-modal learning between auditory and visual systems Applications of large language models in neural signal interpretation Publication Trends Analysis of his 15 most recent articles (2025) reveals dominant themes: neural decoding techniques using intracranial EEG, brain-inspired speech separation models (e.g., Mamba architectures), applications of large language models in auditory neuroscience, cross-modal distillation methods, and clinical translation of audio processing algorithms. A strong emphasis emerges on real-time brain-computer interfaces and noise-robust speech processing. Laboratory and Collaborations Mesgarani directs an interdisciplinary lab developing neurotechnology for hearing restoration. His team collaborates with neurosurgery departments and speech processing centers, focusing on translating theoretical models into clinical brain-machine interfaces. The lab's work has yielded patents for brain-informed speech separation systems and attention-decoding frameworks.

• Natural Language Processing
• Embodied Artificial Intelligence
• Machine Learning
• +4 more

Yonatan Bisk is an Assistant Professor at Carnegie Mellon University (CMU) in the School of Computer Science , with dual appointments in the Language Technologies Institute and Robotics Institute . His research bridges Natural Language Processing (NLP) with robotics, focusing on grounded and embodied language understanding. Assistant Professor, Language Technologies Institute, CMU (2021–Present) Courtesy Appointment, Robotics Institute, CMU Research Themes : Language as a social codification of embodied experience Interpretable multimodal model training Human-robot collaboration frameworks Embodied question-answering systems Selected Trends : His recent publications show increasing focus on cross-modal attention mechanisms (Vid2Robot), error detection in toolchains (Tools Fail), and theory-of-mind reasoning in language agents (SOTOPIA). Multimodal integration spans vision, audio, and robotic control contexts (ANAVI). Labs & Collaborations : Founder of CLAW Lab (Connecting Language to Action and the World) Collaborations with Microsoft Research, Meta Inc, and CMU's REAL (Robotics, Embodied AI, Learning) community

James GlassView profile

Research Fellow

• Machine Learning
• Natural Language Processing
• Speech Recognition
• +3 more

James Glass is a Senior Research Scientist at the Massachusetts Institute of Technology (MIT) and heads the Spoken Language Systems Group within MIT's Computer Science and Artificial Intelligence Laboratory (CSAIL). He is also affiliated with the Harvard-MIT Division of Health Sciences and Technology. His research spans automatic speech recognition, multimodal learning, and spoken language understanding, with applications in healthcare and video analysis. Education: SM and PhD in Electrical Engineering and Computer Science from MIT His work focuses on paralinguistic speech analysis, health markers in speech, and the intersection of speech and natural language processing. Recent trends emphasize audio-visual alignment, recursive reasoning, and AI applications in cognitive disorder diagnosis. Scientific awards include IEEE Fellow, ISCA Fellow, and Associate Editor for IEEE Transactions on Pattern Analysis and Machine Intelligence. His group explores unsupervised learning, speaker verification, and social text analysis. James leads the Spoken Language Systems Group at CSAIL, collaborating with institutions like IBM and Harvard-MIT Division of Health Sciences and Technology. His research integrates vision-language models, neural audio codecs, and self-supervised frameworks.

Mark LeeView profile

Adjunct Professor

• Human Factors Engineering
• Healthcare Safety
• Data Analytics in Manufacturing
• +3 more

Mark Lee is an Adjunct Professor in the People Analytics department at NYU’s Tandon School of Engineering, specializing in Technology Management and Innovation. He holds a Ph.D. in Engineering Psychology from Georgia Institute of Technology (1996). Currently, he serves as Head of Research, Analytics, and Business Development at UL ComplianceWire, focusing on pharmaceutical and medical device manufacturing training. His research leverages large datasets to improve healthcare safety through regulatory compliance and best practices. Courses taught include Human Factors Engineering, Workplace Design, and Predictive Analytics. Education: Ph.D. in Engineering Psychology, Georgia Tech (1996) Key Roles: Adjunct Professor, Head of Research at UL ComplianceWire Research Focus: Human Factors, Training Systems Design, Healthcare Compliance His work spans auditory display systems for aviation (e.g., 3D audio cockpit interfaces) and ergonomic design for industrial products. Recent projects emphasize data-driven solutions for regulatory challenges in life sciences. Publications highlight studies on visual search strategies, age-related cognitive performance, and application of signal detection theory in decision-making. He actively collaborates with industry and government entities, exemplified by the FDA-UL Cooperative Research Agreement.

• Affective Computing
• Artificial Intelligence
• Machine Learning
• +3 more

Dr A. I. Shihab is a Senior Lecturer at Kingston University's Faculty of Engineering, Computing and the Environment, Department of Networks and Digital Media. He teaches programming languages (C++/Java), data structures, web development, and AI/machine learning. His research focuses on affective computing and machine learning applications including: Acoustic event detection in sports environments Audio signal analysis for tennis match modeling Multi-camera visual surveillance systems Medical imaging analysis using fuzzy clustering techniques Publications demonstrate expertise in combining audio/video modalities for sports analytics (tennis rallies, court-shots) and developing Markov models for sound event sequence analysis. Contact: a.shihab@kingston.ac.uk

Andrea CavallaroView profile

Professor

• Machine Learning
• Artificial Intelligence
• Computer Vision
• +7 more

Andrea Cavallaro is a Full Professor at the École Polytechnique Fédérale de Lausanne (EPFL) and Director of the Idiap Research Institute. He holds dual appointments in the School of Engineering (STI) within the Institute of Electrical Engineering and Measurements (IEM) and the School of Engineering's Education Unit (SEL-ENS). His research focuses on machine learning for multimodal perception, privacy-preserving AI, and autonomous systems. Cavallaro earned his PhD in Electrical Engineering from EPFL in 2002 and has held leadership roles including Director of Research at Queen Mary University of London and Turing Fellow at The Alan Turing Institute. Education: PhD in Electrical Engineering (EPFL, 2002) Leadership: Idiap Director, Affiliate at ELLIS Society Editorial Roles: Editor-in-Chief of Signal Processing: Image Communication (2020–2023), Senior Area Editor for IEEE Transactions on Image Processing Research Interests: Machine learning for audio-visual sensing, privacy in AI, autonomous systems perception, and ethical AI frameworks. Key projects include AlignAI (trustworthy AI alignment) and CORSMAL (multimodal object manipulation). Recent articles explore privacy-aware AI models, adversarial attacks, and multimodal perception systems. His work bridges theoretical advancements with practical applications in robotics, healthcare, and education. Awards include the Royal Academy of Engineering Teaching Prize and IAPR Fellowship. Teaching: Leads courses on deep learning ethics and multimodal AI at EPFL. Advising: Supervises 11 PhD students in areas like privacy-preserving algorithms and autonomous systems. Labs/Teams: Coordinates Idiap’s Audiovisual Intelligence and Learning Lab (LIDIAP) and collaborates on projects like GraphNEx (explainable AI via graph neural networks).

Andrew MarkhamView profile

Professor

• Sensors and Sensor Networks
• Signal Processing
• Machine Learning
• +6 more

Andrew Markham is a Professor of Computer Science at the University of Oxford , affiliated with Kellogg College . He leads a research group focusing on Cyber Physical Systems (CPS) , specializing in sensors, signal processing, and machine learning to enable machines to better perceive the physical world. His work emphasizes cross-disciplinary collaboration, notably in wildlife tracking and indoor positioning systems. He has held roles as a Postdoctoral Fellow (2008-2012), Associate Professor (2013), and Full Professor (2021). Education : PhD in Electrical Engineering (University of Cape Town, 2008), BSc (Hons) in Electrical Engineering (2004). Research Interests : Tracking and localization in GPS-denied environments (e.g., underground, indoors), magneto-inductive systems, physics-informed machine learning, and data-driven approaches for noisy sensor data. His projects include wildlife monitoring via wireless sensor networks and mmWave radar for human motion capture. Key Projects : CARACAL acoustic monitoring system, mmPoint dense human tracking, and RandLA-Net for large-scale point cloud segmentation. His work spans robotics, environmental sensing, and biomedical applications. Advising & Grants : Supervises over 30 students and collaborates with industrial partners. Research teams include Cyber Physical Systems, Autonomous Ubiquitous Sensing, and Wildlife Monitoring initiatives. Labs/Teams : Leads the CPS research group, focusing on sensor networks, inertial navigation, and multimodal fusion systems. Collaborates with zoology and earth science disciplines on applied projects.

Shang-Tse ChenView profile

Associate Professor

• Machine Learning
• Data Mining
• Cybersecurity
• +5 more

Shang-Tse Chen is an Associate Professor at the Department of Computer Science and Information Engineering and Graduate Institute of Networking and Multimedia , National Taiwan University . He leads the NTU AI Security Lab , focusing on applied and theoretical machine learning with emphasis on cybersecurity, adversarial ML, and ML privacy/fairness. Education: PhD in Computer Science (Georgia Tech, 2019), BSc in CSIE (NTU, 2010) Awards: K. T. Li Young Researcher Award (2025), IBM PhD Fellowship (2018), KDD Best Student Paper Runner-Up (2016), NSF SaTC Grant (2017-2021) His research spans adversarial ML, certified defenses, model inversion attacks, and intersection with differential privacy/fairness. Recent work includes physical adversarial attacks on object detectors and practical defenses using JPEG compression. He teaches courses like Security and Privacy of Machine Learning and Introduction to Medical Informatics . Key publication trends show focus on adversarial robustness (ICML/NeurIPS/ICLR), cybersecurity applications (ACSAC), and ML fairness (ACL/EMNLP). Collaborations include industry partnerships with Intel Labs and Symantec. Scientific Awards: K. T. Li Young Researcher Award (2025) ACM TiiS Best Paper Honorable Mention (2020) IBM PhD Fellowship (2018) KDD Audience Appreciation Award Runner-Up (2018) Symantec Fellowship Runner-Up (2016) KDD Best Student Paper Runner-Up (2016) NSF Grant (2017) He advises 13 current students (PhD/MS/Undergrad) and has mentored alumni now at CMU/UC Berkeley. The lab actively recruits postdocs and students across levels.