Jacob Whitehill is an Associate Professor in the Department of Computer Science at Worcester Polytechnic Institute (WPI), affiliated with the Learning Science & Technologies (LST) program. His research focuses on applying machine learning to education and human-computer interaction, including speech recognition, emotion analysis, and automated classroom observation. He leads the NSF-funded project Developing New Scientific Instruments for Classroom Observation and collaborates on the AI Institute for Student-AI Teaming (iSAT) . His research interests span Applied Machine Learning (e.g., multi-modal systems, speaker diarization), AI for Education (e.g., automated instructional evaluation, child speech recognition), and Emotion Recognition (e.g., affective computing in classrooms). Recent work emphasizes classroom observation tools and improving student-teacher interaction analysis through video and audio data. Notable projects include: NSF-funded classroom observation tools AI Institute for Student-AI Teaming (iSAT) Schmidt Futures-funded Hybrid Human-Agent Tutoring for math education His team includes PhD students Xinlu He (Data Science), Jiani Wang (Computer Science), and Yiwen Guan (Computer Science), along with visiting scholar Cecilia Tivir. He advises students on topics like speaker recognition, educational data mining, and computer vision in classroom settings. Grants and collaborations include NSF, Schmidt Futures, and industry partnerships. His lab develops tools for automated feedback on teaching practices, leveraging LLMs and multimodal data. For more details, contact jrwhitehill@wpi.edu .


.jpg)





