Chao Peng

Chao Peng is a Principal Research Scientist at ByteDance where he leads the Software Engineering Lab, focusing on AI agents for software engineering. He holds a part-time position as a Postgraduate Student Mentor at Fudan University's School of Computer Science. His research bridges industry and academia, with significant contributions to software testing, program repair, and LLM applications in software development.

Education:

• PhD in Informatics, 2021, University of Edinburgh, UK
• MSc in High Performance Computing and Data Science, 2017, University of Edinburgh, UK
• BEng in Computer Science and Technology, 2016, Xuzhou University of Technology, China

Dr. Peng's research interests center on the intersection of artificial intelligence and software engineering. He explores how large language models can transform traditional software development practices, particularly in code generation, testing, and bug fixing. His work on LLM4Code has led to innovative frameworks like CodeVisionary for evaluating code generation capabilities and Trae Agent for software engineering tasks with test-time scaling. He investigates the synergy between machine learning techniques and compiler optimizations to enhance software reliability and developer productivity.

His recent publications reveal a strong focus on practical evaluation frameworks for LLMs in real-world software engineering contexts. Rather than theoretical benchmarks, his work emphasizes real-world applicability, as seen in RepoMasterEval which evaluates code completion in actual repository settings. He examines multi-faceted challenges including code generation, bug reproduction, issue resolution, and repository-level question answering, consistently addressing the gap between laboratory evaluations and practical development environments.

Scientific Awards:

• Distinguished Reviewer for FSE'25
• Invited to program committees for FSE'26, SANER 2026, ASE 2025, and others
• School of Informatics Scholarship (fully-funded PhD)
• Multiple national scholarships during undergraduate studies
• Honours Spot Bonus at ByteDance

Dr. Peng actively mentors postgraduate students at Fudan University while leading research initiatives at ByteDance that foster university collaborations. His laboratory work translates academic research into practical tools for software development, with several frameworks deployed in industrial settings. He serves on multiple conference program committees, contributing to the advancement of software engineering research through rigorous peer review and community building.

His Software Engineering Lab at ByteDance operates at the forefront of AI-assisted development, exploring how agent-based systems can automate complex software engineering tasks. The team's work on frameworks like AEGIS for bug reproduction and DialogAgent for code question answering demonstrates their commitment to solving practical challenges faced by developers in real-world settings.