Samy Bengio

Samy Bengio is Senior Director of AI and Machine Learning Research at Apple and an adjunct professor at École Polytechnique Fédérale de Lausanne (EPFL). His research focuses on advancing the reasoning capabilities of autoregressive models, developing deep architectures for structured data, and improving generalization in deep learning through adversarial training and curriculum design.

• Current Affiliations
  • Apple (Senior Director, Machine Learning Research)
  • EPFL (Adjunct Professor)

Research Interests: Bengio explores the limits of reasoning in auto-regressive models, with a focus on mathematical reasoning and length generalization. He has contributed to deep architectures for sequences (e.g., speech and text), addressing long-tail issues in machine learning. His work extends to designing machine learning libraries like Torch, TensorFlow, and MLX, and understanding the theoretical foundations of transformer models.

Article Trends: His recent publications emphasize reasoning in large language models (LLMs), symbolic regression with transformers, and addressing challenges in length generalization. Key themes include algorithmic reasoning, global visual reasoning, and the exploration of alternative text factorizations for improved performance.

Scientific Awards:

• Outstanding Paper Award at ICML 2023

Advising and Collaborations: Bengio has mentored numerous students and researchers, including Mark Barnard, Fabien Cardinaux, Silvia Chiappa, and Ronan Collobert. He has organized workshops like the Simons Institute’s Foundation of Deep Learning program and co-chaired ethics reviews at NeurIPS.

Labs and Teams: He has collaborated with labs and teams at Apple, EPFL, and the Simons Institute for the Theory of Computing.