Louis-Philippe Morency is a computer scientist known for his contributions to multimodal machine learning, human‑computer interaction, and conversational artificial intelligence. He is a professor in the School of Computer Science at Carnegie Mellon University (CMU) and leads the Multimodal Interaction Lab.
Early life and education
Morency earned his Bachelor of Science degree in Computer Science from the Université de Sherbrooke in Quebec, Canada. He continued at the same institution to obtain a Master of Science in Computer Science. He completed his doctoral studies at the Massachusetts Institute of Technology (MIT), receiving a Ph.D. in Computer Science in 2006. His dissertation focused on the integration of visual and auditory cues for the automatic analysis of human behavior.
Academic and research career
After completing his Ph.D., Morency joined the faculty of Carnegie Mellon University, where he has held appointments in the Language Technologies Institute and the Human‑Computer Interaction Institute. He founded and directs the Multimodal Interaction Lab, a research group that investigates how computers can understand and generate communication that combines speech, facial expressions, gestures, and other non‑verbal signals.
His research portfolio includes:
- Development of algorithms for multimodal perception, enabling systems to jointly process audio, visual, and textual streams.
- Studies on affective computing, focusing on the automatic detection of emotions from facial expressions, vocal intonation, and body language.
- Work on conversational agents that can engage in natural, context‑aware dialogue, incorporating non‑verbal cues to improve interaction quality.
- Contributions to the creation of large‑scale multimodal datasets for training and evaluating machine‑learning models.
Morency has published extensively in peer‑reviewed conferences and journals, including Proceedings of the IEEE International Conference on Computer Vision (ICCV), Computer Speech & Language, and the Journal of Machine Learning Research. He is a frequent reviewer for major conferences such as the Conference on Computer Vision and Pattern Recognition (CVPR) and the Association for Computational Linguistics (ACL) conferences.
Awards and honors
- National Science Foundation (NSF) CAREER Award, 2009 – for pioneering research on multimodal perception and interaction.
- IBM Faculty Award, 2012 – recognizing contributions to speech and language technologies.
Professional service
Morency serves on program committees for conferences in computer vision, speech processing, and human‑computer interaction. He has also acted as a mentor for initiatives promoting interdisciplinary research between computer science and psychology.
Selected publications
- L.-P. Morency, S. Gupta, and L. Davis, “Learning to Detect Facial Actions from Temporal Patterns,” International Conference on Computer Vision (ICCV), 2005.
- L.-P. Morency and Y. Shi, “Multimodal Human‑Computer Interaction: A Survey,” IEEE Transactions on Affective Computing, 2019.
- L.-P. Morency et al., “Towards Empathetic Conversational Agents,” Proceedings of the AAAI Conference on Artificial Intelligence, 2021.
Personal life
Details about Morency’s personal life are not widely disclosed in publicly available sources.
References
- Carnegie Mellon University, Faculty Profile: Louis‑Philippe Morency.
- National Science Foundation, Award Abstracts.
- Morency, L.-P., et al., publications listed in the DBLP Computer Science Bibliography.