CV
Education
- PhD in Computer Science, Brandeis University, 2026
- MA in Computational Linguistics, Brandeis University, 2012
- BA in Linguistics & Italian Studies, Boston College, 2006
Work Experience
All full-time roles concurrent with PhD studies (2020-2026)
- Oct. 2024 - Present: Director, Research, VERINT
- Lead ML research team and multilingual annotation operations
- Research areas: real-time ASR, multimodal conversational analysis, unsupervised topic discovery, cross-lingual emotion modeling
- Feb. 2017 - Oct. 2024: Director, Machine Learning & Annotation, COGITO (acquired by VERINT Oct. 2024)
- Machine Learning models for behavioral and conversational analysis
- Sep. 2014 - Feb. 2017: Senior PM, Alexa Data Services, AMAZON
- Language data production & strategy for Alexa voice assistant (Beta through launch)
- 2007 - 2014: Earlier roles in Localization, NLP, and Machine Translation
Service & Awards
- Brandeis Michtom School of Computer Science 2022 Outstanding Research Award
- Co-organizer of Second Workshop on Multimodal Semantic Representations (MMSR II) at IWCS 2025
- Program Committee, International Workshop on Designing Meaning Representations (DMR), 2025, 2026
- Mentor, ACL Student Research Workshop (SRW), 2025
- Reviewer: ACL Student Research Workshop, Cognitive Science Society, PEER, MMSYM
- Admissions Reviewer for Brandeis Computational Linguistics MS Program, 2022 - 2024
Talks
September 17, 2026
Talk at Tastes of Language: Past and Present Italian Culinary Discourse in Anglophone Contexts. Sapienza Università di Roma., Rome, Italy
Teaching
Publications
Simone Elias, Noran Moffett, Jeremy Womack, and Richard Brutti (2026). Human-Centered AI Governance in K–12 Education: A Qualitative Content Analysis of Policy Gaps in Massachusetts School Districts. Journal of Research Initiatives, 9(3):12.
Simone Elias, Linda Wilson-Jones, and Richard Brutti (2026). Digital Learning and Digital Literacy: Conceptual Distinctions, Theoretical Frameworks, and Educational Implications Across the Educational Continuum. Journal of Research Initiatives, 9(3):14.
Richard Brutti, and James Pustejovsky (2026). The Grunt Work of Conversational Grounding: Minimal Responses in Multimodal Dialogue. In Proceedings of the Annual Meeting of the Cognitive Science Society (Vol. 48).
Richard Brutti, and James Pustejovsky (2026). More Than "Oh": Grounding Observable Events with Grunts in Multimodal Dialogue. In Proceedings of the Fifteenth Language Resources and Evaluation Conference (LREC).
Simone Elias, Richard Brutti, and Linda Wilson-Jones (2026). Exploring the Potential of Generative Artificial Intelligence in Enhancing Computational Thinking in Digital Literacy and Computer Science Education. Journal of Research Initiatives, 9(2):11.
Kenneth Lai, Lucia Donatelli, Richard Brutti, and James Pustejovsky (2025). A Model of Information State in Situated Multimodal Dialogue. In Proceedings of the 16th International Conference on Computational Semantics, pages 282-288.
Yifan Zhu, Hannah VanderHoeven, Kenneth Lai, Mariah Bradford, Christopher Tam, Ibrahim Khebour, Richard Brutti, Nikhil Krishnaswamy, and James Pustejovsky (2024). Modeling theory of mind in multimodal HCI. In International Conference on Human-Computer Interaction, pages 205-225.
Kenneth Lai, Richard Brutti, Lucia Donatelli, and James Pustejovsky (2024). Encoding Gesture in Multimodal Dialogue: Creating a Corpus of Multimodal AMR. In Proceedings of the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING 2024), pages 5806-5818.
Ibrahim Khalil Khebour, Kenneth Lai, Mariah Bradford, Yifan Zhu, Richard Brutti, Christopher Tam, Jingxuan Tu, Benjamin A. Ibarra, Nathaniel Blanchard, Nikhil Krishnaswamy, and others (2024). Common ground tracking in multimodal dialogue. In Proceedings of the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING 2024), pages 3587-3602.
Ibrahim Khebour, Richard Brutti, Indrani Dey, Rachel Dickler, Kelsey Sikes, Kenneth Lai, Mariah Bradford, Brittany Cates, Paige Hansen, Changsoo Jung, and others (2024). When text and speech are not enough: A multimodal dataset of collaboration in a situated task. In Journal of Open Humanities Data, 10.
Christopher Tam, Richard Brutti, Kenneth Lai, and James Pustejovsky (2023). Evaluating Multimodal Behavior Schemas with VoxWorld. In International Conference on Human-Computer Interaction, pages 578-591.
Christopher Tam, Richard Brutti, Kenneth Lai, and James Pustejovsky (2023). Annotating situated actions in dialogue. In Proceedings of the Fourth International Workshop on Designing Meaning Representations, pages 45-51.
Jingxuan Tu, Eben Holderness, Marco Maru, Simone Conia, Kyeongmin Rim, Kelley Lynch, Richard Brutti, Roberto Navigli, and James Pustejovsky (2022). SemEval-2022 task 9: R2VQ--competence-based multimodal question answering. In Proceedings of the 16th International Workshop on Semantic Evaluation (SemEval-2022), pages 1244-1255.
Lucia Donatelli, Kenneth Lai, Richard Brutti, and James Pustejovsky (2022). Towards situated AMR: Creating a corpus of gesture AMR. In International Conference on Human-Computer Interaction, pages 293-312.
Richard Brutti, Lucia Donatelli, Kenneth Lai, and James Pustejovsky (2022). Abstract meaning representation for gesture. In Proceedings of the Thirteenth Language Resources and Evaluation Conference (LREC).
Mariah Bradford, Paige Hansen, Kenneth Lai, Richard Brutti, Rachel Dickler, Leanne Hirshfield, James Pustejovsky, Nathaniel Blanchard, and Nikhil Krishnaswamy (2022). Challenges and opportunities in annotating a multimodal collaborative problem-solving task. In Interdisciplinary Approaches to Getting AI Experts and Education Stakeholders Talking Workshop, AIEd.
Kenneth Lai, Richard Brutti, Lucia Donatelli, and James Pustejovsky (2021). Situated UMR for multimodal interactions. In Proceedings of the 25th Workshop on the Semantics and Pragmatics of Dialogue (SemDial 2021).
James Pustejovsky, Eben Holderness, Jingxuan Tu, Parker Glenn, Kyeongmin Rim, Kelley Lynch, and Richard Brutti (2021). Designing multimodal datasets for NLP challenges. In arXiv preprint arXiv:2105.05999.
Cristina Gorrostieta, Reza Lotfian, Kye Taylor, Richard Brutti, and John Kane (2019). Gender De-Biasing in Speech Emotion Recognition. In Proceedings of Interspeech 2019, pages 2823-2827.
Cristina Gorrostieta, Richard Brutti, Kye Taylor, Avi Shapiro, Joseph Moran, Ali Azarbayejani, and John Kane (2018). Attention-based Sequence Classification for Affect Detection. In Proceedings of Interspeech 2018, pages 506-510.