Dota - Tianai Dong

Hi! I am a fourth-year (and final-year) PhD student, affiliated with Multimodal Language Department at the Max Planck Institute for Psycholinguistics, and Predictive Brain Lab at the Donders Institute (Centre for Cognitive Neuroimaging). I am funded by an IMPRS fellowship in Language Science.

My work focuses on understanding language and its interaction with the physical and social world. I take an interdisciplinary approach, combining computational methods —such as machine learning and bayesian modeling— with insights from neuroscience, linguistics, and psychology to better understand the human mind and advance artificial intelligence.

Fun Fact: Dota is actually my real, preferred name. It comes from my Mandarin initials, no connection to the game;). My family started calling me that, my friends picked it up, and it’s stuck ever since (in the best way).

If you’d like to discuss academic topics, feel free to get in touch :).

Email // Google Scholar // BlueSky

profile photo
Recent News
2026 Aug

🎤 I will give a lightning talk "Modeling Language from Interaction" at the CCN 2026 Satellite Event Beyond Curated Datasets: Learning Representations from Children's Everyday Experiences. I'll also present a poster at CCN, Do Social Micro-processes Emerge in Multimodal Language Models? A Case Study of Egocentric Referential Communication Do Multimodal Language Models Track Minds and Space? A Cross-lingual Study of Egocentric Referential Communication.

2026 Jul

🎉 Using Perspectival Words Is Harder Than Vocabulary Words for Humans —and Even More So for Multimodal Language Models has been accepted as a main paper at ACL 2026 — looking forward to presenting in San Diego! I'll also be visiting and giving talks at the Developing Intelligence Lab and KOALAB at UT Austin, July 13–17. Feel free to reach out if you'd like to chat :)

2026 May

🧠💭🤖 The very popular Workshop on Representational Alignment is back at ICLR 2026 in Rio!

Recent Publications
A Decade of Comparing Brains to DNNs: Progress and Perspectives
Lea-Maria Schmitt*, Dota Tianai Dong*, Emin Celik*, Floris P. de Lange, Mariya Toneva
Trends in Cognitive Sciences.
paper

Over the past decade, comparisons between deep neural networks (DNNs) and the human brain have become central to cognitive neuroscience. Early work focused on vision, driven by the success of convolutional neural networks in object recognition, before such comparisons later gained traction in language with the rise of large-scale language models. These comparisons have validated existing hypotheses and generated new ones, challenging views of information processing, connectivity, and computational goals. Despite progress, debates persist over the interpretability and validity of mapping DNNs to brains, underscoring the need for more refined models and methods. Looking ahead, integrating cross-modal insights from vision and language, together with improved modeling and experimental frameworks, promises to advance the mechanistic understanding of cognition.

Using Perspectival Words Is Harder Than Vocabulary Words for Humans —and Even More So for Multimodal Language Models
Dota Tianai Dong*, Yifan Luo*, Po-Ya Angela Wang, Asli Ozyurek, Paula Rubio-Fernandez
In Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (ACL). Association for Computational Linguistics.
ACL oral presentation (<5% of submissions).
paper

Multimodal language models (MLMs) increasingly demonstrate human-like communication, yet their use of everyday perspectival words remains poorly understood. To address this gap, we compare humans and MLMs in their use of three word types, which we predict impose increasing cognitive demands: vocabulary (e.g., 'boat' or 'cup'), possessives (e.g., 'mine' vs. 'yours'), and demonstratives (e.g., 'this one' vs. 'that one'). Testing seven MLMs against human participants, we find that perspectival words are harder than vocabulary words for both groups. The gap is even larger for MLMs: while models approach human-level performance on using vocabulary, they exhibit clear deficits with possessives and even greater difficulties with demonstratives. Ablation analyses point to limitations in perspective-taking and spatial reasoning as key sources of these gaps in MLMs. Instruction-based prompting helps close the gap for possessives but still leaves demonstratives far below human performance. These results show that, unlike vocabulary, perspectival words pose a greater challenge in human communication—and this difficulty is further amplified in MLMs, revealing a crucial shortfall in their pragmatic and social-cognitive abilities.

For a complete list, see my Research page →
Recent Talks
  • 2026 Jul: UT Austin, NLP&Linguistics Department
    Putting the World Back into Words: Language, Language Models, and the Interactive Worlds They (Should) Inhabit
  • 2026 Jul: UT Austin, Developing Intelligence Lab
    Language and Language Modeling from Interaction
Recent Service

For all activities, see my Community page →


© Copyright 2026 Dota Dong. Last updated July, 2026.
Template from here