Get Started
Research questionHow do language models represent and combine singular entities when predicting plural pronouns?Plural-pronoun prediction requires a language model to determine when multiple previously mentioned singular entities should be treated as one plural antecedent. The relevant representations and information flow inside the model are not directly observable from its output alone.
AI
Mechanistic Interpretability
Natural Language Processing
Latest papersRecent research connected to this question, newest first.A Circuit for Plural Reference: How LLMs Represent and Retrieve Singular and Plural EntitiesThe evidence concerns language models predicting pronouns that refer to previously mentioned entities. It uses mechanistic interpretability, attention-pattern analysis, and causal interventions to examine entity representation, plural-entity identification, and information transfer to antecedent selection; the study also considers ontological similarity and coordination with “and.”research paper · Sep 3, 2026
Related questions
How does structural priming affect language-model sentence generation, and how do semantic coherence and lexical repetition interact with it?Do language models generalize phonological rules or rely on memorized forms when selecting allomorphs?How can language models recognize unknown entities and refuse to invent relational facts?Can language models infer others’ mental states as social interactions evolve under unreliable information?
Home
Topics
Search
Library