Get Started
Home
Topics
Search
Library
Research questionDo language models generalize phonological rules or rely on memorized forms when selecting allomorphs?Tokenization obscures sound structure, yet models often select morpheme forms according to phonological context. It is difficult to determine whether this behavior reflects memorized forms or a rule-like representation that causally influences selection.
AI
Mechanistic Interpretability
Natural Language Processing
Research Paper
Latest papersRecent research connected to this question, newest first.How Do Language Models Represent and Use Phonological Information for Allomorph Selection?The source analyzes English indefinite-article selection using trigger-token representations, causal interventions, and token-level wug tests, and compares generation-time behavior with explicit phonological judgment. The analysis requires access to model representations and does not establish that the findings generalize across languages or model settings.research paper · Sep 4, 2026
Related questions
How can we tell whether a language diffusion model is memorizing or generalizing?How do attention and recurrent state divide factual retrieval from output style in hybrid language models?How can grounded language-model systems preserve object identity from selection through evidence delivery?When do natural-language rules outperform examples for LLM in-context learning?