Research questionHow can federated learning personalize regional query understanding while preserving privacy and avoiding transformer training failures?Retail regions differ in vocabulary, query behavior, and product preferences, but centralizing their data can violate privacy. Federated personalization must therefore adapt to regional differences without destabilizing modern transformer models.