Research questionHow should phonetic encoders be evaluated for preserving pairwise similarities among IPA transcriptions?An encoder can produce useful collisions without preserving how similar the underlying transcriptions are to one another. Evaluation therefore needs to capture whether encoded-string similarities reflect pairwise similarities in the IPA ground truth.