Research questionHow can we compare medical VQA models when generation obscures answer signal and biases answer positions?A model may encode information useful for selecting the correct medical answer even when its generated response is unreliable. Generation can also favor particular answer positions, causing comparisons to reflect output behavior rather than medical visual understanding.