Improve robustness when handling a perspective key response by deduplicating received server keys.