The policy caches local hosts that are used for the query plan after the replicas, but includes a host#isUp() in the check, so if a host is down at the moment that it's being cache it will not be included in the future and this cache will not be cleared until the host map changes.
Fixed as part of NODEJS-574.