The server caches challenges. If one challenge failed to validate, this challenges is still keep and not retried. This means the server must be restarted after a failed challenges. It is this good to not retry the failed challenges again and again. But we need a timeout or a API to make it clear, that the challenge can be retried.