Add some sanity checks when checking CRL scores