Don't add the first pkcs12 certificate multiple times