Use EVP_PKEY for server EC.