fix inconsistent flen check in rsa_pk1 and rsa_oaep