Make it possible to give vectors only for decryption or encryption.