Here is the answer that worked for me, after Hamish helped me to realize my typo:
To add a new password, use luksAddKey:
sudo cryptsetup luksAddKey /dev/sda5
To remove an existing password, use luksRemoveKey:
sudo cryptsetup luksRemoveKey /dev/sda5