The button next to a certificate in the list allows you to delete the certificate or the private key that belongs to it. Unlike a revoked certificate, a deleted certificate is also removed from the certificate tree. No password is required to do this.
Use the buttons in the lower right-hand corner of the editing window to delete the certificate or the private key only, or to cancel the dialog (Cancel).