It sounds like the system may need you to sign in to the account before you are able to remove it.
When you click on the pencil if you see the attached screenshot options you can click on "edit account info" and at the bottom of the account setup you have the option to "disconnect bank upon saving"
Keeping in mind though that this just disconnects the bank from the feed, it does not remove the account from your chart of accounts.