You should be able to delete an entry by navigating to the correct bank account ledger and then to the relevant transaction and clicking on the blue delete icon to the right of that row.  You can only do this if unreconciled however.  If reconciled, you will need to contact your admin support within the Diocese.

When you delete an entry it will automatically delete the other side to ensure the accounts balance.

Chris