You can only delete contacts that are not linked to any claims and you can do so only from their main contact record.
​
To delete the contact, you just need to open it from the main Contacts list, click on the trash icon, in the header on the right, and select "Ok".
​
The contact will be then permanently deleted. This can not be undone, so proceed with caution.