It is not possible to remove a contact from all linked students, the contact will need to be deleted individually from each student profile. Click on the cog next to the contact's name, and you will find a Delete button at the base of the contact's details.