You should be able to right click on custom map markers to delete them.