Well you don't need to do it if the eggs around dont turn white as well, only if it starts to spread. If you do decide to start removing them it really isn't easy and sometimes it isn't worth it if you don't have a convenient tool. The fungus usually can't spread fast enough to cover all the eggs before they hatch.