Those things are inert epoxy. They'll be fine.
There are three main groups of rocks you want to beware:
Soluble basic/alkaline rocks- limestone, marble, aragonite, certain sandstones, gypsum. These stones can raise your hardness and pH. They are fine with most fish, beneficial to some fish (such as Rift Lake cichlids), and harmful to a few fish (some sensitive blackwater species). The 'acid test' will usually identify these- a few drops of vinegar or other acid will fizz on the stone.
Sharp or gritty rocks- certain sandstones, lava rocks, etc. These can be harmful to soft-skinned bottom-dwellers such as catfish or lungfish, and grazers such as cories and loaches. Easily identified by feel.
Toxic rocks- rocks containing copper, lead, arsenic, or other toxic metals, sulfur compounds, or which have been exposed to toxic pollutants fall into this group. Being sure you don't have one of these requires some more intensive knowledge, but rest assured, you probably won't find these at the pet store or landscaping yard.