No, you'd want to put it in the path of water flow. Most carbon comes in little bags, but if you buy it in bulk, then you either buy the filter bags separately (they're usually white, with drawstrings or clips, and made of really fine mesh) or I use pantyhose (the knee-highs work quite well). Just add carbon into the foot, tie a knot, and cut off the excess, if you like. Carbon is cheaper to buy in bulk, and knee-highs are cheap, also. Keep in mind that carbon lasts about a month; after that, it's not going to absorb any more, and should be removed.
Edit: If you don't have room in the sump, you can buy an Aqua-Clear hang-on-back filter and use it for emergencies. I have a few AC's hanging around which I got in craigslist buys, and didn't get rid of. That way, you don't have to mess with the sump at all, but you're still moving the water through the carbon. In this case, you wouldn't use any media in the AC filter, but just use the above method to add carbon to it, and remove carbon and filter when you're done removing what you need to remove.