Corys do much better in large groups, which would be tough in that size tank. Maybe a group of 6 dwarf corys, or pygmy corys (but they swim in the midlevel) which top out about an inch. I'd switch the bristlenose out for a clown pleco if you really want a pleco. If you just want an algae eater and aren't hooked on plecos, I'd go with snails and shrimp at this size tank. Even a clown pleco is going to feel a little cramped in there and the shrimp/snail bioload is a fraction of any pleco. Also, there are very small catfish that do better alone or in small groups than corys do. The asian stone catfish is one I like and you could do 2 of them no problem. A pygmy talking catfish is another option (a tiny raphael cat). Also, if you're not married to the rummynose, there are smaller tetras and other nano fish that would fit better in those dimensions. Rummynose get over 2 inches and like to swim. They would probably work, but there are a ton of small fish. Endlers, Celestial Pearl Danios, Scarlet Badis, etc. are all pretty hardy.
As always, I'd recommend an undergravel filter over a sponge. A single 12"x12" UGF plate with one small lift tube would do fine in there and not take up a bunch of space like the sponge. Runs on the same air pump.
I always recommend crypts, anubias, dwarf sag, and java ferns as the easiest plants to start with in small tanks (switch the sag to vals in larger ones). None require strong light. Elodea is the easiest stem plant in my experience. Most floating plants are pretty easy, but will need to be stayed on top of as they spread like wildfire and you don't want them to totally blanket the surface.
Substrate I'm weird. I use a combination of fine gravel and baked clay oil absorbent from the auto parts store. 1 layer of gravel over the UGF, layer of oil absorbent, decent cap of more gravel. I dislike sand for a few reasons (but mostly because the mulm all sits on top of it), though I do use it in a couple tanks. I dislike 'aquasoil' because it has to be replaced every couple years. The clay oil absorbent I use is permanent and sucks in nutrients (including ammonia) and holds them for the plants' roots. I did use Seachem Flourite in a couple tanks and it seems to work very well. However, this is mostly a preference thing. Some plants may need a couple root tabs if you go with just sand or just gravel, but those are the cheapest options (the clay oil absorbent is also very cheap, but you buy it in large bags, around $13-$15 for a 33 lbs bag. It can double as cheap kitty litter which is what I do with the extra).