Why not dump the betta and go for inverts? Snails, shrimp, crays, ostracops, pods, there are plenty of options. Some of the small killies might work, too.
Growing pothos, spiderplants, coleus, wandering jew, or other houseplants out of the top is the easiest and most effective IME.
The bottle to the left has no filter.
All of the plants either mentioned by me, or in the picture worked well except for the curly pondweed. (I only tried devil's horn plant and coleus with a filter for water circulation, though.) (The 10g is no longer running, but the bottle still has live moss and snails.)