Yea, but the fans would complain that the storylne repeats itself too much.
Personally, I don't mind the governor. It gives a break from the same old zombie zombie zombie day in and day out. It's also good to have a villain to focus on. I mean who remembers what the last zombie looked like that Rick killed?
I agree. Repetition would kill the show imo. I think it's very realistic that there are human threats. Just need better writing