The farm people weren't good. They were disturbed, believing that zombies were still people and "taking care" of them by keeping them in the barn. It required Rick to face off with Hershel, and that wasn't enough. Hershel had to be confronted with reality several times, and some people had to die, before he "got it." Conflict.

Alexandria was supposed to appear like an oasis, but it had its own issues (domestic abuse, nepotism, etc.). AND its people were ignorant of the challenges outside and were basically meals for wolves. Rick had to educate them, too - more conflict.

Morgan? Same. Dude who lived in a cabin and was one with nature? Same. Tyrese? Well, his refusal to kill a human Wolf cost lives later.

Even the "good" people were sources of conflict, whose decisions placed people at risk.