I still say the group needs another big goal like the CDC or whatever. Sitting in the prison and going out on mini-runs for action scenes ain't gonna keep my interest up. Though I actually liked the more intense conversations at Hershel's farm about what kind of standards and basic rules apply in such a world, they still need something big to work towards that's not just gonna come to them.
I didn't consider the fact that Harry Potter kid mentioned the deer Daryl brought back, that's interesting. I think it would make sense for the show to let a mutated virus, or whatever it is, kill off most of the Woodburians.