cause they've all the good ones have been asked already

Why are there only like 4 buildings in besaid when like 50 people live there?