There shouldnt be any guards barring entrance in the city. Are you sure you're entering the city and not the castle?

edit: Oh, and it would be really helpful if you could tell us what part of the game you're at, plot-wise. What was the last plot-thing that happened? Who is on your team?