Check your widgets-- you may be able to drag the categories link to disable it. I don't have a fresh WP install to check against, though