You can switch, no problem. It's essentially New Game + - you get to keep your compendium.