Even if it's just a small part of Bavaria, the towns would still fit into that small part of Bavaria.

The argument you're making for it not fitting with Bavaria could be made with practically any of the suggestions in this thread.