Control Panel > Regional and Language options. On the Languages tab, click Details, and add "English (United Kingdom)" to the bottom list, set it as default, and apply. You can remove the US one after applying the UK as default. If you try before applying, it might complain. If it complains, just remove it again, it usually works the second time anyway