The fact that it's not in the right time period doesn't bother me. The show deals in magical realism, what does it care about timelines?
What I don't like is that Jessica Lange isn't particularly good at singing and the scene felt so out of place and disruptive to the rest of the plot.