Never ever used. Maybe perhaps to address the Queen or a female officer who is higher ranked than yourself if you're in the army/police. Madam is more common in Britain.