He removed it to appear more human to Rey, I'm also fairly sure he removes it when he is conflicted. When his mask is off he always looks on the verge of crying - aka weak, with the mask on he can massacre a whole village....