Xmas quite literally means Christmas. The 'X' is a representative of the Greek symbol chi which means Christ. There for Xmas stands for Christmas and is just a short hand version of writing Christmas, and in no way removes the religious connotation of the holiday.
Person 1: Merry Christmas!
Person 2: Merry Xmas to you too!