Of course. How stupid is it to remove protective equipment when you come into warm's way in the batter's box? Even if the catcher's mask would be a problem when batting, the shin guards and chest protector would obviously protect the batter.
I have long advocated that all fielders not in the outfield should wear the functional equivalent of the catcher's gear. Given that, I think the catcher should use the equipment that he's already wearing. It's dumb to remove it. Then put it back on. Then remove it. Then put it back on... for four plate appearances. Come on. Get smart.