I think guys really wouldn’t mind a transwoman nearly as much as a trans man would bother people in the ladies.

Although the trans woman might have a bad experience in the mens (imagine the scale of a “bad experience” yourself), I don’t think that men would be bothered. Hell, pretty often in nightclubs you get cis women using the men’s, because the line is so much longer and slower in the ladies.