Well, sex is in and of itself a hot and sweaty activity. So if a man looks like he is willing to get down and dirty in the bedroom, that helps potential partners visualize what he would be like before, during and after sex.
The phermones released from working all day might have something to do with it too.
Besides, you appear to be a "manly man", like our Governator. [:D]