Throughout history, men have worn hats as a way of asserting dominance over other men. 'I buy hats,' a behatted man seems to say. 'I am better than you.'
It's a bit unfair that women get to smell like actual things, and we men are stuck smelling like abstract concepts.