Well, I am not a girl and I have hunted after getting dressed up fresh for a night out and having it cancelled and just grabbed a rifle to go hunt and had a similar experience.
HOWEVER, deer are aware of color contrast. The issue about dayglow orange is that they don't see into the red portion of the spectrum well. Apparently, reds and oranges appear whitish or greyish (or that is believed), like seeing such colors on B&W TV. Deer and many other artiodactyls have dichromatic vision whereas humans are trichromatic.
Here is a nifty video on deer vision...