I'm not sure that camo makes a huge difference with deer. My dad has shot his last half a dozen or so deer wearing blue jeans and a navy blue winter coat, and a lot of folks on here and THR seem to think that scent control is more important than camo.
That being said, i agree with you in principle. Even if deer can't see colors per se, I'd think that if they happen to see you it'd be beneficial to have a pattern that breaks up your outline instead of large patches of solid colors. This year, I'll be hunting in an M65 jacket and pants in woodland camo along with a blaze hat and a Cabela's Blaze fleece 3/4 vest
. The vest is supposed to last a lot longer than a plastic one and I got camo patterns because I figure it can't hurt.