There is only one rule to fashion I observe when it comes to leather goods.
Black shoes, black belt, black leather holster. If you have brown shoes then it's a brown belt and brown holster.
The rest in my opinion is up for grabs.
If I want to be stylish for a more upscale occasion (such as a nice dinner in a finer establishment), I'll holster my 460V with .45 Colt rounds because a revolver is in my mind classy unless you just have a classy tastefully decked out pistol of another type then by all means, holster it and enjoy the evening.
If it's casual I may holster my XD-40 or my 1911.
As for me I commonly like wearing things with black in them because it contrasts nicely with other colors and I'm the son of two artists so I'm just like that.