Leather is quieter when sneaking through the brush.
Ever brushed a bush with a nylon jacket on? Same affect with the holster, and both holster and jacket doing this can get the attention of game animals pretty quickly.
Other than that, it's pretty much a matter of choice. For me, I've always preferred leather for that reason above all others.