The timing of the bullet leaving the barrel is what effects groups, so velocity is primarily a factor in how it relates to that timing. Assuming, that is, that the velocity is appropriate for the bullet and twist so that nothing "funky" is happening in that regard.
See Dan Newberry's discussion of "Optimal Barrel Time":
http://optimalchargeweight.embarqspace.com/
You shall now be obsessed.
