So on closer inspection on the bore alignment, the slide is laughably angled left at the front, causing the barrel bushing to sit with a gap on it.
I'm not sure if this is a manufacturing defect or if the previous owner dropped the gun, somehow I don't see how dropping the gun could cause this, so I'm going with manufacturing defect.
Pic:
https://www.copy.com/s/Bqdrgf3XFaQA
Think I'll try mucking with the bushing to make it shoot straight.