If you move the front sight to the left, that will move the shot to the right.
The only possibility I see is you not lining up the sights correctly. They should be perfectly centered and perfectly level. The shorter the sight radius, the easier it is to screw up.
There is no such thing as a stupid question, only stupid people.