You can drift the sights yourself, with a brass punch and light hammer (may a small metal or slightly heavier plastic-headed hammer.) You should have those in your gun bag or tool box, regardless.
Center both sights in the dovetails at home, and then take the punch and hammer with you to the range the next time you shoot... and try sighting it in at about 25' feet. Adjust as needed as you shoot from a rest. (If you still need to go lower, you'll probably need as for a higher front sight from Ruger...)
Federal American Eagle and Winchester White Box will give more problems than more expensive (or better quality) ammo.