Wind shouldn't be too much of a factor at 100. You would have to have a pretty hefty wind to take it far off course with a 175 gr bullet. Out to 300, the wind has more time to affect the bullet and will start to affect POI. I regularly shoot a 77 gr bullet at 200 yds for practiceand wind is rarely strong enough to play a major role.
My advice is definitely to focus on the fundamentals of position, sight alignment and trigger pull and follow through. Consistency is the name of the game in precision shooting. Once you have some consistent results you can slowly start to increase distances and wind.
This brings up another question, Are you shooting off a bench? Bipod? Rest? Bags? Shooting mat frome prone position? Sitting, standing?