My wife is 5'1" and 120lbs - she has had no troubles with my XDMs or Glocks. The only thing she doesn't like is the 1911, because the plunger in the front is a bit tough.
It sounds like you just need to learn how to use leverage in your favor.
Hold the gun in your right hand in a shooting style grip. Point the gun to the left and get a firm grasp on the top of the slide. Force your hands together to move the slide to the rear, rather than sling shot style - my wife has trouble with sling shot style, too. With this method, you're using your upper arms and shoulders to compress the spring.
Kind of difficult to explain, I suppose, but look up YouTube videos. I'm sure there are some demonstrations.
Glock 19 G4 Gray | Glock 17 G4 FDE | S&W M&P 22 | S&W M&P 45 | S&W M&P 9 | Sig P226 MK25 | Sig P229 Extreme | Sig P220 Carry Elite Stainless | Sig P320 F | Sig P320 C | HK USP 9 | HK USP 45 | HK USP 45 (Tan) | HK VP9
Daniel Defense DDM4 V4 | Arsenal SGL 21 | ASA SBR | Savage Mark II FV-SR
Mossberg 590A1 20" SP | Mossberg 500 Cruiser