You have to have a solid foundation to build any skills from. Practice, practice, practice. Bad reloads will cost you seconds, and they all add up.
Practice the correct grip, draws and reloads and speed will come with time. Trying to push speed usually results in
My rifle and pistol are tools, I am the weapon.