IMO, it should be OK if you treat it as a pistol round. That means, keep ranges realistic and more importantly, shot placement is key and don't expect hydrostatic shock to drop the deer like a .30-06 may do. Put the hole in the right place and any deer should go down.
Non-expanding rounds would be preferable IMO. You want to maximize penetration put the hole in the right place and make sure it goes DEEP, rather than relying more on the 'energy dump' of an expanding round, like you would with a full sized rifle round.