The only deer I ever shot with a pistol is my biggest deer to date. I had a fractured eye socket and couldn't shoot a long gun due to recoil on cheek bone. My FIL loaned me a Savage Striker in 243. That is one heck of a hand gun. This year I bought a Glock 40, I'm gonna carry it as a hunting side and if the opportunity shows might try a deer with it.
Sounds like you have it all together. Good hunting!BE understand the skill and range limits associated with handgun hunting and I would not use too much gun rather something I can handle and shoot well at 50 yards. I have property in Orange Co (100 Acres) and 50 yards would be a "normal" shot