A ,32 is a nice "squirrel rifle" - I had a CVA .32 squirrel rifle for a while and it was a nice shooting rifle - large enough to take a squirrel - small enough to not "clean" it at the same time.
In my "downsizing", I sold it. I still have my .36 underhammer H & A though and it also does a nice job on squirrels - simple rifle and fun to shoot. A good caliber for most things small whether it be squirrels, rabbits or even a woodchuck. Fun to plink with as well and doesn't require a lot of lead/powder. Good luck in your search and I hope you find a rifle that is right for you.