I don't think it would be silly.
I would start by seeing how much range pickup brass you can accumulate how quick. Once you have a, gosh, several hundred or so, then look at a die set and powder and bullets and so on.
I started reloading about five years ago. I live in a strange remote market far away from the CONUS. What I have observed is the price of factory loaded ammunition goes up faster than components, so calibers that weren't "worth" reloading a few years ago, are worth it now.
Save your brass for now. Someday (maybe soon) it will make financial sense to reload it.