Thanks for the reply folks. I did get in touch with a gunsmith in Missouri that told me about what was going on in there. He said usually what happens with these is that people will take them apart, and then they will unknowingly lose that ball.
Either way, I got in touch with browning, and they said that they do have the part. It is only around $1, but I can't buy it. It is a factory install item only. They said they would charge about $80 to put it in, and I would have to pay shipping both ways probably. The gunsmith in Missouri said the same thing, they cannot sell them to me. I could send it to them and have them put it in..
Must be a liability issue.
I had not thought about the ball being stuck because of crud buildup. I will check that out.