IMO, damage is not likely in just a few rounds. The problem is, do you know how long the buffer has been broken? It may just now be starting to break up. It might even still be intact enough to "buffer" for a bit longer.
It would be hard to tell without examining the buffer.