Do you have a scientifically graduated cylinder?
Drop them in water and measure the displacement. You know the mass of the bullet, and the volume of displacement in water will give you a cubic centimeter measurement.
Density = Mass/Volume
If you don't have one fine enough, just use more bullets to get a bigger difference and then divide your final number by that number.