That sounds very much like the setup on the 1907 Dreyse. The indicator has a head on it but is the same thickness all the way as it also fits into a sleeve that fits into the screw on the back of the bolt (yes, that screw that everyone ruins trying to turn it!).
Check this diagram to see if Part # 5 looks familiar. I won't say it is the same, but the idea might be.