There should be no stock contact with the barrel in the barrel channel. It should float there. Yes there should be downward force.
It is a common occurance with commercial stocks to have to narrow of a barrel channel.
I have worked on atleast half a dozen of the Boyds/CMP stocks and they all needed work of some type or another.
If the channel is to narrow and is holding the barrel up from its proper position your POI will be to high and you will run out of adjustment.
Not saying this is what the OP's problem is but it is worth looking into