Let's be real here. What is a right is a social construct. The interaction of the public and government officials decided what is a right.
Many types of people had quite restricted rights under past versions and interpretations of the Constitution.
The development of a right or disabling of a right is sometimes played out in the experimental labs of state government.