Try using Walmart carb cleaner instead of the brake cleaner for degreasing. It DEFINITELY won't affect the blue, and it's cheaper than the brake cleaner. Don't get it on plastic or the finish on your stock, though.
Vinegar is a good idea for removing blue. It is a weaker acid and won't etch the metal as much as Naval Jelly or muriatic acid.