Keep greases and oils off rubber gaskets.
Remember from Chemistry class, like dissolves like? Organics (oil) will dissolve other organics (rubber). Even if the gaskets were thermoset, instead of thermoplastic plastic, there is nothing good that an oil coating will do over time.
It is likely the gasket material is tolerant of oil, so wipe the things off, soap and water won't hurt, and close the lid.
If I'm not shooting, I'm reloading.