While using your GPS as your primary direction finding "tool", you might want to bring an "old fashioned" good quality compass and topo maps along, too.
If you're not experienced with compass navigation, the GPS is right there to correct your mistakes as you learn.
Compasses don't need batteries and their "signal" can't be turned off or intentionally degraded for security reasons. Paper maps don't usually fail.
I've rescued several boaters whose misuse of GPS units (or equipment failures) got them hopelessly lost - especially if they didn't have charts (nautical maps) with them, too.
Just my 2 cents...YMMV