Fire is certainly a consideration, but it should not be one that is too worrisome. Not unless you've made some very
serious enemies.
When my wife and I lived in a
third floor apartment, we bought one of those escape ladders to use, just in case. The fire was below us, then we'd simply evac down the hall and exit an outside stairwell to the pool area.
Use a little common sense and you'll be fine.