Perhaps to lose a sense of where you are implies the danger of losing a sense of who you are.