Perhaps to lose a sense of where you are implies the danger of losing a sense of who you are. That must be it, I thought--to lose your direction is to lose your face.