Memory isn't something that stays with you at all times. It's a quantity that gets summoned or evoked or brought to mind. It gets carried to an arena for our viewing pleasure. By definition, then, there are times it must go missing.