Mental time travel and theory of mind develop, both phylo- and ontogenetically, at the same stage. We argue that this synchrony is due to the emergence of a shared competence, namely, the ability to become aware of frames of reference.