That's one way of looking at it. Another is that if your thoughts are off into the future, your mind is not particularly aware of itself in the present.
That said, I'm not here to say rebirth is or isn't true. As I see it, it makes little difference what I think, because what I think/believe/speculate wouldn't change the reality of what will be in relation to "literal post mortem rebirth" anyway.
What I do know is that erroneously perceiving a self and extending this false perception of self backwards and forwards in time is not consistent with "seeing things as they really are", so I endeavour not to do it.
"Do not force others, including children, by any means whatsoever, to adopt your views, whether by authority, threat, money, propaganda, or even education." - Ven. Thich Nhat Hanh
"The uprooting of identity is seen by the noble ones as pleasurable; but this contradicts what the whole world sees." (Snp 3.12)
"To argue with a person who has renounced the use of reason is like administering medicine to the dead" - Thomas Paine