Time Travel Isn't Linear

Without the ability to time travel,  it's hard to say what our memories might look like - but ultimately, he believes it comes down to speculation and semantics, along with the understanding that time simply isn't linear.

In the movie, Adam gets a healthy dose of thoughtful counsel from his kid self  - so much so that it changes his perception of his own past for the better.