People have different priorities at different stages of life

At one period in your life, you might focus on building a career. Then, your priority shifts to spending time with your family.

Wanting your past self to have spent time doing something else means placing your present set of values on your former self, which doesn’t make sense.

Our values evolve as we age. Even now, you might be spending time on a goal that your future self would think differently about. That’s okay. What’s important is that your values in that time align with the activities that you’re pursuing.