My pick would have to be the A Whole Nother Story trilogy, in which (spoiler warning) you can only travel back in time. But because time is in a loop of sorts, if you go before the beginning of time, you will be at the end of time. From there you can go back to any time you want to. And time paradoxes cannot be produced. Plus, your memories from the previous timeline exist as well as the memories from the new one.
11/22/63 is the obvious answer, but Cast Under an Alien Sun is the first book of a great series that while not technically time travel is functionally the same in practice.