This is intentional, as it allows you to pick up where you left off using the forward/backward navigation to jump between your recent documents. You can empty the history per editor whenever you want using Navigate > Editor > Clear Document History.
Missed this one, it is very nice, thank you