When a project is closed, the Project Backup box that (optionally) pops up has an Abort button will abort the save in progress and close out the project. This is the same box as when you do a manual save.
It would be good if that box, when invoked via the Close project command, also had a Cancel button that would cancel the project close altogether.