I second this. If someone were starting from scratch and wanting the power and flexibility of pandoc-based processing I would recommend they learn Quarto. But since you have a workflow that works for you, I don’t think there’s compelling reason to change. That’s the choice I made, at least. I do use pandoc-crossref, and the fact that Quarto doesn’t rely on the author of pandoc-crossref still caring about the project is a plus (he’s great, but he often stresses in his github discussions that he is frequently pressed for time). But the way I think of it is that Quarto will be there if I ever need it. Meanwhile, I’ve got my Scrivener setup just where I want it, so why mess with a good thing.
Last thing from me: I often have a fair number of equations in my text, but even if you don’t you’ll still have things like blockquotes after which you’ll want to force the output not to indent the next line of text. I have my Scrivener template set up in a fairly complicated way that enables me to do this, but there is a simpler way that you may not know about. I described it here.