In my novel series, I structure it like this:
Novel > Chapter > Scene > Passage
This gives me all the granularity I need. Indeed, I rarely go to the passage level. When I do, it’s because I am uncertain if the passage would work better elsewhere. I usually make that decision in the revision stage.