Try this:
Double-click on some layout to get to the formatting page.
Choose Section Layouts on the left.
Choose the layout you want to change.
Go to the Title Options page.
You will probably see: Chapter <$t:chapter> ¶
Remove the "Chapter " but leave the rest.
This won’t change what you see while you’re editing, just what you get when you compile.