Hashtags? You mean you’re getting #TwitterKeywords in your manuscript? That is certainly nothing Scrivener would be doing on its own. You should use the Project Search feature to search for them, they are probably somewhere in your text.
Or are you meaning to refer to the punctuation mark itself—the sharp, the hashmark, the One True Octothorp:
#
If so, these prior threads may be of some assistance: