Another small annoyance, playback volume slider

As a part of my work, I use Scrivener to transcribe my interviews with the aid of MacSpeech. Typically, I use two windows: one window to place transcribed copy; a second window to play my MP3 audio interviews. Occasionally I use my mouse or trackpad over the audio “window” to fast forward or rewind the audio. Frequently, this same action seems to lower the audio slider at the bottom left of the audio window. Is there any way that these actions can be more isolated?