Make a concious effort to practice your parts, exercises, etc at different dynamic levels. Speed should not be effected by volume, and vice versa.
+1,000,000
drums like ANY other instrument has a dynamic range that should be explored and controlled. its like your voice. you're not always shouting at people, but you talk in whispers, conversation, etc.