do you have a tach or are you just guessing at RPM?
you keep saying speed, so I have no idea if you mean boat speed across the water or RPM.
there is no reason I can think of that a motor would make a loud noise like a muffler fell off when it just lowered RPM.
motors make more noise at higher...