
I haven't had my hands on a bike like your's, I was looking for a clear picture to see if there is an over-ride button on your's, like my 660 has. We have different set-ups so mine looks like this; (second picture)
Buy Yamaha 5KM-83972-00-00 - SWITCH, HANDLE 4. This OEM part is guaranteed by Yamaha's limited part warranty ✓ FREE Shipping on qualified orders - Partzilla.com
www.partzilla.com
by the left side grip. Mine has diff lock and when this position is selected the speed is limited to 20 m.p.h. by de-tuning the engine, and when in reverse this same de-tuning happens above @10 m.p.h., never really looked to see the speed when it kicks in.
Your problem description sounds exactly like what mine does (sounds like) when the limiter kicks in, but I can't find good info on your bike to know this is right way to go.