Mouse moving with arrow keys unexpectedly

I've had this a few times and it makes scrolling websites with the arrow keys on our media PC really annoying.

It's caused by having Paint open. Close paint and it goes away.

This is not the same as mouse keys with the number pad that's different.