Yes, that is correct. We define mouse action as clicking and scrolling. Just moving the cursor (usually) does not have any effect, it does not serve a purpose and is not considered to be work. So, when you do not click nor scroll and you do move the mouse around, you are still reminded to take your hand away.