If this happens after using the pointing stick and it stops a few seconds after you let go, this is normal. The pointing stick re-calibrates itself now and then. If it happens when you're not even touching anything, it may be a flaky driver. Do you have a mouse plugged in when this happens?

your mouse may have some dirt in it, try to clean it out with a dry paper towel or just blow in it and shake it gently