optical flow

Hello, I just built my first DIY quadcopter using an F500 frame. It uses a (vibration dampened) Pixhawk 2.4.8 controller and a normal m8n GPS. Maybe I had false assumptions, but I'm shocked at the high instability when hovering at a stationary point. It sways around like it's drunk, sometimes...