In the Android app you can set the direction i 2 ways:
Use the phones compass
Select a direction compared to the way you are traveling.
The compass is often not too good and it look like you have that. You may try to calibrate it or download a compass app to see if it is good.
Selecting a direction, usually forward, comapred to your path, is much more stable. That requires that you point the camera in the same way. When it is mounted in a car or on a bike that is often given.