iOS heading bug

I’ve been wondering about the heading bug that’s been causing iOS app captures when travelling above walking speed to have a 90 degree heading offset for months now. The Mapillary algorithm figures out the correct direction, and a separate corrected FOV cone is shown while viewing an affected image after processing.

So is there any reason that the green cones on the map can’t all show the true heading instead of whatever the capture-device’s sensors erroneously showed? A couple of years ago, another bug had every direction flipped 180 degrees. Working with imagery on OpenStreetMap would be easier if the true heading was shown automatically.

I am not a Mapillary iOS code user, but given the CLI tools interpolates image direction from the motion of one frame to the next by default, the iOS code may have the facility to force it. Is there a interpolate direction option?

1 Like

Unfortunately not.

@wa_wheatbelt - yes, we are working on fixing this. When you say “Working with imagery on OpenStreetMap would be easier if the true heading was shown automatically.” - what environment are you looking at Mapillary imagery in, iD, or on Mapillary.com or something else?

1 Like

Hi @boris and thanks for the comment. I’m mostly referring to using the iD editor for OSM. The trails of green cones all point in the direction of their image heading metadata instead of the direction that Mapillary’s algorithm has detected. So I don’t truly know which direction a Mapillary image in iD is facing without clicking on it, especially for those sequences that had a 180 degree offset. Hope that makes sense.

Got it - it looks like the iD editor is using the original exif orientation as opposed to the computed Mapillary orientation. We are working on a fix now to make the computed orientation significantly more reliable, and then we can submit a pull request for the iD editor to switch to show the computed orientation to fix the issue you’re describing. Please stay tuned :slight_smile:

1 Like

Awesome!! Thank you, @boris !

Me again. I forgot to mention this before, but Mapillary’s iOS app also shows the exif heading instead of the computed heading. Hopefully that could be changed as well. :folded_hands::grin:

Yes, good catch. We will switch both the iOS and Android apps to computed compass angle.

1 Like

Hey @wa_wheatbelt,

I just released a new version of the iOS app which hopefully fixes any issues with image heading; both when capturing an image and also when viewing existing uploads (which now use the computed compass angle, CCA).

See iOS: 6.11.0 is out (map rotation, blocked area updates, bug fixes)

Thanks, @Anders !

Sorry to report that it hasn’t fixed it for me. I used 6.11 through TestFlight today for some captures, but it still had the wrong heading. I just downloaded the app from the AppStore, and old captures that were affected by the bug are still showing the incorrect heading.

FYI, I’m using an iPhone 15 Pro, and I always keep iOS up to date.

Now, this is an unexpected move? :distorted_face: I have asked for a computed sequences layer on the web app last year but not much has happened. And now, out with “the old”, in with “the new” so quickly for Android and iOS? Since neither GPS metadata nor computed values are always perfect (though computed values usually tend to be closer to the truth, if reconstruction works properly), I would rather prefer a toggle for both layers (perhaps in the filter menu?) in the web app than one layer (or dataset) over the other. Both datasets provide distinct value.

@GITNE we’re making the change because we are landing a fix that will make computed compass angle significantly more accurate than it was previously. On the web you’ll still be able to see both, for simplicity on the mobile clients I think we’ll start with just the computed (to replace just exif), and would love your feedback once the fix goes out in a couple weeks.

2 Likes

There are two compass angles we need to pay attention to

  1. The recorded angle that is stored in the image (raw angle, pre-upload)
  2. What is displayed on the map (computed angle, post upload)

The bug fix in the latest app update addresses #1. If you do a new capture with the latest update, and before uploading, open the capture and look at the compass angle for a few photos, do they look correct or are they 90 degrees off?

#2 is also addressed, in the sense that it displays the computed compass angle, which might or might not be correct.

Regarding the existing capture that you linked, I think it looks correct to me (the computed compass angle, not the original angle, that is unchanged).

2 Likes

Just to clear up some confusion about compass angle:

  • The professional (and original geometric or geographic) term for this angle is called “azimuth”. :wink:
  • In maritime and aviation applications it is called “bearing”.
  • In imaging and Exif metadata it is called “image direction”. For some unknown reason, Google engineers wanted to pile on to the confusion through the use of the “heading” term in GPano. :person_facepalming:
1 Like

Thanks. My use of the word heading actually comes from spending my teenage years obsessed with Microsoft Flight Simulator. :joy:

1 Like

Hi @Anders. The “recorded angle” is still offset 90 degrees for me, unfortunately. See screenshot of a sequence I captured today and am yet to upload.

Yeah that looks incorrect, I’ll look into it again next week.

In which orientation did you have your phone? Was the top of the phone rotated to the left or to the right? Also, was orientation lock on or off?

1 Like

Thanks.

Orientation lock was off. And I had the top of my phone rotated to the left.