Missing parts of the sequences

Contributing and equipment
#1

I decided to make separate topic of this.
Since some time I am getting weird gaps in my sequences after upload. Just as if some pictures were missing. It is usually 200-300 pics. It is extremely annoying because I see no reason for them being missing, and when I try to upload them again they dont show up either. Finally yesterday I tried to use web uploader, and got message that I try to upload duplicates. So the pictures are there somewhere, just they dont appear on the web!
Can someone from mapillary check it? I include here a link to three shots that web uploader thinks are duplicates, but try to find them on the map!
https://www.dropbox.com/sh/bosac7t9pzkgyhu/AADRnFmuCJlKjM1f-8n8Waela?dl=0

It seems same thing happening with mobile app, but I cannot try to upload pics again because they are deleted automatically, so no way to feel the gaps :-/

2 Likes
Odd Behavior during Uploading
Mapillary rejection of images -- unable to debug cause
#2

This happen sometimes and it seems that the missing pictures appear some days or weeks later. Also a reason why I coded my own uploader for Python 3.

#3

I’ve seen similar issues from a few users and we are looking to figure it out. Send any details you have on your username, date of upload, and sequence keys to support@mapillary.com and I can get this logged in as more evidence of the issue!

#4

here is a sequence from 26th january with two gaps. Should be complete:

https://www.mapillary.com/app/?focus=map&pKey=529cnGK0v1JRn9fXQah7cs&lat=53.67283250350212&lng=15.632137730200839&z=7.881265573936758&dateFrom=2021-01-26&dateTo=2021-01-26

another sequence from 14th january with many gaps:
https://www.mapillary.com/app/?focus=map&pKey=F3a0QtJC0kHT51NE8vCWVG&lat=52.361007388553446&lng=17.92320138249852&z=7.1533815372546465&dateFrom=2021-01-13&dateTo=2021-01-14

as I wrote, I tried to upload again missing parts, but system saying they are already there.

Here is a gap from 17th december:
https://www.mapillary.com/app/?focus=map&pKey=aUmBYlRTRyeBjKkTtUk7i4&lat=53.626761311386105&lng=15.856129898686163&z=11.632730856982722&mapStyle=OpenStreetMap&dateFrom=2020-12-17&dateTo=2020-12-17

…and I filled it overwriting the EXIF with new gpx data with another timestamp (3 january):
https://www.mapillary.com/app/?lat=53.60815889999805&lng=15.871014&z=17&mapStyle=OpenStreetMap&dateFrom=2020-12-17&pKey=ASHQDahwBjoPUacWD2e6W1

but its lots of work and not really sensible. Orginal photos never show up on the map

#5

Something new on the problem. You can find the pictures uploaded in ID editor. So they exist! and ID editor is showing them. Just website and JOSM are not.
But characteristic thing: they appear as separate dots not conected by the sequence line.

#6

Some of my sequences seem to be affected too: wdotc45y2kfrq3j3j5cxvm or 1fPnwKTAReeZ8Wu49V03Zg.
As per Mapillary API the sequences exist, they have been reconstructed and CV processed. They have also been connected to the navigation graph. However, they neither show up on the sequence map layer nor in the uploads tab. You cannot traverse these sequences in the web viewer either. They are kind of presented as single point images only. :slightly_frowning_face:

I have also observed that except for new sequences, the sequence map layer has not been updated since about Q4 2020. Having said that, I am unsure if sequence map layer generation has just been delayed and it is going to catchup with recent processing or if it is actually broken.

#7

I think it has connection with the procedure to filter out corrupt gps frames that sometimes happen, so there are no longer long lines through all map to antarctica or greenland :smiley: So maybe the algorithm is throwing out all parts of sequences with only one picture corrupt?
When I was processing my pictures I’ve got communicates about to large distance or speed or something.
But I need to observe it little bit more…

#8

Some of my sequences seem to be affected too: wdotc45y2kfrq3j3j5cxvm or 1fPnwKTAReeZ8Wu49V03Zg

I have just realized that sequence wdotc45y2kfrq3j3j5cxvm seems to not exist as by the Mapillary API. However, image 6X0FxlSKFpBhaIOz01sto6 exists per Mapillary API and should be the first image in sequence wdotc45y2kfrq3j3j5cxvm. :confused:

#9

happened again. It always starts with pictures in new gopro directory.

sequence: q1jvgbjmfqh3nlv03sss9l
images:
TURwcMbQmaSogsQrut4x60
AJZqdcUuYZQ0q1cxtQR8MA
3hre8yOHb9AOl7rR99vqgO
…and more…are in one sequence but not connected to each other. Only possible to find and open them through ID editor, and they dont appear on mapillary website at all.

#10

same here. e.g. Sequence dduwie9mzntxrc7kvtexzl
Image k09gmX4M1Kx7v5uLj05sh5

#11

Happened again. Image XnFmTIA42vmjmBL3b53VWO is not on the map but viewable. It is also part of sequence qzdr28bc11ws3quongk5bk but the Mapillary API says that it does not exist. :confused:

#12

Same with:
Sequence: GMfu07jXJyoKKnV1nkPscD
Images: 4KKNlspsC3gr56jTZGfCDE, PgZqrxk6wcc8k1iheCDaGP,…

#13

My problem seems related: Photos not appearing on map

Heads up: One bad image can make a sequence not show up
#14

Something must have happened - many more of my photos from 21/11/2020 (Photos not appearing on map) have just appeared on the map, including some that have been outstanding for 4 months.

#15

We may have made progress in finding the root course of this issue. Hope to have an update for you soon.

3 Likes
Photos not appearing on map
#16

While we investigate further, I just want to thank you all for doing such an amazing job diving into this issue and trying to work out what is going on. It goes a long way to helping us debug.

You’ve also been incredibly patient!

#17

Hi @eneerhut

Thank you for the response. Do you know if any fix is likely to apply to past uploads?

This affects something like 30% of our captures, it’s quite frustrating and we can not understand how to avoid it (it’s something that’s made us look at self hosting & mapping)

#18

The fix will definitely apply to previous uploads. The leading theory at the moment relates to a bot that we have that flags images that it thinks are not street-level imagery.

It looks like whole sequences might be getting flagged in the system if just one of the images is flagged by the bot. Some innocent images may be getting flagged such as an image of a wall or the ground which the bot marks as ‘not street-level imagery’.

Usually these false flags are reviewed and corrected for, but that system is broken. We’re hoping a fix we’ve just applied will rectify the issue.

2 Likes
#19

@masterofnoroad I just went through a bunch of your pending images and approved/rejected the flags. Hopefully your images process and appear in your feed soon.

There were a few that were images looking straight at the ground or of a hand which won’t go through, but the rest should be fine.

#20

Could this also be a reason why some of my sequences, although visible on the map, have not been 3D reconstructed after weeks?

Another question: Is the quality score somehow connected to or an indicator to the “steet-level imagery” police bot?