Error in uploading images

Hi,
When I try to upload large number of images (for example 5000) I get this error in the middle of uploading:

Uploading 4. sequence with 5 threads
Traceback (most recent call last):===========================] 100.0% … 0 images left…
File “mapillary_tools”, line 76, in
File “mapillary_tools\commands\upload.py”, line 49, in run
File “mapillary_tools\upload.py”, line 108, in upload
File “mapillary_tools\uploader.py”, line 830, in upload_file_list_manual
File “site-packages\requests\models.py”, line 940, in raise_for_status
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://a.mapillary.com/v3/me/uploads/NgY36GfEcmYl0e8HGnW7KU/closed?client_id=MkJKbDA0bnZuZlcxeTJHTmFqN3g1dzo1YTM0NjRkM2EyZGU5MzBh
[10864] Failed to execute script mapillary_tools

I didn’t understand what is the problem and how to fix it :frowning:
Anyone can help?

Hi @bigbang001,

Recently, Mapillary has started to check duplicated files in order to prevent duplicated files. All uploading tools check duplications and uploading session fails if at least one image is a duplicate. You will be getting notification email regarding this file so you can remove these files for uploading your files without duplication. Please make sure, you do not have any duplicated files.

1 Like

Thanks but I’m sure I didn’t upload images before
when the number of images get more that 500 I get several errors:
Using upload session hc8cimuF2J6JAYAJuyX7Cu
Uploading 2. sequence with 5 threads
Traceback (most recent call last):===========================] 100.0% … 0 images left…
File “mapillary_tools”, line 76, in
File “mapillary_tools\commands\upload.py”, line 49, in run
File “mapillary_tools\upload.py”, line 108, in upload
File “mapillary_tools\uploader.py”, line 830, in upload_file_list_manual
File “site-packages\requests\models.py”, line 940, in raise_for_status
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://a.mapillary.com/v3/me/uploads/hc8cimuF2J6JAYAJuyX7Cu/closed?client_id=MkJKbDA0bnZuZlcxeTJHTmFqN3g1dzo1YTM0NjRkM2EyZGU5MzBh
[13116] Failed to execute script mapillary_tools

I’ve been uploading this week without any issues, but as of today, I’m getting following error:

HTTP error: HTTP Error 403: Forbidden on G0011667.jpg, will attempt upload again for 49 more times

<?xml version="1.0" encoding="UTF-8"?>

<Error>
    <Code>InvalidAccessKeyId</Code>
    <Message>The AWS Access Key Id you provided does not exist in our records.</Message>
    <AWSAccessKeyId>...</AWSAccessKeyId>
    <RequestId>...</RequestId>
    <HostId>...</HostId>
</Error>

Reran mapillary_tools --advanced authenticate to no avail. Anyone else having this issue? Contacted support, will inform of their reply.

Reply from support:

There was a bug related to AWSAccessKeyId and it is fixed right now.

Hi, I still have the issue:
Each time about 500 image uploads mapillay_tools fails.
This is what I face for uploading more than 4K of images:

C:\mp>mapillary_tools upload --import_path C:\mp\20200703\tl2\DIR --advanced --number_threads=10
Uploading 4506 images with valid mapillary tags (Skipping 6)

Using upload session sm2UDTIip91iX4Gz2fL1Vq
Uploading 1. sequence with 10 threads
[============================================================] 100.0% … 0 images left…
Closed upload session sm2UDTIip91iX4Gz2fL1Vq

Using upload session sm2UDTIip91iX4Gz2fL1Vq
Uploading 2. sequence with 10 threads
Traceback (most recent call last):===========================] 100.0% … 0 images left…
File “mapillary_tools”, line 76, in
File “mapillary_tools\commands\upload.py”, line 49, in run
File “mapillary_tools\upload.py”, line 108, in upload
File “mapillary_tools\uploader.py”, line 830, in upload_file_list_manual
File “site-packages\requests\models.py”, line 940, in raise_for_status
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://a.mapillary.com/v3/me/uploads/sm2UDTIip91iX4Gz2fL1Vq/closed?client_id=MkJKbDA0bnZuZlcxeTJHTmFqN3g1dzo1YTM0NjRkM2EyZGU5MzBh
[4544] Failed to execute script mapillary_tools

C:\mp>mapillary_tools upload --import_path C:\mp\20200703\tl2\DIR --advanced --number_threads=10
Uploading 3506 images with valid mapillary tags (Skipping 1006)

Using upload session sm2UDTIip91iX4Gz2fL1Vq
Uploading 1. sequence with 10 threads
Traceback (most recent call last):===========================] 100.0% … 0 images left…
File “mapillary_tools”, line 76, in
File “mapillary_tools\commands\upload.py”, line 49, in run
File “mapillary_tools\upload.py”, line 108, in upload
File “mapillary_tools\uploader.py”, line 830, in upload_file_list_manual
File “site-packages\requests\models.py”, line 940, in raise_for_status
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://a.mapillary.com/v3/me/uploads/sm2UDTIip91iX4Gz2fL1Vq/closed?client_id=MkJKbDA0bnZuZlcxeTJHTmFqN3g1dzo1YTM0NjRkM2EyZGU5MzBh
[9176] Failed to execute script mapillary_tools

C:\mp>mapillary_tools upload --import_path C:\mp\20200703\tl2\DIR --advanced --number_threads=10
Uploading 3087 images with valid mapillary tags (Skipping 1425)

Using upload session sm2UDTIip91iX4Gz2fL1Vq
Uploading 1. sequence with 10 threads
Traceback (most recent call last):===========================] 100.0% … 0 images left…
File “mapillary_tools”, line 76, in
File “mapillary_tools\commands\upload.py”, line 49, in run
File “mapillary_tools\upload.py”, line 108, in upload
File “mapillary_tools\uploader.py”, line 830, in upload_file_list_manual
File “site-packages\requests\models.py”, line 940, in raise_for_status
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://a.mapillary.com/v3/me/uploads/sm2UDTIip91iX4Gz2fL1Vq/closed?client_id=MkJKbDA0bnZuZlcxeTJHTmFqN3g1dzo1YTM0NjRkM2EyZGU5MzBh
[3680] Failed to execute script mapillary_tools

C:\mp>mapillary_tools upload --import_path C:\mp\20200703\tl2\DIR --advanced --number_threads=10
Uploading 2651 images with valid mapillary tags (Skipping 1861)

Using upload session sm2UDTIip91iX4Gz2fL1Vq
Uploading 1. sequence with 10 threads
Traceback (most recent call last):===========================] 100.0% … 0 images left…
File “mapillary_tools”, line 76, in
File “mapillary_tools\commands\upload.py”, line 49, in run
File “mapillary_tools\upload.py”, line 108, in upload
File “mapillary_tools\uploader.py”, line 830, in upload_file_list_manual
File “site-packages\requests\models.py”, line 940, in raise_for_status
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://a.mapillary.com/v3/me/uploads/sm2UDTIip91iX4Gz2fL1Vq/closed?client_id=MkJKbDA0bnZuZlcxeTJHTmFqN3g1dzo1YTM0NjRkM2EyZGU5MzBh
[7472] Failed to execute script mapillary_tools

C:\mp>mapillary_tools upload --import_path C:\mp\20200703\tl2\DIR --advanced --number_threads=10
Uploading 2151 images with valid mapillary tags (Skipping 2361)

Using upload session sm2UDTIip91iX4Gz2fL1Vq
Uploading 1. sequence with 10 threads
Traceback (most recent call last):===========================] 100.0% … 0 images left…
File “mapillary_tools”, line 76, in
File “mapillary_tools\commands\upload.py”, line 49, in run
File “mapillary_tools\upload.py”, line 108, in upload
File “mapillary_tools\uploader.py”, line 830, in upload_file_list_manual
File “site-packages\requests\models.py”, line 940, in raise_for_status
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://a.mapillary.com/v3/me/uploads/sm2UDTIip91iX4Gz2fL1Vq/closed?client_id=MkJKbDA0bnZuZlcxeTJHTmFqN3g1dzo1YTM0NjRkM2EyZGU5MzBh
[9544] Failed to execute script mapillary_tools

C:\mp>mapillary_tools upload --import_path C:\mp\20200703\tl2\DIR --advanced --number_threads=10
Uploading 1651 images with valid mapillary tags (Skipping 2861)

Using upload session sm2UDTIip91iX4Gz2fL1Vq
Uploading 1. sequence with 10 threads
Traceback (most recent call last):===========================] 100.0% … 0 images left…
File “mapillary_tools”, line 76, in
File “mapillary_tools\commands\upload.py”, line 49, in run
File “mapillary_tools\upload.py”, line 108, in upload
File “mapillary_tools\uploader.py”, line 830, in upload_file_list_manual
File “site-packages\requests\models.py”, line 940, in raise_for_status
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://a.mapillary.com/v3/me/uploads/sm2UDTIip91iX4Gz2fL1Vq/closed?client_id=MkJKbDA0bnZuZlcxeTJHTmFqN3g1dzo1YTM0NjRkM2EyZGU5MzBh
[13040] Failed to execute script mapillary_tools

C:\mp>mapillary_tools upload --import_path C:\mp\20200703\tl2\DIR --advanced --number_threads=10
Uploading 1151 images with valid mapillary tags (Skipping 3361)

Using upload session sm2UDTIip91iX4Gz2fL1Vq
Uploading 1. sequence with 10 threads
Traceback (most recent call last):===========================] 100.0% … 0 images left…
File “mapillary_tools”, line 76, in
File “mapillary_tools\commands\upload.py”, line 49, in run
File “mapillary_tools\upload.py”, line 108, in upload
File “mapillary_tools\uploader.py”, line 830, in upload_file_list_manual
File “site-packages\requests\models.py”, line 940, in raise_for_status
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://a.mapillary.com/v3/me/uploads/sm2UDTIip91iX4Gz2fL1Vq/closed?client_id=MkJKbDA0bnZuZlcxeTJHTmFqN3g1dzo1YTM0NjRkM2EyZGU5MzBh
[8720] Failed to execute script mapillary_tools

C:\mp>mapillary_tools upload --import_path C:\mp\20200703\tl2\DIR --advanced --number_threads=10
Uploading 1000 images with valid mapillary tags (Skipping 3512)

Using upload session sm2UDTIip91iX4Gz2fL1Vq
Uploading 1. sequence with 10 threads
Traceback (most recent call last):===========================] 100.0% … 0 images left…
File “mapillary_tools”, line 76, in
File “mapillary_tools\commands\upload.py”, line 49, in run
File “mapillary_tools\upload.py”, line 108, in upload
File “mapillary_tools\uploader.py”, line 830, in upload_file_list_manual
File “site-packages\requests\models.py”, line 940, in raise_for_status
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://a.mapillary.com/v3/me/uploads/sm2UDTIip91iX4Gz2fL1Vq/closed?client_id=MkJKbDA0bnZuZlcxeTJHTmFqN3g1dzo1YTM0NjRkM2EyZGU5MzBh
[11916] Failed to execute script mapillary_tools

C:\mp>mapillary_tools upload --import_path C:\mp\20200703\tl2\DIR --advanced --number_threads=10
Uploading 500 images with valid mapillary tags (Skipping 4012)

Using upload session sm2UDTIip91iX4Gz2fL1Vq
Uploading 1. sequence with 10 threads
HTTP error: HTTPSConnectionPool(host=‘s3-eu-west-1.amazonaws.com’, port=443): Max retries exceeded with url: /mapillary-uploads (Caused by NewConnectionError(’<urllib3.connection.VerifiedHTTPSConnection object at 0x0000023F95A61668>: Failed to establish a new connection: [Errno 10060] A connection attempt failed because the connected party did not properly respond after a period of time, or established connection failed because connected host has failed to respond’,)) on G0025210.jpg, will attempt upload again for 49 more times
Successful upload of G0025210.jpg on attempt 2===============] 100.0% … 0 images left.
Traceback (most recent call last):
File “mapillary_tools”, line 76, in
File “mapillary_tools\commands\upload.py”, line 49, in run
File “mapillary_tools\upload.py”, line 108, in upload
File “mapillary_tools\uploader.py”, line 830, in upload_file_list_manual
File “site-packages\requests\models.py”, line 940, in raise_for_status
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://a.mapillary.com/v3/me/uploads/sm2UDTIip91iX4Gz2fL1Vq/closed?client_id=MkJKbDA0bnZuZlcxeTJHTmFqN3g1dzo1YTM0NjRkM2EyZGU5MzBh
[11836] Failed to execute script mapillary_tools

C:\mp>mapillary_tools upload --import_path C:\mp\20200703\tl2\DIR --advanced --number_threads=10
Done uploading 0 images.
No post processing action specified.

1 Like

See Unable to upload: The AWS Access Key Id you provided does not exist in our records for what steps helped me with the 403 error.

1 Like

Thanks @asturksever, how does the failure manifest itself with mapillary_tools?
I also have started getting “HTTPError: 404” failures on some images - but that’s 0-8 of instances per 999 of images.

How do we find out why some images failed to upload, and what is that 404 error?

Got a notice from Said that the 404 errors are fixed in the latest mapillary_tools release - 0.5.3 changelog at https://github.com/mapillary/mapillary_tools/releases/tag/v0.5.3.1 says “fixed 404 errors on upload session closing”.

I’m not quite sure whether all the previously failed images ended up being uploaded successfully, but it was becoming impossible to keep track of them - removed all of them.

Not quite sure whether 404 are gone as they did not happen on every directory, will watch out after upgrading :slight_smile:

I redownload Windows package installation again but still it’s version was 0.5.0
how should I upgrade mapillary_tools.exe?

1 Like

@bigbang001