Error in uploading images

bigbang001 · June 20, 2020, 6:12am

Hi,
When I try to upload large number of images (for example 5000) I get this error in the middle of uploading:

Uploading 4. sequence with 5 threads
Traceback (most recent call last):===========================] 100.0% … 0 images left…
File “mapillary_tools”, line 76, in
File “mapillary_tools\commands\upload.py”, line 49, in run
File “mapillary_tools\upload.py”, line 108, in upload
File “mapillary_tools\uploader.py”, line 830, in upload_file_list_manual
File “site-packages\requests\models.py”, line 940, in raise_for_status
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://a.mapillary.com/v3/me/uploads/NgY36GfEcmYl0e8HGnW7KU/closed?client_id=MkJKbDA0bnZuZlcxeTJHTmFqN3g1dzo1YTM0NjRkM2EyZGU5MzBh
[10864] Failed to execute script mapillary_tools

I didn’t understand what is the problem and how to fix it
Anyone can help?

asturksever · June 21, 2020, 12:01am

Hi @bigbang001,

Recently, Mapillary has started to check duplicated files in order to prevent duplicated files. All uploading tools check duplications and uploading session fails if at least one image is a duplicate. You will be getting notification email regarding this file so you can remove these files for uploading your files without duplication. Please make sure, you do not have any duplicated files.

bigbang001 · June 26, 2020, 10:06am

Thanks but I’m sure I didn’t upload images before
when the number of images get more that 500 I get several errors:
Using upload session hc8cimuF2J6JAYAJuyX7Cu
Uploading 2. sequence with 5 threads
Traceback (most recent call last):===========================] 100.0% … 0 images left…
File “mapillary_tools”, line 76, in
File “mapillary_tools\commands\upload.py”, line 49, in run
File “mapillary_tools\upload.py”, line 108, in upload
File “mapillary_tools\uploader.py”, line 830, in upload_file_list_manual
File “site-packages\requests\models.py”, line 940, in raise_for_status
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://a.mapillary.com/v3/me/uploads/hc8cimuF2J6JAYAJuyX7Cu/closed?client_id=MkJKbDA0bnZuZlcxeTJHTmFqN3g1dzo1YTM0NjRkM2EyZGU5MzBh
[13116] Failed to execute script mapillary_tools

eero_sario · July 1, 2020, 8:08am

I’ve been uploading this week without any issues, but as of today, I’m getting following error:

HTTP error: HTTP Error 403: Forbidden on G0011667.jpg, will attempt upload again for 49 more times

<?xml version="1.0" encoding="UTF-8"?>

<Error>
    <Code>InvalidAccessKeyId</Code>
    <Message>The AWS Access Key Id you provided does not exist in our records.</Message>
    <AWSAccessKeyId>...</AWSAccessKeyId>
    <RequestId>...</RequestId>
    <HostId>...</HostId>
</Error>

Reran mapillary_tools --advanced authenticate to no avail. Anyone else having this issue? Contacted support, will inform of their reply.

eero_sario · July 1, 2020, 10:52am

Reply from support:

There was a bug related to AWSAccessKeyId and it is fixed right now.

bigbang001 · July 7, 2020, 2:28pm

Hi, I still have the issue:
Each time about 500 image uploads mapillay_tools fails.
This is what I face for uploading more than 4K of images:

C:\mp>mapillary_tools upload --import_path C:\mp\20200703\tl2\DIR --advanced --number_threads=10
Uploading 4506 images with valid mapillary tags (Skipping 6)

Using upload session sm2UDTIip91iX4Gz2fL1Vq
Uploading 1. sequence with 10 threads
[============================================================] 100.0% … 0 images left…
Closed upload session sm2UDTIip91iX4Gz2fL1Vq

Using upload session sm2UDTIip91iX4Gz2fL1Vq
Uploading 2. sequence with 10 threads
Traceback (most recent call last):===========================] 100.0% … 0 images left…
File “mapillary_tools”, line 76, in
File “mapillary_tools\commands\upload.py”, line 49, in run
File “mapillary_tools\upload.py”, line 108, in upload
File “mapillary_tools\uploader.py”, line 830, in upload_file_list_manual
File “site-packages\requests\models.py”, line 940, in raise_for_status
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://a.mapillary.com/v3/me/uploads/sm2UDTIip91iX4Gz2fL1Vq/closed?client_id=MkJKbDA0bnZuZlcxeTJHTmFqN3g1dzo1YTM0NjRkM2EyZGU5MzBh
[4544] Failed to execute script mapillary_tools

C:\mp>mapillary_tools upload --import_path C:\mp\20200703\tl2\DIR --advanced --number_threads=10
Uploading 3506 images with valid mapillary tags (Skipping 1006)

Using upload session sm2UDTIip91iX4Gz2fL1Vq
Uploading 1. sequence with 10 threads
Traceback (most recent call last):===========================] 100.0% … 0 images left…
File “mapillary_tools”, line 76, in
File “mapillary_tools\commands\upload.py”, line 49, in run
File “mapillary_tools\upload.py”, line 108, in upload
File “mapillary_tools\uploader.py”, line 830, in upload_file_list_manual
File “site-packages\requests\models.py”, line 940, in raise_for_status
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://a.mapillary.com/v3/me/uploads/sm2UDTIip91iX4Gz2fL1Vq/closed?client_id=MkJKbDA0bnZuZlcxeTJHTmFqN3g1dzo1YTM0NjRkM2EyZGU5MzBh
[9176] Failed to execute script mapillary_tools

C:\mp>mapillary_tools upload --import_path C:\mp\20200703\tl2\DIR --advanced --number_threads=10
Uploading 3087 images with valid mapillary tags (Skipping 1425)

Using upload session sm2UDTIip91iX4Gz2fL1Vq
Uploading 1. sequence with 10 threads
Traceback (most recent call last):===========================] 100.0% … 0 images left…
File “mapillary_tools”, line 76, in
File “mapillary_tools\commands\upload.py”, line 49, in run
File “mapillary_tools\upload.py”, line 108, in upload
File “mapillary_tools\uploader.py”, line 830, in upload_file_list_manual
File “site-packages\requests\models.py”, line 940, in raise_for_status
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://a.mapillary.com/v3/me/uploads/sm2UDTIip91iX4Gz2fL1Vq/closed?client_id=MkJKbDA0bnZuZlcxeTJHTmFqN3g1dzo1YTM0NjRkM2EyZGU5MzBh
[3680] Failed to execute script mapillary_tools

C:\mp>mapillary_tools upload --import_path C:\mp\20200703\tl2\DIR --advanced --number_threads=10
Uploading 2651 images with valid mapillary tags (Skipping 1861)

Using upload session sm2UDTIip91iX4Gz2fL1Vq
Uploading 1. sequence with 10 threads
Traceback (most recent call last):===========================] 100.0% … 0 images left…
File “mapillary_tools”, line 76, in
File “mapillary_tools\commands\upload.py”, line 49, in run
File “mapillary_tools\upload.py”, line 108, in upload
File “mapillary_tools\uploader.py”, line 830, in upload_file_list_manual
File “site-packages\requests\models.py”, line 940, in raise_for_status
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://a.mapillary.com/v3/me/uploads/sm2UDTIip91iX4Gz2fL1Vq/closed?client_id=MkJKbDA0bnZuZlcxeTJHTmFqN3g1dzo1YTM0NjRkM2EyZGU5MzBh
[7472] Failed to execute script mapillary_tools

C:\mp>mapillary_tools upload --import_path C:\mp\20200703\tl2\DIR --advanced --number_threads=10
Uploading 2151 images with valid mapillary tags (Skipping 2361)

Using upload session sm2UDTIip91iX4Gz2fL1Vq
Uploading 1. sequence with 10 threads
Traceback (most recent call last):===========================] 100.0% … 0 images left…
File “mapillary_tools”, line 76, in
File “mapillary_tools\commands\upload.py”, line 49, in run
File “mapillary_tools\upload.py”, line 108, in upload
File “mapillary_tools\uploader.py”, line 830, in upload_file_list_manual
File “site-packages\requests\models.py”, line 940, in raise_for_status
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://a.mapillary.com/v3/me/uploads/sm2UDTIip91iX4Gz2fL1Vq/closed?client_id=MkJKbDA0bnZuZlcxeTJHTmFqN3g1dzo1YTM0NjRkM2EyZGU5MzBh
[9544] Failed to execute script mapillary_tools

C:\mp>mapillary_tools upload --import_path C:\mp\20200703\tl2\DIR --advanced --number_threads=10
Uploading 1651 images with valid mapillary tags (Skipping 2861)

Using upload session sm2UDTIip91iX4Gz2fL1Vq
Uploading 1. sequence with 10 threads
Traceback (most recent call last):===========================] 100.0% … 0 images left…
File “mapillary_tools”, line 76, in
File “mapillary_tools\commands\upload.py”, line 49, in run
File “mapillary_tools\upload.py”, line 108, in upload
File “mapillary_tools\uploader.py”, line 830, in upload_file_list_manual
File “site-packages\requests\models.py”, line 940, in raise_for_status
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://a.mapillary.com/v3/me/uploads/sm2UDTIip91iX4Gz2fL1Vq/closed?client_id=MkJKbDA0bnZuZlcxeTJHTmFqN3g1dzo1YTM0NjRkM2EyZGU5MzBh
[13040] Failed to execute script mapillary_tools

C:\mp>mapillary_tools upload --import_path C:\mp\20200703\tl2\DIR --advanced --number_threads=10
Uploading 1151 images with valid mapillary tags (Skipping 3361)

Using upload session sm2UDTIip91iX4Gz2fL1Vq
Uploading 1. sequence with 10 threads
Traceback (most recent call last):===========================] 100.0% … 0 images left…
File “mapillary_tools”, line 76, in
File “mapillary_tools\commands\upload.py”, line 49, in run
File “mapillary_tools\upload.py”, line 108, in upload
File “mapillary_tools\uploader.py”, line 830, in upload_file_list_manual
File “site-packages\requests\models.py”, line 940, in raise_for_status
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://a.mapillary.com/v3/me/uploads/sm2UDTIip91iX4Gz2fL1Vq/closed?client_id=MkJKbDA0bnZuZlcxeTJHTmFqN3g1dzo1YTM0NjRkM2EyZGU5MzBh
[8720] Failed to execute script mapillary_tools

C:\mp>mapillary_tools upload --import_path C:\mp\20200703\tl2\DIR --advanced --number_threads=10
Uploading 1000 images with valid mapillary tags (Skipping 3512)

Using upload session sm2UDTIip91iX4Gz2fL1Vq
Uploading 1. sequence with 10 threads
Traceback (most recent call last):===========================] 100.0% … 0 images left…
File “mapillary_tools”, line 76, in
File “mapillary_tools\commands\upload.py”, line 49, in run
File “mapillary_tools\upload.py”, line 108, in upload
File “mapillary_tools\uploader.py”, line 830, in upload_file_list_manual
File “site-packages\requests\models.py”, line 940, in raise_for_status
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://a.mapillary.com/v3/me/uploads/sm2UDTIip91iX4Gz2fL1Vq/closed?client_id=MkJKbDA0bnZuZlcxeTJHTmFqN3g1dzo1YTM0NjRkM2EyZGU5MzBh
[11916] Failed to execute script mapillary_tools

C:\mp>mapillary_tools upload --import_path C:\mp\20200703\tl2\DIR --advanced --number_threads=10
Uploading 500 images with valid mapillary tags (Skipping 4012)

Using upload session sm2UDTIip91iX4Gz2fL1Vq
Uploading 1. sequence with 10 threads
HTTP error: HTTPSConnectionPool(host=‘s3-eu-west-1.amazonaws.com’, port=443): Max retries exceeded with url: /mapillary-uploads (Caused by NewConnectionError(‘<urllib3.connection.VerifiedHTTPSConnection object at 0x0000023F95A61668>: Failed to establish a new connection: [Errno 10060] A connection attempt failed because the connected party did not properly respond after a period of time, or established connection failed because connected host has failed to respond’,)) on G0025210.jpg, will attempt upload again for 49 more times
Successful upload of G0025210.jpg on attempt 2===============] 100.0% … 0 images left.
Traceback (most recent call last):
File “mapillary_tools”, line 76, in
File “mapillary_tools\commands\upload.py”, line 49, in run
File “mapillary_tools\upload.py”, line 108, in upload
File “mapillary_tools\uploader.py”, line 830, in upload_file_list_manual
File “site-packages\requests\models.py”, line 940, in raise_for_status
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://a.mapillary.com/v3/me/uploads/sm2UDTIip91iX4Gz2fL1Vq/closed?client_id=MkJKbDA0bnZuZlcxeTJHTmFqN3g1dzo1YTM0NjRkM2EyZGU5MzBh
[11836] Failed to execute script mapillary_tools

C:\mp>mapillary_tools upload --import_path C:\mp\20200703\tl2\DIR --advanced --number_threads=10
Done uploading 0 images.
No post processing action specified.

Richlv · July 28, 2020, 7:11pm

See Page not found for what steps helped me with the 403 error.

Richlv · July 29, 2020, 9:33am

Thanks @asturksever, how does the failure manifest itself with mapillary_tools?
I also have started getting “HTTPError: 404” failures on some images - but that’s 0-8 of instances per 999 of images.

How do we find out why some images failed to upload, and what is that 404 error?

Richlv · July 31, 2020, 1:43pm

Got a notice from Said that the 404 errors are fixed in the latest mapillary_tools release - 0.5.3 changelog at Release v0.5.3 · mapillary/mapillary_tools · GitHub says “fixed 404 errors on upload session closing”.

I’m not quite sure whether all the previously failed images ended up being uploaded successfully, but it was becoming impossible to keep track of them - removed all of them.

Not quite sure whether 404 are gone as they did not happen on every directory, will watch out after upgrading

bigbang001 · August 8, 2020, 11:09am

I redownload Windows package installation again but still it’s version was 0.5.0
how should I upgrade mapillary_tools.exe?

asturksever · August 21, 2020, 5:36pm

@bigbang001
http://mapillary.trydiscourse.com/t/mapillary-tools-0-5-3-for-windows/4331/2?u=asturksever

Topic		Replies	Views
Error while uploading with Windows Tools Command line tools	4	722	May 20, 2021
Mapillary_tools upload errors Command line tools	6	1022	April 28, 2022
[Solved] Error uploading pictures Command line tools	2	531	August 11, 2019
Upload fails: "403 Client Error" Contributing and equipment	4	410	June 22, 2021
[bugreport] Failed images always retried	0	508	July 29, 2020

Error in uploading images

Related Topics