Mapillary_tools usage for GoPro Max

Contributing and equipment Command line tools
1

I have *.360 files from GoPro Max and want to process using mapillary_tools to upload rectilinear 360 images that are spaced with GPS distance three meters. I am on Windows 10 so i cant generate rectilinear mp4 with embedded GPMF metadata as this option only works in Mac version of GoPro Player.

Currently i am only able to sample rectilinear 360 images with time interval, not GPS distance.

Following workflow:

  1. Convert *.360 file to rectilinear *.mp4 (without GPMF metadata as i am on Windows 10)

  2. run mapillary_tools sample_video --video_sample_distance -1 --video_sample_interval 2 E:\GoPro\GS010603.mp4

  3. Rename folder with sampled images from
    E:\GoPro\mapillary_sampled_video_frames\GS010603.mp4 to GS010603.360

  4. run mapillary_tools process --geotag_source gopro_videos --filetypes image --geotag_source_path E:\ORIGINALS\GS010603.360 E:\GoPro\mapillary_sampled_video_frames\GS010603.360

  5. run mapillary_tools upload --user_name <***> --organization_key <***> E:\GoPro\mapillary_sampled_video_frames\GS010603.360

2

You can ignore my previous post as after several days of looking i found a better way of dealing with GoPro Max metadata.

I duplicate here what i posed on gopro forum just in case, obviously you don’t need the audio part for mapillary.

  1. Export video using GoPro Player into MP4 format

  2. Download FFMpeg

  3. Use either of this commands

    for GPMF metadata only

    ffmpeg -i "C:\GoPro\GS010603.360" -map 0:3 -c copy "C:\GoPro\GS010603_gpmf.mov"

    for 360 audio only

    ffmpeg -i "C:\GoPro\GS010603.360" -map 0:6 -c copy "C:\GoPro\GS010603_pcm.mov"

    for both GPMF metadata and 360 audio

    ffmpeg -i "C:\GoPro\GS010603.360" -map 0:3 -map 0:6 -c copy "C:\GoPro\GS010603_gpmf_and_pcm.mov"

    this will export data from original .360 container

  4. Add it to MP4 that created by GoPro Player (keep in mind MP4 should be same length timewise as original video for everything to work smoothly, otherwise you can edit as you wish)

    (first input file depends on your choice in step 3)

    ffmpeg -i "C:\GoPro\GS010603_gpmf_and_pcm.mov" -i "C:\GoPro\GS010603.mp4" -map 0 -map 1 -c copy "C:\GoPro\GS010603_gpmf_and_pcm_final.mov"

    Your final output file has to be .mov, can not use .mp4

  5. If you really want to get an MP4 instead of MOV then download MP4Box and use command

    (input file depends on your choice in step 4)

    MP4Box -add "C:\GoPro\GS010603_gpmf_and_pcm_final.mov" -new "C:\GoPro\GS010603_gpmf_and_pcm_final.mp4"

  6. Might need to update timestamps in MP4 using ExifTool

    exiftool -TagsFromFile "E:\GoPro\GS010603.360" "-time:all>time:all" -overwrite_original "E:\GoPro\GS010603_gpmf_and_pcm_final.mp4"

Now you can use MOV or MP4 (depending on your choice) in any program that supports metadata or upload straight to mapillary or google street view.

As a bonus if you want to export 360 audio from original .360 file use this command

ffmpeg -i "C:\GoPro\GS010603.360" -map 0:6 -c:a pcm_s32le "C:\GoPro\GS010603_4ch.wav"

then you can mix it in Adobe Audition for example and export as stereo.

Only benefit i found of 360 audio is that if you use noise reduction in GoPro Max options (i recommend to set Noise Reduction to Auto, really all it does it makes microphone volume lower if camera thinks its too loud?, having it ON all the time just makes microphone volume too low) then wav file is unprocessed audio that will have full volume and better quality, you can save it to stereo and use it instead if noise reduction messes up your audio too much.

1 Like
3

@MapMan - what is the benefit of this approach vs uploading the .360 to mapillary directly? (both mapillary_tools and desktop uploader support .360 videos natively, and they will get sampled to one image every 3 meters by the mapillary server, no processing required by users)

4

If the same data is used for Google Streetview, Google can’t process the .360 files directly.

1 Like
5

To clarify mapillary_tools supports .360 files, but only if end user wants to upload the whole videos + JSON. However for extracting JPG stills from video mapillary_tools only support getting front camera stream from .360 file, for whole 360 image got to convert video to mp4 using GoPro Player which on Windows does not include GPMF in final 360 video.

In situations like mine (and others) where i record about 50 GB of 360 videos at a time and want to upload only JPG’s while having control of the distance between images in meters.
360 JPG generation using mapillary_tools only works from MP4 that has GPMF embedded.

This is mappilary_tools approach i come up with so far.

Export GPMF from .360 file

ffmpeg -i "E:\GoPro\GS010603.360" -map 0:3 -c copy "E:\GoPro\GS010603_gpmf.mov"

Embed GPMF to MP4. Important specify GPMF stream as second option so it will append at the end of the video container, otherwise there is a bug in current version of mapillary_tools that outputs low quality JPG’s.

ffmpeg -i "E:\GoPro\GS010603.mp4" -i "E:\GoPro\GS010603_gpmf.mov" -map 0 -map 1 -c copy "E:\GoPro\GS010603_gpmf_final.mov"

copy timestamps from 360 file

exiftool -TagsFromFile "E:\GoPro\GS010603.360" "-time:all>time:all" -overwrite_original "E:\GoPro\GS010603_gpmf_final.mov"

extract JPG’s

mapillary_tools sample_video --video_sample_distance 3 "E:\GoPro\GS010603_gpmf_final.mov"

generate JSON

mapillary_tools process --filetypes image "E:\GoPro\mapillary_sampled_video_frames\GS010603_gpmf_final.mov"

Upload to Mapillary

mapillary_tools upload --user_name <...> --organization_key <...> E:\GoPro\mapillary_sampled_video_frames\GS010603_gpmf_final.mov

Can be split into less commands if needed, but this is for someone who wants to make their own script for batch processing, so they probably know how to do it.

1 Like
6

Gotcha, thank you for the clarification!

7

What settings do you use for the 360 to mp4 conversion in Go Pro Player?