Tesla Integrated Dashcam-Feature - possible use with Mapillary?

Hi there,

I’m driving a Tesla Model 3 which has the ability to record the videos made with 4 cameras onto an USW-Stick. The 4 cameras are front, back, side left and side right.
Is there any possibility to use these videos with mapillary?
From my oppinion, the biggest problem would be matching via timestamp ti the gps coordinates.
Via TeslaFi or via the tesla api, it could be possible to record also the GPS coordinates from the car.

Is there anyone who is working on such a project?

I could offer some example videos, if someone is interested.

Thanks for any comments.

Thomas

4 Likes

when you can supply MP4 and GPX file (or an other format containing GPS data) I am willing to take a look.

(I think I can easily modify my script to handle this)

1 Like

Yes, Mapillary has the Mapillry command line tools (https://github.com/mapillary/mapillary_tools) that can import video, geotag and upload. When you are sure you have your setup perfect, it can do it in one command. If you cannot get the GPS data from the car you can record it on your phone. I assume an online car like Tesla has the clock set via a time server, so it should be fairly accurate.
As you can see you can get help in this forum.

thanks for your responds.
I recorded a track with my GPS and some videos an I will supply them to eesger

1 Like

How can i sent you a link to the files per private message?

I sent you a PM

PS: are you a bit “computer handy?” Then u could install Mapillary-tools and do it all yourself!
PS2: is it OK that I send the link to @tryl also?

1 Like

Hi, yes, I’m “computer handy”, I will try :slightly_smiling_face:

And yes, you can send the link to @tryl too

Thank you and greetings from Germany
Thomas

1 Like

I’ll be happy to help if I can.

I have sent the link to @tryl.

When he is able to process the data via mapillary-tools that would be the easiest way to go for you I think. If that road proves to be a bumpy one I’ll step in :wink:

I am working on (almost) complete automate my workflow, but I am working on a Linux system for that… I think it can also be modified to run on Windows but that’ll be a “to do” then :wink:

I have taken a look at the MP4 files, the rear view will become tricky I think.
Also I tried something, but I need more info… does your Tesla take 4 images per second? Dos the provided GPX contain all the GPX data for all the sequences provided? (I have the impression it is partial, if so, please tell me which part… one system records in CEST, the other in local time… I need to match it…)

You will probably need something like

mapillary_tools sample_video --video_import_path “path/to/videos” --advanced

mapillary_tools process --advanced --import_path “path/to/.mapillary/sampled_video_frames/video_import_path” --user_name “username_at_mapillary” --geotag_source “gpx” --geotag_source_path “path/to/gpx_file” --overwrite_all_EXIF_tags --interpolate_directions

mapillary_tools upload --import_path “path/to/.mapillary/sampled_video_frames/video_import_path”

from https://github.com/mapillary/mapillary_tools. But in addition to --interpolate_directions (which I added in addition to the example) you need an argument to set in which direction the camera is pointing. This is in degrees, so
Front: 0
Back 180
Right: 90
Left 270
Between right and back: 135
Between left and back: 225

I need to find the argument when I get to another computer.
I wil also need to find the argument that ensures that the videos time stamps are treated as local time, because the GPX file is in UTC and the video is in local time.
So I’ll be back.

The above is a command for a single video file. You will need to write some bat or power shell to run a command for each file and also needs to match the correct gpx file with the video.

Thank you for asking this question, I have been considering this as well.

Because of the 60 minute roll over of the videos, besides starting a separate GPS track capture, one would also have to hit the Save button every 59 minutes.

The argument --offset_angle will set the offset angle, i.e. if the camera points straight right the value is 90 (degress) etc.

The argument --local_time will make the script assume that the gpx file is in UTC and the video file is in the computer local time zone. A great solution to an annoying problem!

Sounds annoying that the Tesla cannot be set to save all videos, tough.