NeRF -> 3DGS moving on to new tech for 3D reconstruction

Web and notifications
1

I wonder if some move is going on from trying NeRF to the new tech of 3D Gausian Splatting?
My observation on Mapillary is that NeRF did not really pick-up.

I happened to come across a YouTube video recently about using a DJI Neo for such which caught my interest. Kiri Engine provides photogrammetry, NeRF and 3DGS. I am experimenting with it using my 2010 through 2014 imagery for Microsoft Research’s Photosynth. These didn’t NeRF well with Mapillary. First 3DGS results are not too bad.

Kiri Engine recently got API functionality and lists Meta as a client. I wonder what is going on?

I found this an informative talk by the Kiri Engine CEO https://youtu.be/d2wiQqCGGP0?si=TyVuhUGibAt6UeQc

If Mapillary continues on 3D reconstruction, then I suggest focusing the effort on objects instead of spaces. Having statues and like points of interest on the map in 3D is a great thing, I think. A lot of that imagery is likely available already.

2

@JoscTr - agreed that this field is moving quickly and that Gausian Splatting seems like promising next generation technology - this is something we’ll look at - thank you!

2 Likes
3

@boris - appreciate your response. If I understood and remember correctly, Kiri shares a lot on Github. Maybe it is of use in developing Meta’s own processing.

1 Like