If it is up to me, everybody would capture everything i 360 degrees, including garbage, poverty, open sewers, sound smell and everything. I also knows that is not possible and investing in a 360 degree camera just for mapillary is not possible for many people.
The reason I would like to see all these nasty things (and good things) is, that I like to see how people live. In some places garbage disposal is not working well and in regular slum areas most things does not work. Those problems does not go away because we do not photograph them - but photographing them may help them go away. If we only show what pleases us, all the unplessent issues are left alone.
Mapillary have a automatic blurring and it works some times. When I look at pictures to fix the blurring mistakes, I often see peoples faces. Even when walking around in a poor cuntry, the road is made of dirt, houses made of essentially garbage materials, but when I see their faces, they look happy! If they have a pig, who cares if it eats of a garbage pile. They have a pig!
The only thing that would prevent me from walking through a slum area with a 360 degree camera, would be safety and the fact that I have small kids and cannot travel right now. But I love pictures from such places!
And just at tip from me, @abhyankar: A lot of your images a blurry from a shaking camera. That often happens to me when I walk (as you do) and have the app on auto. The problem is that walking is not fluent and some times there is a lot of shaking, that may be too much even when there is plenty of light. A hole in the road is alsmost certain a shaked image.
I have started to use the manual mode when I walk. When there is enough light I can walk as normal and just take a picture when I am not putting a foot down. If there is not so much light I may stop every 10-20 meters and take a picture.