# Suggestions for computer vision features **URL:** \ **Category:** Uncategorized\ **Created:** [August 26, 2015, 12:57pm UTC](https://forum.mapillary.com/t/suggestions-for-computer-vision-features/58 "2015-08-26T12:57:10Z")\ **Posts on this page:** 13\ **Page:** 1
**Author:** ![jesolem](https://sea1.discourse-cdn.com/flex015/user_avatar/forum.mapillary.com/jesolem/32/52_2.png) [@jesolem](https://forum.mapillary.com/u/jesolem)\ **Post date:** [August 26, 2015, 12:57pm UTC](https://forum.mapillary.com/t/suggestions-for-computer-vision-features/58/1 "2015-08-26T12:57:10Z")
What are your favorite suggestions for Mapillary features using computer vision? Let’s discuss here. Some suggestions: - Automatic detection of car hoods and other vehicle parts in sequences. Then we soft crop or hide these regions. - Visual image search. Mark a region in an image and find other images with the same/similar object across all of Mapillary. - Automatic object tagging (with user feedback and suggestions for objects). - Blur detection. To flag images to hide. Add your ideas! Ideas collected from replies below: - Detect reflections on wind shields ---
**Author:** ![yubin](https://sea1.discourse-cdn.com/flex015/user_avatar/forum.mapillary.com/yubin/32/60_2.png) [@yubin](https://forum.mapillary.com/u/yubin)\ **Post date:** [August 26, 2015, 2:06pm UTC](https://forum.mapillary.com/t/suggestions-for-computer-vision-features/58/2 "2015-08-26T14:06:04Z")
One more idea is to do text detection and OCR, so we can also extract semantic information from images. ---
**Author:** ![tryl](https://sea1.discourse-cdn.com/flex015/user_avatar/forum.mapillary.com/tryl/32/62_2.png) [@tryl](https://forum.mapillary.com/u/tryl)\ **Post date:** [August 26, 2015, 5:41pm UTC](https://forum.mapillary.com/t/suggestions-for-computer-vision-features/58/4 "2015-08-26T17:41:09Z")
Many pictures taken from within a car has some or a lo of the dash board visible. Perhaps it would be possible to detect this and crop the series? Of cause the dash board changes between pictures, when the light changes, but it is usually very little between individual images. The change is more when you turn or the Sun changes. ---
**Author:** ![de\_vries](https://avatars.discourse-cdn.com/v4/letter/d/858c86/32.png) [@de\_vries](https://forum.mapillary.com/u/de_vries)\ **Post date:** [August 26, 2015, 8:07pm UTC](https://forum.mapillary.com/t/suggestions-for-computer-vision-features/58/5 "2015-08-26T20:07:03Z")
detect reflections on wind shields. [Removing reflections from photos taken through windows | MIT News | Massachusetts Institute of Technology](http://news.mit.edu/2015/algorithm-removes-reflections-photos-0511) ---
**Author:** ![jesolem](https://sea1.discourse-cdn.com/flex015/user_avatar/forum.mapillary.com/jesolem/32/52_2.png) [@jesolem](https://forum.mapillary.com/u/jesolem)\ **Post date:** [August 27, 2015, 7:33am UTC](https://forum.mapillary.com/t/suggestions-for-computer-vision-features/58/6 "2015-08-27T07:33:58Z")
Yup. Getting rid of car parts is top of my wish list! Definitely doable if we can just carve out enough time to work on it. We can try to detect in the apps at capture and warn “consider adjusting your camera placement” too. ---
**Author:** ![tryl](https://sea1.discourse-cdn.com/flex015/user_avatar/forum.mapillary.com/tryl/32/62_2.png) [@tryl](https://forum.mapillary.com/u/tryl)\ **Post date:** [August 27, 2015, 8:27am UTC](https://forum.mapillary.com/t/suggestions-for-computer-vision-features/58/7 "2015-08-27T08:27:33Z")
If you get it working well enough, it would be nice to run it on the existing images. I have several times let some dash board show purposely, because the clouds in the sky would make the auto exposure let the images become way too dark. But a warning would be good too. I have tried hard to avoid dash board and still gotten it several times. ---
**Author:** ![waldyrious](https://sea1.discourse-cdn.com/flex015/user_avatar/forum.mapillary.com/waldyrious/32/68305_2.png) [@waldyrious](https://forum.mapillary.com/u/waldyrious)\ **Post date:** [August 28, 2015, 1:07pm UTC](https://forum.mapillary.com/t/suggestions-for-computer-vision-features/58/8 "2015-08-28T13:07:19Z")
> [@jesolem](#): > > warn “consider adjusting your camera placement” too. The main issue I get is not the dashboard itself, but its reflection in the windshield, as @de_vries pointed out. Oftentimes no amount of repositioning gets me rid of it without losing large portions of the scene. It would be great to have a system for removing not only the dashboards, but their reflections as well (and while we’re at it, raindrops and other kinds of mostly static obstructions too). ---
**Author:** ![jesolem](https://sea1.discourse-cdn.com/flex015/user_avatar/forum.mapillary.com/jesolem/32/52_2.png) [@jesolem](https://forum.mapillary.com/u/jesolem)\ **Post date:** [August 28, 2015, 1:15pm UTC](https://forum.mapillary.com/t/suggestions-for-computer-vision-features/58/9 "2015-08-28T13:15:18Z")
> [@waldyrious](#): > > The main issue I get is not the dashboard itself, but its reflection in the windshield, as @de_vries pointed out. Oftentimes no amount of repositioning gets me rid of it without losing large portions of the scene. Someone suggested black T-shirt (or cloth would do) on the dashboard to get rid of reflections. Haven’t tried but sounds reasonable. ---
**Author:** ![tryl](https://sea1.discourse-cdn.com/flex015/user_avatar/forum.mapillary.com/tryl/32/62_2.png) [@tryl](https://forum.mapillary.com/u/tryl)\ **Post date:** [August 30, 2015, 9:47am UTC](https://forum.mapillary.com/t/suggestions-for-computer-vision-features/58/10 "2015-08-30T09:47:20Z")
I just browsed this sequence: [http://www.mapillary.com/map/im/DJ7J4nAdEtN2SwSxBD7g7Q/photo](http://www.mapillary.com/map/im/DJ7J4nAdEtN2SwSxBD7g7Q/photo) and thought that removal of animals and drops of water on a wind shield would be great. Mapillary gets a lot of images that would never hit a service like Google Streetview, but some of the errors can probably be fixed. I know you computer vision guys don’t do magic, but you can make it look like that and that is good enough. ---
**Author:** ![Polyglot](https://avatars.discourse-cdn.com/v4/letter/p/c57346/32.png) [@Polyglot](https://forum.mapillary.com/u/Polyglot)\ **Post date:** [November 17, 2015, 9:48am UTC](https://forum.mapillary.com/t/suggestions-for-computer-vision-features/58/11 "2015-11-17T09:48:07Z")
I’d like to see these two: - Visual image search. Mark a region in an image and find other images with the same/similar object across all of Mapillary. Sounds like an expensive operation though… - Automatic object tagging (with user feedback and suggestions for objects). This would be wonderful. I’d probable ‘teach’ it to recognize our local bus stop signs and shelters. Or those signs that indicate there is an underground hydrant. Those make good spatial reference points, so I go out of my way to make pictures of them. Speaking of reference points. Are you still working on creating a DB of ‘recurring objects’? That’s probably a question for a separate thread though. ---
**Author:** ![jesolem](https://sea1.discourse-cdn.com/flex015/user_avatar/forum.mapillary.com/jesolem/32/52_2.png) [@jesolem](https://forum.mapillary.com/u/jesolem)\ **Post date:** [November 24, 2015, 1:22pm UTC](https://forum.mapillary.com/t/suggestions-for-computer-vision-features/58/12 "2015-11-24T13:22:00Z")
Hi @Polyglot We are actually looking into both of your suggestions. Visual search is not as expensive as it sounds. Object tagging requires some infrastructure work. We’ll keep you posted on progress. Thanks ---
**Author:** ![Kozuch](https://avatars.discourse-cdn.com/v4/letter/k/3da27b/32.png) [@Kozuch](https://forum.mapillary.com/u/Kozuch)\ **Post date:** [August 18, 2017, 12:06pm UTC](https://forum.mapillary.com/t/suggestions-for-computer-vision-features/58/13 "2017-08-18T12:06:45Z")
I have got a suggestion for discussion here: [Using computer vision (monocular odometry) to correct vehicle path](http://mapillary.trydiscourse.com/t/using-computer-vision-monocular-odometry-to-correct-vehicle-path/1126) Will appreciate any replies! ---
**Author:** ![StephaneP](https://avatars.discourse-cdn.com/v4/letter/s/71c47a/32.png) [@StephaneP](https://forum.mapillary.com/u/StephaneP)\ **Post date:** [August 19, 2017, 8:34am UTC](https://forum.mapillary.com/t/suggestions-for-computer-vision-features/58/14 "2017-08-19T08:34:05Z")
I’ve already try to correct the pictures’ exposure, but it’s difficult to do it automaticaly. Could computer vision help for this ? With the classification you compute on all pictures, it could be easier to exclude unuseful features like clouds, sky, to correct the exposure ?