<p>Sorry I'm not an expert. Since there hasn't been a response on this and if you are still looking, the vocabulary I would use to describe this type of problem is <a href="https://arxiv.org/pdf/1703.04309.pdf" rel="nofollow noreferrer">disparity networks</a> and segmentation. Your best bet may be a specific type of disparity network: <a href="https://lmb.informatik.uni-freiburg.de/people/ronneber/u-net/" rel="nofollow noreferrer">U-net</a> </p>
(Tensorflow) What is the correct NN needed for this task?
<p>I'm about to start developing a neural net here with Tensorflow, but before I get into it too deep, I was hoping I could get some feedback on exactly what type of neural net I will need for this (If a net is the right way to go about this at all) </p>

<p>I need the NN to input an image, and output another image. This will be used for path-mapping on a robot I'm working on. The input image will be a <a href="https://stackoverflow.com/questions/17607312/difference-between-disparity-map-and-disparity-image-in-stereo-matching">disparity map</a>, and the output will be a "driveable map" (an image that displays what in the scene can be driven on, and what can't)</p>

<p>I have built a dataset using Unity 3d. Here is an example from the set:</p>

<p>disparity map</p>

<p><a href="https://i.stack.imgur.com/s6NK6.png" rel="nofollow noreferrer"><img src="https://i.stack.imgur.com/s6NK6.png" alt="Disparity Map"></a></p>

<p>driveable map:</p>

<p><a href="https://i.stack.imgur.com/UsYlR.png" rel="nofollow noreferrer"><img src="https://i.stack.imgur.com/UsYlR.png" alt="Driveable map"></a></p>

<p>As you can probably see, white represents the area where my robot can drive and black is where it can't. I will need the NN to take a disparity map, and give me back a "driveable map". Can this be done?
     Thanks!</p>