Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Additional image segmentation view options #1188

Conversation

jmancewicz
Copy link
Contributor

@jmancewicz jmancewicz commented Oct 19, 2016

Adding view options for image segmentation.

screen shot 2016-10-19 at 12 20 01 pm

The existing Opacity slider changes the opacity of the fill region.
screen shot 2016-10-19 at 12 21 43 pm

The Mask slider changes the opacity of the non-segmented area. I find this useful to find small segments.
screen shot 2016-10-19 at 12 22 00 pm

The Threshold slider changes the moves in the distance field around segmentation boundaries.
screen shot 2016-10-19 at 12 22 18 pm

The Line Width does what you think
screen shot 2016-10-19 at 12 22 32 pm

Gamma along with the Colormap can make the grey scale medical images a little easier to read.
screen shot 2016-10-19 at 12 23 16 pm

Also, if the inference feature image comes through as a float array, and PIL won't convert it to an image, then the data is normalized to its range and converted to uint8 so that it will be converted to a PIL.Image.

@jmancewicz jmancewicz force-pushed the further-image-segmentation-view-improvement branch from 3aa49d3 to 42a6ec0 Compare October 19, 2016 22:36
@jmancewicz jmancewicz force-pushed the further-image-segmentation-view-improvement branch from 1ec311b to 98a745d Compare October 19, 2016 22:41
@gheinrich
Copy link
Contributor

Looks great! Do you think we could also apply this to the binary segmentation example? In this example the network output has shape Height x Width and each "pixel" value is a score (0->strongly think it's foreground, 255->strongly think it's background - we could reverse this if it's easier to visualize).

@jmancewicz
Copy link
Contributor Author

I'm sure we can get it to work with the binary example. I'll have a look now.

@jmancewicz
Copy link
Contributor Author

@gheinrich, I just went through the binary segmentation example, and cam up with a result similar to what you show.
screen shot 2016-10-20 at 2 07 49 pm

I thought Jon Barker's SpaceNet example had smoother gradients (I might be wrong), but moving along the gradient would be very uninteresting in this case. What exactly did you have in mind?

@gheinrich
Copy link
Contributor

Hi Joe, when we display the binary segmentation output as an image we get the image you show above with different shades of grey. Suppose you want to make a hard decision whether a given pixel is inside or outside a triangle. In that case you'll need to choose a threshold (below threshold: inside of triangle; above threshold:outside of triangle). I think it would be helpful to display this network output using the binary segmentation extension because the slider allows the user to interactively set the threshold - as in 2-class image segmentation. It's just a thought - I think your PR is already great now.

@jmancewicz jmancewicz merged commit 61b1859 into NVIDIA:master Oct 26, 2016
@jmancewicz jmancewicz deleted the further-image-segmentation-view-improvement branch October 26, 2016 22:42
lukeyeager added a commit to lukeyeager/DIGITS that referenced this pull request Oct 27, 2016
lukeyeager added a commit to lukeyeager/DIGITS that referenced this pull request Oct 27, 2016
ethantang95 pushed a commit to ethantang95/DIGITS that referenced this pull request Jul 10, 2017
…tion-view-improvement

Additional image segmentation view options
ethantang95 pushed a commit to ethantang95/DIGITS that referenced this pull request Jul 10, 2017
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants