Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fp16/half precision support #79

Closed
lukasc-ch opened this issue Dec 22, 2015 · 10 comments
Closed

fp16/half precision support #79

lukasc-ch opened this issue Dec 22, 2015 · 10 comments

Comments

@lukasc-ch
Copy link
Contributor

@lukasc-ch lukasc-ch commented Dec 22, 2015

What is the current status on the half precision stuff? With the Tegra X1 out, this is becoming more interesting. I have seen that @soumith has committed some first stuff with 27e969b. Is anyone working on this? I would generally be interested on contributing to this. Are there some thoughts around on how this should best be done with CudaTensor currently supporting single-precision exclusively?

@soumith
Copy link
Owner

@soumith soumith commented Dec 22, 2015

As soon as torch/cutorch#225 is merged, we can enable half precision. Should be merged this week.

@Darktex
Copy link

@Darktex Darktex commented Mar 3, 2016

Hi soumith, any progress on this?

@jcjohnson
Copy link

@jcjohnson jcjohnson commented Mar 19, 2016

Any idea when we will see FP16 support? torch/cutorch#225 Seems to have been merged a while back.

@jorditg
Copy link

@jorditg jorditg commented Apr 11, 2016

+1

@lukasc-ch
Copy link
Contributor Author

@lukasc-ch lukasc-ch commented Apr 19, 2016

FYI, stuff is moving: PR #170, and szagoruyko/cudnn.torch/fp16

@victorhcm
Copy link

@victorhcm victorhcm commented May 13, 2016

That'd be great, specially if the GTX 1080 will really support double rate at half precision.

@FuriouslyCurious
Copy link

@FuriouslyCurious FuriouslyCurious commented Jun 28, 2016

Is FP16 still under development? What is the ETA? Thanks!

@szagoruyko
Copy link
Collaborator

@szagoruyko szagoruyko commented Jun 28, 2016

@campbx there are 2 pull requests ongoing: #206 and torch/cutorch#431, fp16 is working and tested and hopefully will be merged soon after little modifications.

@jorditg
Copy link

@jorditg jorditg commented Jul 14, 2016

Hi all, I've seen that #206 and torch/cutorch#431 are ready.

When fp16 is expected to be merged?

@soumith
Copy link
Owner

@soumith soumith commented Jul 29, 2016

They've been merged now. Thanks everyone, and especially @szagoruyko

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Linked pull requests

Successfully merging a pull request may close this issue.

None yet
8 participants
You can’t perform that action at this time.