/caffe

Sigmoid Cross-Entropy Loss: add GPU forward for full GPU mode speed-up #4908

Merged
merged 1 commit into from Oct 27, 2016

Conversation

Reviewers
No reviews
Assignees
No one assigned
Labels
speed-up
Projects
None yet
Milestone
No milestone
1 participant
@shelhamer
@shelhamer
Owner

shelhamer commented Oct 27, 2016

The sig-ce loss was somehow passed over when it came to GPU implementation, but this PR completes GPU mode by including GPU forward. This resolves a (perhaps surprisingly severe) performance penalty due to communication overhead. When the target is high-dimensional, say a whole image for an FCN, then the time to go back-and-forth could slow iterations by >10x. Not anymore!

Closes #3004.

shelhamer added the speed-up label Oct 27, 2016

@shelhamer shelhamer sigmoid cross-entropy loss: add GPU forward for full GPU mode 
close #3004

All checks have passed

2 successful checks
continuous-integration/appveyor/pr — AppVeyor build succeeded
Details
continuous-integration/travis-ci/pr — The Travis CI build passed
Details
197d11a

@shelhamer shelhamer merged commit 6491504 into BVLC:master Oct 27, 2016
2 checks passed

2 checks passed

continuous-integration/appveyor/pr AppVeyor build succeeded
Details
continuous-integration/travis-ci/pr The Travis CI build passed
Details

shelhamer deleted the shelhamer:sigce-gpu branch Oct 27, 2016

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment