-
Notifications
You must be signed in to change notification settings - Fork 271
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conclusions #370
Conclusions #370
Changes from 2 commits
File filter
Filter by extension
Conversations
Jump to
Diff view
Diff view
There are no files selected for viewing
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -1,15 +1,70 @@ | ||
## Conclusions | ||
|
||
Final thoughts and future outlook here. The Discussion will give an overview | ||
and the Conclusion will provide a short, punchy take home message. | ||
Deep learning-based methods now matches or surpasses the previous state of the | ||
art in a diverse array of tasks in patient and disease categorization, | ||
fundamental biological study, genomics, and treatment development. We return to | ||
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. "Returning to our central question": less passive There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. Yes, that's better. I changed it. |
||
our central question: given this rapid progress, has deep learning transformed | ||
the study of human disease? Though the answer is highly dependent on the | ||
specific domain and problem being addressed, we conclude that deep learning has | ||
not *yet* realized its transformative potential or induced a strategic | ||
inflection point. Despite its dominance over competing machine learning | ||
approaches in many of the areas reviewed here and quantitative improvements in | ||
predictive performance, deep learning has not yet definitively "solved" those | ||
problems. | ||
|
||
Points to mention based on discussion thus far that may make the bar for | ||
conclusions: | ||
As an analogy, consider recent progress in conversational speech recognition. | ||
Since 2009 there have been drastic performance improvements, with error rates | ||
dropping from more than 20% to less than 6% [@tag:Speech_recognition] and | ||
finally approaching or exceeding human performance in the past year | ||
[@arxiv:1610.05256 @arxiv:1703.02136] `TODO: need better source for this error | ||
trajectory`. The phenomenal improvements on benchmark datasets are undeniable, | ||
but halving the error rates on these benchmarks did not fundamentally transform | ||
the domain. Widespread adoption of conversational speech technologies will | ||
require not only improvements over baseline methods but truly solving the | ||
problem, in this case exceeding human-level performance, as well as convincing | ||
users to embrace the technology [@tag:Speech_recognition]. We see parallels to | ||
the healthcare domain, where achieving the full potential of deep learning will | ||
require outstanding predictive performance as well as acceptance and adoption by | ||
biologists and clinicians. | ||
|
||
* Limitations of data & workarounds (availability impacts on amount, etc) | ||
* Transferability of features | ||
* Strong enthusiasm for unsupervised approaches. | ||
* Right to an explanation (possibly, depends if raised in multiple areas) | ||
Some of the areas we have discussed are closer to surpassing this lofty bar than | ||
others, generally those that are more similar to the non-biomedical tasks that | ||
are now monopolized by deep learning. In medical imaging, diabetic retinopathy | ||
[@doi:10.1001/jama.2016.17216], diabetic macular edema | ||
[@doi:10.1001/jama.2016.17216], tuberculosis [@doi:10.1148/radiol.2017162326], | ||
and skin lesion [@doi:10.1038/nature21056] classifiers are highly accurate and | ||
comparable to clinician performance in the latter case. `TODO: more imaging | ||
examples or other examples that might be at or close to "transformative"?` | ||
|
||
In other domains, perfect accuracy will not be required because deep learning | ||
will be used primarily to prioritize experiments and assist discovery. For | ||
example, in chemical screening for drug discovery, a deep learning system that | ||
successfully identifies dozens or hundreds of target-specific, active small | ||
molecules from a massive search space would have immense practical value even if | ||
its overall precision is modest. In medical imaging, deep learning can point an | ||
expert to the most challenging cases that require manual review | ||
[@doi:10.1148/radiol.2017162326]. | ||
|
||
Conversely, the most challenging tasks may be those in which predictions are | ||
used directly for downstream modeling or decision-making, especially in the | ||
clinic. In addition, the stochasticity and complexity of biological systems | ||
implies that for some problems, for instance, predicting gene regulation in | ||
disease, perfect accuracy will be unattainable. `TODO: expand this paragraph?` | ||
|
||
Even if deep learning in biology and healthcare is not yet transformative today, | ||
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. ... and it's early days yet, full potential not explored, deep learning still evolving, yadda yadda yadda There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. Added a line |
||
we are extremely optimistic about its future. Given how rapidly deep learning | ||
is evolving, its full potential in biomedicine has not been explored. We have | ||
highlighted numerous challenges beyond improving training and predictive | ||
accuracy, such as preserving patient privacy and interpreting models. Ongoing | ||
research has begun to address these problems and shown they are not | ||
insurmountable. Deep learning offers the flexibility to model data in its most | ||
natural form `TODO: rephrase`, spurring creative modeling approaches that would | ||
be infeasible with other machine learning techniques. Unsupervised methods are | ||
currently less-developed than their supervised counterparts, but they may have | ||
the most potential. When deep learning algorithms can summarize very large | ||
collections of input data into interpretable models that spur scientists to ask | ||
questions that they didn't know to ask, it will be clear that deep learning has | ||
transformed biology and medicine. | ||
|
||
### Author contributions | ||
|
||
|
@@ -29,3 +84,5 @@ revisions; approved the final manuscript draft; and agreed to be accountable in | |
all aspects of the work. Individuals who did not contribute in one or more of | ||
these ways, but who did participate, are acknowledged at the end of the | ||
manuscript. | ||
|
||
`TODO: update after finalizing discussion in #369` |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
subject/verb agreement