-
Notifications
You must be signed in to change notification settings - Fork 130
/
loss.rst
143 lines (99 loc) · 2.64 KB
/
loss.rst
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
.. _loss:
==============
Loss Functions
==============
This is a list of all loss functions that can be used by adding ``"loss": "<class_name_of_loss>"`` to a layer.
Additional input parameters to the respective loss classes can be given via ``loss_opts``.
A scale for a loss can be set via ``loss_scale`` (also see :ref:`network_define_layers`)
If the output of a loss function is needed as a part of the network,
the ``LossLayer`` can be used in combination with one of the losses.
LossLayer
---------
.. autoclass:: returnn.tf.layers.basic.LossLayer
:members:
:undoc-members:
As-Is Loss
----------
.. autoclass:: returnn.tf.layers.basic.AsIsLoss
:members:
:undoc-members:
Binary Cross-Entropy Loss
-------------------------
.. autoclass:: returnn.tf.layers.basic.BinaryCrossEntropyLoss
:members:
:undoc-members:
Bleu Loss
---------
.. autoclass:: returnn.tf.layers.basic.BleuLoss
:members:
:undoc-members:
Cross-Entropy Loss
------------------
.. autoclass:: returnn.tf.layers.basic.CrossEntropyLoss
:members:
:undoc-members:
CTC Loss
--------
.. autoclass:: returnn.tf.layers.basic.CtcLoss
:members:
:undoc-members:
Deep Clustering Loss
--------------------
.. autoclass:: returnn.tf.layers.basic.DeepClusteringLoss
:members:
:undoc-members:
Edit Distance Loss
------------------
.. autoclass:: returnn.tf.layers.basic.EditDistanceLoss
:members:
:undoc-members:
Expected Loss
-------------
.. autoclass:: returnn.tf.layers.basic.ExpectedLoss
:members:
:undoc-members:
Extern Sprint Loss
------------------
.. autoclass:: returnn.tf.layers.basic.ExternSprintLoss
:members:
:undoc-members:
Fast Baum Welch Loss
--------------------
.. autoclass:: returnn.tf.layers.basic.FastBaumWelchLoss
:members:
:undoc-members:
Generic Cross-Entropy Loss
--------------------------
.. autoclass:: returnn.tf.layers.basic.GenericCELoss
:members:
:undoc-members:
Mean-L1 Loss
-----------------------
.. autoclass:: returnn.tf.layers.basic.MeanL1Loss
:members:
:undoc-members:
Mean-Squared-Error Loss
-----------------------
.. autoclass:: returnn.tf.layers.basic.MeanSquaredError
:members:
:undoc-members:
L1 Loss
-------
.. autoclass:: returnn.tf.layers.basic.L1Loss
:members:
:undoc-members:
Sampling-Based Loss
--------------------
.. autoclass:: returnn.tf.layers.basic.SamplingBasedLoss
:members:
:undoc-members:
Triplet Loss
------------
.. autoclass:: returnn.tf.layers.basic.TripletLoss
:members:
:undoc-members:
Via Layer Loss
--------------
.. autoclass:: returnn.tf.layers.basic.ViaLayerLoss
:members:
:undoc-members: