Trained on own datase but loss does not drop !

[holicc]

I want to use this model to detect the similarity of the two people's handwriting signature . so i made dataset just like 2afc.

train on net-lin + alex

(ep: 9, it: 20000, t: 0.003[s], ept: 0.16/0.55[h]) loss_total: 0.564, acc_r: 0.680
(ep: 9, it: 25000, t: 0.003[s], ept: 0.20/0.56[h]) loss_total: 0.556, acc_r: 0.700
(ep: 9, it: 30000, t: 0.003[s], ept: 0.25/0.58[h]) loss_total: 0.525, acc_r: 0.780
(ep: 9, it: 35000, t: 0.003[s], ept: 0.30/0.60[h]) loss_total: 0.570, acc_r: 0.720
(ep: 9, it: 40000, t: 0.003[s], ept: 0.35/0.62[h]) loss_total: 0.511, acc_r: 0.800
(ep: 9, it: 45000, t: 0.003[s], ept: 0.42/0.65[h]) loss_total: 0.674, acc_r: 0.660
(ep: 9, it: 50000, t: 0.003[s], ept: 0.48/0.67[h]) loss_total: 0.545, acc_r: 0.700
(ep: 9, it: 55000, t: 0.003[s], ept: 0.54/0.69[h]) loss_total: 0.548, acc_r: 0.720
(ep: 9, it: 60000, t: 0.003[s], ept: 0.62/0.72[h]) loss_total: 0.626, acc_r: 0.660
(ep: 9, it: 65000, t: 0.003[s], ept: 0.69/0.75[h]) loss_total: 0.606, acc_r: 0.640
(ep: 9, it: 70000, t: 0.003[s], ept: 0.77/0.77[h]) loss_total: 0.516, acc_r: 0.720
(ep: 10, it: 5000, t: 0.003[s], ept: 0.03/0.38[h]) loss_total: 0.447, acc_r: 0.800
(ep: 10, it: 10000, t: 0.003[s], ept: 0.05/0.38[h]) loss_total: 0.500, acc_r: 0.800
(ep: 10, it: 15000, t: 0.003[s], ept: 0.10/0.48[h]) loss_total: 0.484, acc_r: 0.840
(ep: 10, it: 20000, t: 0.003[s], ept: 0.15/0.52[h]) loss_total: 0.523, acc_r: 0.760
(ep: 10, it: 25000, t: 0.003[s], ept: 0.20/0.56[h]) loss_total: 0.579, acc_r: 0.700
(ep: 10, it: 30000, t: 0.003[s], ept: 0.25/0.59[h]) loss_total: 0.609, acc_r: 0.620
(ep: 10, it: 35000, t: 0.003[s], ept: 0.31/0.63[h]) loss_total: 0.544, acc_r: 0.760
(ep: 10, it: 40000, t: 0.003[s], ept: 0.38/0.67[h]) loss_total: 0.613, acc_r: 0.660
(ep: 10, it: 45000, t: 0.003[s], ept: 0.45/0.70[h]) loss_total: 0.569, acc_r: 0.700
(ep: 10, it: 50000, t: 0.003[s], ept: 0.52/0.74[h]) loss_total: 0.567, acc_r: 0.660
(ep: 10, it: 55000, t: 0.003[s], ept: 0.59/0.75[h]) loss_total: 0.651, acc_r: 0.600
(ep: 10, it: 60000, t: 0.003[s], ept: 0.66/0.77[h]) loss_total: 0.492, acc_r: 0.780
(ep: 10, it: 65000, t: 0.003[s], ept: 0.73/0.79[h]) loss_total: 0.547, acc_r: 0.720
(ep: 10, it: 70000, t: 0.003[s], ept: 0.81/0.81[h]) loss_total: 0.608, acc_r: 0.660