Big different results with your post when I run your code from RNN

[Hessen525]

Hi, I have no idea why so big different results when I run exactly the same code you posted.

[Hessen525]

Thanks!

[OdysseasKr]

Hi @Hessen525 :)

I don't have your results so I can not check myself but, looking at your plot I have some points:

1. Your plot doesn't look all that bad in terms of events. That means that (from what I can see) the spikes match even if the amount of watts is not correct.
2. Please check the on_power_threshold in the metadata of NILMTK. Sometimes it happens that the threshold is too high, and thus, even if the network predicts highers wattage, it's still not that high for the device to be considered on. Hence, the metrics are worse.
3. Judging from the plot, it seems like we are not testing on the same data or the plotting behaves differently.

[Hessen525]

Hi, @OdysseasKr :

I used REDD low-frequency Dataset from http://redd.csail.mit.edu/, is that the same as yours?
Thank you so much for your reply and help!

[OdysseasKr]

Yes that is the same indeed.

[Hessen525]

Yes that is the same indeed.

Could you give me more details about how to fix it? ex: where I can check the on_power_threshold in the metadata of NILMTK?

Thanks!

[Hessen525]

Yes that is the same indeed.
GOT!
After I increased epochs from 5 to 11, the results are very close to yours. That is it!

[OdysseasKr]

Glad it worked out! The results are very similar.

For future reference, in order to access the nilmtk metadata, you need to find the files of this package which is installed automatically when you install nilmtk.

[RengarWang]

Hi, I have no idea why so big different results when I run exactly the same code you posted.

I had the same problem
my result is
============ Recall: 0.06080812748658777
============ Precision: 0.7873688147161255
============ Accuracy: 0.29049305213046556
============ F1 Score: 0.11289725264136873
============ Relative error in total energy: 0.7858544224150322
============ Mean absolute error(in Watts): 19.859596349905722

i try epochs =15 , maybe it is better.

[RengarWang]

Hi, I have no idea why so big different results when I run exactly the same code you posted.

I had the same problem
my result is
============ Recall: 0.06080812748658777
============ Precision: 0.7873688147161255
============ Accuracy: 0.29049305213046556
============ F1 Score: 0.11289725264136873
============ Relative error in total energy: 0.7858544224150322
============ Mean absolute error(in Watts): 19.859596349905722

i try epochs =15 , maybe it is better.

i got the result on epochs = 15 , but it is not good.