Many error messages on the Registry

[amy-silcock]

Hi,

I tried to purge the Registry today but received a timeout error, and it didn't compete.

This data file is also showing a fair few error messages. Not sure if it's related to the purging or not? https://iatiregistry.org/dataset/ec-fpi-88

[amy-silcock]

We're still getting a time out message when trying to use the purge feature:

[ss-bhat]

504 Gateway error is from nginx timeout frontend, which is set to (30sec). However, It is not recommended increasing nginx timeout.

Since, purging is a python job even after we get 504 error, when we reload the page for next time all datasets should be purged. However, there are some datasets which can't be purged using the UI due to a database error.

However, these datasets can be deleted/purged by running a paster command in ckan -

paster dataset purge <dataset id>
As a temporary solution - we will delete unpurged datasets and clear the purge queue by running a paster command in CKAN.

There is a fix coming for this issue, please see the github issue, we will incorporate this fix once it is merged with upstream ckan.

[ss-bhat]

@amy-silcock

Is it ok to purge 7 datasets in below link manually?

https://iatiregistry.org/ckan-admin/trash

[amy-silcock]

I've just tried to purge manually and get this screen:

And refreshing the page brings back the 7 files.

Yes please to delete them.

[ss-bhat]

Purge functionality is implemented in staging

[ss-bhat]

Deployed in production. Please let me know if we are good to run purge command in production. Thanks

[amy-silcock]

Hi Swaroop,

Purge is working in staging. I still get a 504 time out error in live. Yes please try it out. Do let us know if we can expect any down time.

Thank you.

[ss-bhat]

The 504 error is the time out from nginx (which is the recommended setting)- not from the CKAN. So if you refresh the page after a couple of minutes, all dataset should be purged.

This 504 time out error occurs when there is a lots of items to purge which takes more than 30 sec.

If you visit the trash page now all datasets should be purged. Please let me know if this is not the case. Thanks

[ss-bhat]

Closing the issue - please reopen if you face any issues.