-
Notifications
You must be signed in to change notification settings - Fork 15
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
question about how subscriptions are handled when metadata is removed #211
Comments
Hi @woollattd. Had a check in the code and it looks like these metadata records will not be deleted. Following the code (I haven't actually tried it on a real server), once it has harvested records from the remote GISC, it will try to delete metadata records one by one. The first stage of the metadata deletion is to check whether there are any users subscribed to the metadata. If so, the deletion raises an exception, which will be added as a harvesting error but will not abort the process of deleting the remaining metadata records. |
That's right. That's what happens. It seems clear to me that this will lead to the metadata getting out of synch with the true number from an originating GISC - leading to the whole global GISC catalogue system being a mess. I suspect this might be something for WMO to add guidance on. I can't find any about this anywhere. Or was it an original requirement created for OpenWIS? |
All Let me ask a follow up question. Right now, if a new metadata record gets Steve On Fri, Oct 14, 2016 at 3:31 AM, Dom Woollatt notifications@github.com
|
Hi Steve I'm not quite sure when that would happen as you say the the product already has metadata, why would it need another one? Updates to the content of current metadata should have no effect on subscriptions. The 'urn' is linked to the data, and vice versa. Metadata should only have one product (dataset) linked. It gets messy otherwise. There will be a need to remove metadata from time to time - ie product is no longer produced or has been replaced with a completely new one (with a new name). The problem here is that the old metadata will be kept in the catalogue when it has at least one subscription linked to it. This means that this metadata can still be found and subscribed to by other users, but they would never receive any data. And the more of these there are the more the catalogues between the GISCs will become out of synch. At this stage, I wouldn't want OpenWIS to automatically send replacement products. The end user might need to set up their end for any changes in product name, size etc.. , so it's best that they are notified. I believe we need some thought on how we intergrate this into OpenWIS. Maybe bring this issue up at WMO level as well, as there's no point OpenWIS covering this when others' systems might not. Like I say in my second post - i've seen no guidance on this. Cheers |
Please keep in mind that the metadata is informational regarding the actual -pat On Fri, Oct 14, 2016 at 10:19 AM, Dom Woollatt notifications@github.com
Patrick S. Gillis |
Dom: I agree that some discussions need to happen, and thanks for your Thanks! Steve On Fri, Oct 14, 2016 at 10:19 AM, Dom Woollatt notifications@github.com
|
Hi @woollattd and @solson-nws,
I bet it was a consequence on how OpenWIS links subscriptions to metadata records (you cannot get data from OpenWIS without a record - hence the use of draft metadata) along with a lack of any clear guidelines as to how to decommission metadata from the WMO. It would be interesting to see how other implementations handle this case: I cannot imagine we would be the only ones that need to cater for it. Of course it all depends on how they manage their request/subscriptions. One way we could handle this without addressing this uncertainly at the WMO level would be to do what Dom suggested and send out an automatic email to each of the subscribed users saying that data for this metadata is no longer available, remove the metadata and the associated subscriptions. The only potential problem with that is the case when the metadata might be deleted but the data feeds are still available, or the metadata is deleted by accident. We would loose the subscription information and the users will need to recreate them. Another potential way we could handle this would be to remove the metadata from the catalogue, and then immediately create a draft metadata record and reassign the subscriptions to it. That way, the record would be out of the "public" catalogue but should data for those records still be ingested by OpenWIS (which I bet would happen even though it isn't meant to), these users will still be able to get them. Anyway, something for the backlog. Thanks, Leon |
No real reason to fix this for v3, but might be worth thinking about for v4 as this is re-implemented. |
This issue was moved to OpenWIS/openwis4#56 |
reopened since OpenWIS v3.x is in maintenance mode for next 6 years so this still applies |
small question
I notice that there has been some activity with metadata in recent months around the GISCs... so
What happens when a user has subscribed to some harvested metadata that is later removed by the originating provider?
I don't seem to be able to remove metadata manually on OpenWIS when there are subscriptions attached.
Won't this cause catalogue discrepancies between the GISCs?
The text was updated successfully, but these errors were encountered: