Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Obtain new EntityFacts dump #210

Closed
acka47 opened this issue Jul 11, 2019 · 10 comments

Comments

@acka47
Copy link
Contributor

commented Jul 11, 2019

This request by D.G. from Bonn came in via email today (snippet):

Heute aber bin ich
etwas überrascht, weil ich auf der Suche nach Friedman, Batya
(GND-Nummer 1187201553 oder 152687629) keine Verknüpfungen zu VIAF, LOC
oder anderen Datenbanken vorhanden sind, obwohl Frau Friedman dort zu
finden ist:

https://viaf.org/viaf/77828351/

Ich hoffe, Sie können das wahrscheinlich technische Problem lösen und
die fehlende Verknüpfung ohne großen Aufwand einarbeiten.

It looks like the person did not have an EntityFacts entry by the time the last dump was created (2019-03-05) (see #183). However, by now such an entry exists, see https://hub.culturegraph.org/entityfacts/1187201553

@acka47 acka47 self-assigned this Jul 11, 2019

@acka47 acka47 added this to Backlog in lobid board via automation Jul 11, 2019

@acka47 acka47 added the upstream label Jul 11, 2019

@acka47

This comment has been minimized.

Copy link
Contributor Author

commented Jul 11, 2019

I wrote a request to the lds list, see https://lists.dnb.de/pipermail/lds/2019-July/000147.html.

@acka47 acka47 moved this from Backlog to Working in lobid board Jul 12, 2019

@acka47

This comment has been minimized.

Copy link
Contributor Author

commented Jul 12, 2019

DNB responded that there will be a nw EntityFacts dump next week. However, as we are only interested in the depiction and sameAs information from EntityFacts (see #44), I figured the best solution would be if DNB send us the monthly updated enrichment file created from all the BEACON files, VIAF and Wikidata as described in https://wiki.dnb.de/display/LINKEDDATASERVICE/Anreicherungen. I sent an enquiry to datendienste whether this is feasible.

@acka47

This comment has been minimized.

Copy link
Contributor Author

commented Jul 29, 2019

A new dump is now available:

Am 29.07.19 um 10:30 schrieb Datendienste:

Sehr geehrte Damen und Herren,
Liebe Kolleginnen, liebe Kollegen,
nach einigen Schwierigkeiten steht Ihnen jetzt auch der aktualisierte
Gesamtabzug der Daten des Services „Entity Facts“[1] zur Verfügung[2].
Ich bedanke mich bei Ihnen für Ihre Geduld und bei meinen Kollegen für
Ihre Hartnaeckigkeit.
Mit freundlichen Grüßen
i.A.
Uta Ackermann
[1]https://www.dnb.de/entityfacts
[2]https://data.dnb.de/opendata/

@acka47 acka47 added upstream and removed upstream labels Jul 29, 2019

@acka47

This comment has been minimized.

Copy link
Contributor Author

commented Jul 29, 2019

@fsteeg, I keep this open until the data is updated in lobid-gnd. I think @dr0i usually set up the EntityFacts index. Can you take over this taks this time?

@acka47 acka47 moved this from Working to Ready in lobid board Jul 29, 2019

@acka47 acka47 assigned fsteeg and unassigned acka47 Jul 30, 2019

@fsteeg

This comment has been minimized.

Copy link
Member

commented Aug 1, 2019

Assigning @dr0i for next week. If he doesn't have time, I'll do it later next week.

@fsteeg fsteeg assigned dr0i and unassigned fsteeg Aug 1, 2019

@dr0i

This comment has been minimized.

Copy link
Contributor

commented Aug 5, 2019

Buildt new entityfacts-index, switched alias. I think the gnd-index need a complete rebuild, don't see how to do this in the crontab - there only updates are described.
Assigning @fsteeg, also: could you paste into the crontab how to trigger a fulldump index build ?

@dr0i dr0i assigned fsteeg and unassigned dr0i Aug 5, 2019

@dr0i dr0i removed the upstream label Aug 5, 2019

@fsteeg

This comment has been minimized.

Copy link
Member

commented Aug 12, 2019

Assigning @fsteeg, also: could you paste into the crontab how to trigger a fulldump index build ?

I think there are two things we should do here to make this fully automatable:

- [ ] Move GND indexing into a separate main (currently done as part of the app startup process) #213
- [ ] Move EntityFacts indexing into lobid-gnd (currently done in lobid-resources) #214

@fsteeg fsteeg moved this from Ready to Working in lobid board Aug 12, 2019

fsteeg added a commit that referenced this issue Aug 15, 2019

Remove faulty second argument for ConvertUpdates
Interval from config was ignored, resulting in HTTP 413 errors,
removing since we don't actually have a use case for this.

See #210
@fsteeg

This comment has been minimized.

Copy link
Member

commented Aug 16, 2019

Deployed to test: http://test.lobid.org/gnd/1187201553 (http://test.lobid.org/gnd/search)

(But it seems the VIAF link already got there in some other way: http://lobid.org/gnd/1187201553)

@fsteeg fsteeg assigned acka47 and unassigned fsteeg Aug 16, 2019

@fsteeg fsteeg moved this from Working to Review in lobid board Aug 16, 2019

@acka47

This comment has been minimized.

Copy link
Contributor Author

commented Aug 20, 2019

(But it seems the VIAF link already got there in some other way: http://lobid.org/gnd/1187201553)

The VIAF and ISNI links are meanwhile also in the GND RDF, see https://d-nb.info/gnd/1187201553/about/lds.ttl.

In https://hypothes.is/a/bmBf8sKBEemssUsuLRMriQ a missing depiction link for Berlin was reported. It will be there after deployment to production (see http://test.lobid.org/gnd/4005728-8.).

+1 for deploying

@acka47 acka47 removed their assignment Aug 20, 2019

@fsteeg

This comment has been minimized.

Copy link
Member

commented Aug 20, 2019

Deployed current data to production, closing. See http://lobid.org/gnd/search

@fsteeg fsteeg closed this Aug 20, 2019

lobid board automation moved this from Review to Done Aug 20, 2019

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
3 participants
You can’t perform that action at this time.