Indicate journal frequency with dct:accrualPriodicity & controlled values #59

acka47 · 2016-03-09T11:03:19Z

I just learned that there are controlled values in ZDB data for frequency information. I will investigate this so that we can also add this to the RDF.

acka47 · 2016-07-25T13:38:00Z

In the DINI KIM context it was proposed to use dcterms:accrualPeriodicity and values from http://marc21rdf.info/terms/continuingfrequency# (which probably is a SKOS version of this list). http://marc21rdf.info/ is currently down, though...

acka47 · 2016-07-25T13:39:32Z

The source field probably is 406. From the MAB documentation:


406       NORMIERTER ERSCHEINUNGSVERLAUF

          Indikator:
          blank = nicht spezifiziert
          a     = abgeschlossenes Erscheinen
          b     = fortlaufendes Erscheinen

          Unterfelder:
          Beginngruppe:
          $5    = Parallele Zaehlung
          $f    = Sachliche Benennung
          $d    = Bandzaehlung
          $e    = Heft
          $b    = Tag
          $c    = Monat
          $j    = Berichtszeit bzw. Erscheinungszeit
          $h    = Abweichende Erscheinungszeit
          $g    = Kommentar zur Beginngruppe

          Endegruppe:
          $n    = Bandzaehlung
          $o    = Heft
          $l    = Tag
          $m    = Monat
          $k    = Berichtszeit bzw. Erscheinungszeit
          $i    = Abweichende Erscheinungszeit
          $q    = Kommentar zur Endegruppe

acka47 · 2016-08-19T11:39:02Z

http://marc21rdf.info/ is up again. Here is the controlled value list for frequency of continuing resources in turtle:

@prefix rdf: <http://www.w3.org/1999/02/22-rdf-syntax-ns#> .
@prefix : <http://www.w3.org/2004/02/skos/core#> .
@prefix rdfs: <http://www.w3.org/2000/01/rdf-schema#> .
@prefix dc: <http://purl.org/dc/elements/1.1/> .
@prefix reg: <http://metadataregistry.org/uri/schema/registry/> .

<http://marc21rdf.info/terms/continuingfre#>
    dc:title "MARC21-008: Frequency of continuing resource" ;
    a :ConceptScheme .

<http://marc21rdf.info/terms/continuingfre#%23>
    reg:identifier <http://marc21rdf.info/terms/3853> ;
    reg:status <http://metadataregistry.org/uri/RegStatus/1001> ;
    a :Concept ;
    :inScheme <http://marc21rdf.info/terms/continuingfre#> ;
    :notation "#"@en ;
    :prefLabel "no determinable frequency"@en .

<http://marc21rdf.info/terms/continuingfre#a>
    reg:identifier <http://marc21rdf.info/terms/3854> ;
    reg:status <http://metadataregistry.org/uri/RegStatus/1001> ;
    a :Concept ;
    :definition "Once a year."@en ;
    :inScheme <http://marc21rdf.info/terms/continuingfre#> ;
    :notation "a"@en ;
    :prefLabel "annual"@en .

<http://marc21rdf.info/terms/continuingfre#b>
    reg:identifier <http://marc21rdf.info/terms/3855> ;
    reg:status <http://metadataregistry.org/uri/RegStatus/1001> ;
    a :Concept ;
    :definition "Every two months."@en ;
    :inScheme <http://marc21rdf.info/terms/continuingfre#> ;
    :notation "b"@en ;
    :prefLabel "bimonthly"@en ;
    :scopeNote "Includes 6, 7, or 8 times a year."@en .

<http://marc21rdf.info/terms/continuingfre#c>
    reg:identifier <http://marc21rdf.info/terms/3856> ;
    reg:status <http://metadataregistry.org/uri/RegStatus/1001> ;
    a :Concept ;
    :definition "Twice a week."@en ;
    :inScheme <http://marc21rdf.info/terms/continuingfre#> ;
    :notation "c"@en ;
    :prefLabel "semiweekly"@en .

<http://marc21rdf.info/terms/continuingfre#d>
    reg:identifier <http://marc21rdf.info/terms/3857> ;
    reg:status <http://metadataregistry.org/uri/RegStatus/1001> ;
    a :Concept ;
    :definition "Once a day."@en ;
    :inScheme <http://marc21rdf.info/terms/continuingfre#> ;
    :notation "d"@en ;
    :prefLabel "daily"@en ;
    :scopeNote "Includes Saturday and Sunday."@en .

<http://marc21rdf.info/terms/continuingfre#e>
    reg:identifier <http://marc21rdf.info/terms/3858> ;
    reg:status <http://metadataregistry.org/uri/RegStatus/1001> ;
    a :Concept ;
    :definition "Every two weeks."@en ;
    :inScheme <http://marc21rdf.info/terms/continuingfre#> ;
    :notation "e"@en ;
    :prefLabel "biweekly"@en .

<http://marc21rdf.info/terms/continuingfre#f>
    reg:identifier <http://marc21rdf.info/terms/3859> ;
    reg:status <http://metadataregistry.org/uri/RegStatus/1001> ;
    a :Concept ;
    :definition "Twice a year."@en ;
    :inScheme <http://marc21rdf.info/terms/continuingfre#> ;
    :notation "f"@en ;
    :prefLabel "semiannual"@en .

<http://marc21rdf.info/terms/continuingfre#g>
    reg:identifier <http://marc21rdf.info/terms/3860> ;
    reg:status <http://metadataregistry.org/uri/RegStatus/1001> ;
    a :Concept ;
    :definition "Every two years."@en ;
    :inScheme <http://marc21rdf.info/terms/continuingfre#> ;
    :notation "g"@en ;
    :prefLabel "biennial"@en .

<http://marc21rdf.info/terms/continuingfre#h>
    reg:identifier <http://marc21rdf.info/terms/3861> ;
    reg:status <http://metadataregistry.org/uri/RegStatus/1001> ;
    a :Concept ;
    :definition "Every three years."@en ;
    :inScheme <http://marc21rdf.info/terms/continuingfre#> ;
    :notation "h"@en ;
    :prefLabel "triennial"@en .

<http://marc21rdf.info/terms/continuingfre#i>
    reg:identifier <http://marc21rdf.info/terms/3862> ;
    reg:status <http://metadataregistry.org/uri/RegStatus/1001> ;
    a :Concept ;
    :inScheme <http://marc21rdf.info/terms/continuingfre#> ;
    :notation "i"@en ;
    :prefLabel "three times a week"@en .

<http://marc21rdf.info/terms/continuingfre#j>
    reg:identifier <http://marc21rdf.info/terms/3863> ;
    reg:status <http://metadataregistry.org/uri/RegStatus/1001> ;
    a :Concept ;
    :inScheme <http://marc21rdf.info/terms/continuingfre#> ;
    :notation "j"@en ;
    :prefLabel "three times a month"@en .

<http://marc21rdf.info/terms/continuingfre#k>
    reg:identifier <http://marc21rdf.info/terms/3864> ;
    reg:status <http://metadataregistry.org/uri/RegStatus/1001> ;
    a :Concept ;
    :definition "More frequent than daily."@en ;
    :inScheme <http://marc21rdf.info/terms/continuingfre#> ;
    :notation "k"@en ;
    :prefLabel "continuously updated"@en .

<http://marc21rdf.info/terms/continuingfre#m>
    reg:identifier <http://marc21rdf.info/terms/3865> ;
    reg:status <http://metadataregistry.org/uri/RegStatus/1001> ;
    a :Concept ;
    :inScheme <http://marc21rdf.info/terms/continuingfre#> ;
    :notation "m"@en ;
    :prefLabel "monthly"@en ;
    :scopeNote "Includes 9, 10, 11, or 12 times a year."@en .

<http://marc21rdf.info/terms/continuingfre#q>
    reg:identifier <http://marc21rdf.info/terms/3866> ;
    reg:status <http://metadataregistry.org/uri/RegStatus/1001> ;
    a :Concept ;
    :definition "Every three months."@en ;
    :inScheme <http://marc21rdf.info/terms/continuingfre#> ;
    :notation "q"@en ;
    :prefLabel "quarterly"@en ;
    :scopeNote "Includes 4 times a  year."@en .

<http://marc21rdf.info/terms/continuingfre#s>
    reg:identifier <http://marc21rdf.info/terms/3867> ;
    reg:status <http://metadataregistry.org/uri/RegStatus/1001> ;
    a :Concept ;
    :definition "Twice a month."@en ;
    :inScheme <http://marc21rdf.info/terms/continuingfre#> ;
    :notation "s"@en ;
    :prefLabel "semimonthly"@en .

<http://marc21rdf.info/terms/continuingfre#t>
    reg:identifier <http://marc21rdf.info/terms/3868> ;
    reg:status <http://metadataregistry.org/uri/RegStatus/1001> ;
    a :Concept ;
    :inScheme <http://marc21rdf.info/terms/continuingfre#> ;
    :notation "t"@en ;
    :prefLabel "three times a year"@en .

<http://marc21rdf.info/terms/continuingfre#u>
    reg:identifier <http://marc21rdf.info/terms/3869> ;
    reg:status <http://metadataregistry.org/uri/RegStatus/1001> ;
    a :Concept ;
    :inScheme <http://marc21rdf.info/terms/continuingfre#> ;
    :notation "u"@en ;
    :prefLabel "unknown"@en .

<http://marc21rdf.info/terms/continuingfre#w>
    reg:identifier <http://marc21rdf.info/terms/3870> ;
    reg:status <http://metadataregistry.org/uri/RegStatus/1001> ;
    a :Concept ;
    :definition "Once a week."@en ;
    :inScheme <http://marc21rdf.info/terms/continuingfre#> ;
    :notation "w"@en ;
    :prefLabel "weekly"@en .

<http://marc21rdf.info/terms/continuingfre#z>
    reg:identifier <http://marc21rdf.info/terms/3871> ;
    reg:status <http://metadataregistry.org/uri/RegStatus/1001> ;
    a :Concept ;
    :definition "Frequency other than annual, bimonthly, semiweekly, daily, biweekly, semiannual, biennial, triennial, three times a week, three times a month, continuously updated, monthly, quarterly, semimonthly, three times a year, weekly."@en ;
    :inScheme <http://marc21rdf.info/terms/continuingfre#> ;
    :notation "z"@en ;
    :prefLabel "other"@en .

<http://metadataregistry.org/uri/RegStatus/1001>
    a :Concept ;
    :prefLabel "Published"@en .

acka47 · 2016-08-23T14:19:37Z

The source field probably is 406

No, it's not. In the ZDB it is Pica+ field 018@.a, see the documentation which also includes the code list:

d täglich
t drei- bis fünfmal wöchentlich
c zweimal wöchentlich
w wöchentlich
e vierzehntäglich
s halbmonatlich
m monatlich
b alle zwei Monate
q vierteljährlich
f halbjährlich
a jährlich
i dreimal im Jahr
j dreimal im Monat
g alle zwei Jahre
h alle drei Jahre
z unregelmässig

ZDB also implements the RDF approach we would like to implement, e.g. 018@ $aw becomes dcterms:accrualPeriodicity <http://marc21rdf.info/terms/continuingfre%23w> in RDF (example).

I can not find the controlled values in hbz Aleph export data, though, see for example http://lobid.org/hbz01/HT001387709. (I can neither find the information in the DNB MARC XML, see e.g. http://d-nb.info/011172355/about/marcxml where it should be in fields 853-855, subfield w.)

If I am right and the information is not part of the hbz data, we won't be able to implement this.

acka47 · 2016-11-02T12:42:33Z

I found it in 052, 8-10. From the MAB documentation:

052       VEROEFFENTLICHUNGSSPEZIFISCHE ANGABEN ZU FORTLAUFENDEN  SAMMELWERKEN


...

         8-10  Erscheinungsweise
               d = taeglich
               t = drei- bis fuenfmal woechentlich
               c = zweimal woechentlich
               w = woechentlich
               e = vierzehntaegig
               s = halbmonatlich
               m = monatlich
               b = alle zwei Monate
               q = vierteljaehrlich
               f = halbjaehrlich
               a = jaehrlich
               g = alle zwei Jahre
               h = alle drei Jahre
               z = unregelmaessig oder sonstige Erscheinungsweise

Regarding the matichng, the abbreviations are the same except for Mab t ("drei- bis fuenfmal woechentlich") which has no direct match in the MARC codes i suggest using MARC i ("three times a week") instead as it is a very close match:

acka47 · 2016-12-08T09:59:17Z

We could also use bf:frequency as property.

ChristophEwertowski · 2017-01-25T16:04:53Z

I second the use of bibframe frequency. We aren't limited to a specific set of controlled values with that.

dr0i · 2017-02-07T13:24:55Z

Not sure about the labels.json entry - we already have a frequency. Is this good:

"label": "Erscheinungfrequenz",
"name": "publicationFrequency"` ?

? Here the complete entries:

{
    "uri": "http://rdaregistry.info/Elements/u/P60538",
    "label": "Erscheinungsweise",
    "name": "frequency",
    "referenceType": "String",
    "container": "@set",
    "multilangLabel": { }
},
{
    "uri": "http://id.loc.gov/ontologies/bibframe/frequency",
    "label": "Erscheinungfrequenz",
    "name": "publicationFrequency",
    "referenceType": "String",
    "container": "@set",
    "multilangLabel": { }
},

ChristophEwertowski · 2017-02-07T14:03:37Z

+1 without the Erscheinungsfrequenz wrongly spelled (missing s). For non-libriarians the term is more explicit than Erscheinungsweise.

- update labels providing German labels See #59.

ChristophEwertowski · 2017-03-28T12:36:39Z

Problem solved on data side, see http://test.lobid.org/resources/search?q=publication.frequency.label:terms&format=json or example resource (test) / example resource (production). I suppose that it is not shown in the frontend because the webpage is still cached (the labels.json has the URL in it). Right @fsteeg or @dr0i ?

acka47 · 2017-03-29T09:22:01Z

The problem I noted in #59 (comment) and via chat is still existent.

Take for example HT015427971 (source, test). 052 looks like this:

<controlfield tag="052">p||||||tz||||||</controlfield>

In position 0, we have a p. Positions 1-6 are empty. Position 7 has the t, and at 8 we have z. As the frequency is taken from positions 8 to 10, the frequency indicator is z which means "unregelmaessig oder sonstige Erscheinungsweise" = http://marc21rdf.info/terms/continuingfre#z. This corresponds with the publication note which says "Periodizität: 3x jährl., bis 2009: 2x jährl.". Currently, the value is taken from position 7, i.e. t which results in the – incorrect – frequency "drei- bis fünfmal wöchentlich", see the data on test.

Systematically, a lot of entries are wrong as position 7 is taken where you find the values that could all be in position 8. From the MAB documentation:

 7  Publikationsstatus
               a = fortlaufende Publikation ohne geplanten
                   Abschluss
               f = Titelaenderung
               t = eingestelltes Erscheinen
               z = keine Angabe moeglich

That is why we have so much http://marc21rdf.info/terms/continuingfre#i in the data as t seems to be the most used value in 052, position 7.

As a consequence, we have to add a period at each | part in

lobid-resources/src/main/resources/morph-hbz01-to-lobid.xml

Line 697 in 747f81a

    
           <regexp match="^.......t|^........t|^.........t" format="http://marc21rdf.info/terms/continuingfre#i"/>

to get the correct values.

Resolves last part of #59 (#59 (comment))

ChristophEwertowski · 2017-04-03T07:11:31Z

The last commit should fix it: Example (production) / example (test).

ChristophEwertowski · 2017-04-03T07:19:12Z

An issue was opened for the wrongly shown frequency ids (#362).

acka47 · 2017-04-03T09:02:15Z

This is still not correct. The example file now has the wrong frequency = http://marc21rdf.info/terms/continuingfre#i ("dreimal wöchentlich"), although the MAB source has a d = at 052, position 8 (and also publication.note says "Periodizität: tägl."):

<controlfield tag="052">z||||||td||||||</controlfield>

@ChristophEwertowski, I suggest you just do what I already said twice (via chat and in #59 (comment)):

we have to add a period at each | part in

lobid-resources/src/main/resources/morph-hbz01-to-lobid.xml

Line 697 in 747f81a

<regexp match="^.......t|^........t|^.........t" format="http://marc21rdf.info/terms/continuingfre#i"/>

to get the correct values.

See #59 (comment)

acka47 · 2017-04-03T10:45:03Z

I just pushed a fix to the branch. Please review.

ChristophEwertowski · 2017-04-03T11:53:23Z

+1

acka47 self-assigned this Mar 9, 2016

acka47 added the working label Jul 25, 2016

acka47 mentioned this issue Jul 25, 2016

Missing field MAB 405 hbz/lobid#286

Closed

acka47 added ready and removed working labels Jul 25, 2016

acka47 removed their assignment Sep 21, 2016

acka47 removed the ready label Sep 21, 2016

acka47 self-assigned this Oct 31, 2016

acka47 added ready and removed ready labels Oct 31, 2016

acka47 assigned dr0i and unassigned acka47 Nov 2, 2016

acka47 added ready and removed working labels Nov 2, 2016

dr0i added working and removed ready labels Feb 7, 2017

dr0i assigned acka47 and ChristophEwertowski Feb 7, 2017

dr0i added the review label Feb 7, 2017

dr0i added a commit that referenced this issue Feb 7, 2017

Add publication frequency from 052

20612e3

- update labels providing German labels See #59.

ChristophEwertowski mentioned this issue Mar 28, 2017

Fix missing frequencies problem #354

Closed

ChristophEwertowski assigned acka47 and unassigned ChristophEwertowski Mar 28, 2017

ChristophEwertowski added review and removed working labels Mar 28, 2017

acka47 assigned ChristophEwertowski and unassigned acka47 Mar 29, 2017

ChristophEwertowski added a commit that referenced this issue Mar 31, 2017

Fix missing frequencies problem

800801f

Resolves last part of #59 (#59 (comment))

ChristophEwertowski assigned acka47 and unassigned ChristophEwertowski Apr 3, 2017

acka47 assigned ChristophEwertowski and acka47 and unassigned acka47 and ChristophEwertowski Apr 3, 2017

acka47 added a commit that referenced this issue Apr 3, 2017

Correct frequency indicator positions for 052

564ff54

See #59 (comment)

acka47 assigned ChristophEwertowski and unassigned acka47 Apr 3, 2017

ChristophEwertowski removed their assignment Apr 3, 2017

dr0i added deploy and removed review labels Apr 6, 2017

dr0i closed this as completed in 5cf0e55 Apr 6, 2017

dr0i removed the deploy label Apr 6, 2017

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Indicate journal frequency with dct:accrualPriodicity & controlled values #59

Indicate journal frequency with dct:accrualPriodicity & controlled values #59

acka47 commented Mar 9, 2016

acka47 commented Jul 25, 2016 •

edited

acka47 commented Jul 25, 2016

acka47 commented Aug 19, 2016

acka47 commented Aug 23, 2016

acka47 commented Nov 2, 2016 •

edited

acka47 commented Dec 8, 2016

ChristophEwertowski commented Jan 25, 2017

dr0i commented Feb 7, 2017

ChristophEwertowski commented Feb 7, 2017

ChristophEwertowski commented Mar 28, 2017

acka47 commented Mar 29, 2017

ChristophEwertowski commented Apr 3, 2017

ChristophEwertowski commented Apr 3, 2017

acka47 commented Apr 3, 2017

acka47 commented Apr 3, 2017

ChristophEwertowski commented Apr 3, 2017

Indicate journal frequency with dct:accrualPriodicity & controlled values #59

Indicate journal frequency with dct:accrualPriodicity & controlled values #59

Comments

acka47 commented Mar 9, 2016

acka47 commented Jul 25, 2016 • edited

acka47 commented Jul 25, 2016

acka47 commented Aug 19, 2016

acka47 commented Aug 23, 2016

acka47 commented Nov 2, 2016 • edited

acka47 commented Dec 8, 2016

ChristophEwertowski commented Jan 25, 2017

dr0i commented Feb 7, 2017

ChristophEwertowski commented Feb 7, 2017

ChristophEwertowski commented Mar 28, 2017

acka47 commented Mar 29, 2017

ChristophEwertowski commented Apr 3, 2017

ChristophEwertowski commented Apr 3, 2017

acka47 commented Apr 3, 2017

acka47 commented Apr 3, 2017

ChristophEwertowski commented Apr 3, 2017

acka47 commented Jul 25, 2016 •

edited

acka47 commented Nov 2, 2016 •

edited