Align Technial and Editorial Tickets - OsTicket #1118 of 2023-04-14 #9
WolfgangFahl
started this conversation in
Ideas
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
https://submissions.ceur-ws.org/scp/tickets.php?id=1118
Hi Michael,
i was wandering how we can align the technical and editorial tickets for the intended workflow as part of the upcoming
semantification of CEUR-WS.
An example is what needs to be done if a new volume is published.
The procedure below needs to be much improved before we are in production state and the redundant pieces int the workflow made superfluous.
I suggest that we interlink the two ticket systems in some way to make sure that issues that are both relevant for the editorial and technical work are properly discussable
One step would be to give all technical project participants access here. I have not seen Tim or Christoph on the list of people being able to use this systems. Sometime Beyza Akyüz is also helping us.
What do you propose?
Viele Grüße
Wolfgang
What needs to be done when new volumes are published
Currently I get alerted by a cron-job that runs every night on the mirror sites wikidata.dbis-rwth-aachen.de (internet) and my own computer capri.bitplan.com (intranet).
The next step is to run the ceur-ws volume browser software locally:
ceur-ws --serve
JustPy ready to go on http://fix.bitplan.com:9998/
and click the settings button and then the check button
Now "dry run" needs to be switched off to activate the wikidata creating functionality.
Just clicking the checkboxes in the Vol column will create new wikidata entries or complain if entries already exist.
The next step is to update the state of the ceur-ws volume browser on q.bitplan.com:
ceur-ws --recreate
Creating typemanager(StoreMode.SQL) for VolumeManager using cache /home/wf/.ceurws/ceurws.db
Creating typemanager(StoreMode.SQL) for PaperManager using cache /home/wf/.ceurws/ceurws.db
IWSM-MENSURA 2022: 3%|█▏ | 96/3366 [00:04<01:58, 27.63it/s]
which takes some 2 minutes to finish
storing recreated volume table for 3366 volumes (20 invalid)
storing 3366 volumes for VolumeManager to StoreMode.SQL:/home/wf/.ceurws/ceurws.db
store for VolumeManager done after 0.3 secs
storing 61952 papers
storing 61952 papers for PaperManager to StoreMode.SQL:/home/wf/.ceurws/ceurws.db
store for PaperManager done after 1.5 secs
KRDB'94: 99%|███████████████████████████████████████████████▋| 3346/3366 [02:00<00:00, 27.73it/s]
start_ceur-ws
then restarts the volume-browser and
http://cvb.bitplan.com/volumes
now shows the new volumes and the RESTFul interfaces as outlined in
http://cvb.bitplan.com/docs
will provide the new data.
This new data may now be picked up by the single point of truth server
http://ceurspt.wikidata.dbis.rwth-aachen.de/index.html
on wikidata:
kill the running service:
pkill -f ceur-spt
pgrep -fl ceur-spt
Check existing cache files
wf@wikidata:~/.ceurws$ ls -l
ls -l
total 61448
-rw-r--r-- 1 wf wf 3330048 Mar 20 08:42 ceurws.db
-rw-rw-r-- 1 wf wf 3873081 Mar 20 08:42 index.html
-rw-rw-r-- 1 wf wf 34504926 Apr 14 07:35 papers_dblp.json
-rw-rw-r-- 1 wf wf 14040183 Apr 14 07:35 papers.json
-rw-rw-r-- 1 wf wf 3097206 Apr 14 07:35 proceedings.json
-rw-rw-r-- 1 wf wf 4065152 Apr 14 07:35 volumes.json
remove and recreate cached json files - the RESTFUL interface of the volume browser will be used:
ceur-spt --recreate
Starting read volumes ... ...
read volumes ... read 3366 volumes took 0.9 s
Starting store volumes ... ...
store volumes ... store 3366 volumes took 0.0 s
Starting read papers ... ...
read papers ... read 61952 papers took 3.6 s
Starting store papers ... ...
store papers ... store 61952 papers took 0.0 s
Starting read proceedings ... ...
read proceedings ... read 3346 proceedings took 0.4 s
Starting store proceedings ... ...
store proceedings ... store 3346 proceedings took 0.0 s
Starting read papers_dblp ... ...
read papers_dblp ... read 47948 papers_dblp took 3.9 s
Starting store papers_dblp ... ...
store papers_dblp ... store 47948 papers_dblp took 0.0 s
restart with
start_ceurspt
new columes are now visible
http://ceurspt.wikidata.dbis.rwth-aachen.de/Vol-3372.html
The wikidata entries are still missing since it takes 5 minutes to catch up and the refresh button on the volume browser needs to be clicked to resync which i forgot so the data will only be visible on the next "loop"
ceur-spt command line usage
ceur-spt -h
usage: ceur-spt [-h] [-a] [-b BASEPATH] [-bu BASEURL] [-d] [-rc] [-v] [--host HOST]
[--port PORT] [-s] [-V]
Copyright 2023 contributors. All rights reserved.
Licensed under the Apache License 2.0
https://www.apache.org/licenses/LICENSE-2.0
Distributed on an "AS IS" basis without warranties
or conditions of any kind, either express or implied.
options:
-h, --help show this help message and exit
-a, --about show about info [default: False]
-b BASEPATH, --basepath BASEPATH
the base path to the ceur-ws volumes [default:
/home/wf/.local/lib/python3.10/site-packages/ceur-ws]
-bu BASEURL, --baseurl BASEURL
the base url to use for the RESTFul metadata service [default:
http://cvb.bitplan.com/]
-d, --debug show debug info [default: False]
-rc, --recreate reload caches e.g. volume table
-v, --verbose show verbose infos e.g. on startup [default: False]
--host HOST the host to serve / listen from [default: wikidata]
--port PORT the port to serve from [default: 9990]
-s, --serve start webserver [default: False]
-V, --version show program's version number and exit
ceur-ws volume browser command line usage
ceur-ws -h
usage: ceur-ws [-h] [-a] [-c] [-d] [--host HOST] [-l] [-rc] [-den DBLP_ENDPOINT_NAME]
[-wen WIKIDATA_ENDPOINT_NAME] [-wdu] [--port PORT] [-s] [-nq] [-V]
Copyright 2022 contributors. All rights reserved.
Licensed under the Apache License 2.0
http://www.apache.org/licenses/LICENSE-2.0
Distributed on an "AS IS" basis without warranties
or conditions of any kind, either express or implied.
optional arguments:
-h, --help show this help message and exit
-a, --about show about info [default: False]
-c, --client start client [default: False]
-d, --debug show debug info [default: False]
--host HOST the host to serve / listen from [default: q.bitplan.com]
-l, --list list all volumes [default: False]
-rc, --recreate recreate caches e.g. volume table
-den DBLP_ENDPOINT_NAME, --dblp_endpoint_name DBLP_ENDPOINT_NAME
name of dblp endpoint to use qlever-dblp-plus
-wen WIKIDATA_ENDPOINT_NAME, --wikidata_endpoint_name WIKIDATA_ENDPOINT_NAME
name of wikidata endpoint to use wikidata
-wdu, --wikidata_update
update tables from wikidata
--port PORT the port to serve from [default: 9998]
-s, --serve start webserver [default: False]
-nq, --namedqueries generate named queries [default: False]
-V, --version show program's version number and exit
cron message example
All reactions