a Schema Markup Validator: adopting SDTT to add validation to Schema.org site

[danbri]

In 2021 we should improve the schema.org by incorporating validation tooling. There are two broad categories here: syntactic parsing and shape-based checks.

Nearby:

• Google's blog post on future of SDTT
• my mail thread "a Schema Markup Validator: adopting SDTT for validator.schema.org"
• background document with a few more details

/cc @tmarshbing @scor @tilid @rvguha @nicolastorzec

[danbri]

See also https://developers.google.com/search/blog/2020/12/structured-data-testing-tool-update from Google on plans for SDTT (essentially to rework it as a tool for the schema.org community).

I have put a short document together at https://docs.google.com/document/d/1q8z_rRJepiz4Os_KcEs3NaCVEm3US5l-qYL14JmE0To/edit# that talks a bit more about the two kinds of validator and how we might proceed.

[danbri]

Email thread: https://lists.w3.org/Archives/Public/public-schemaorg/2020Dec/0002.html

Nearby discussion: https://searchengineland.com/google-to-move-the-structured-data-testing-tool-to-schema-org-344815

[danbri]

I have messed with the subject line after realizing on Twitter I had given the impression that "validator.schema.org" was already working. We are setting a direction here not announcing a finished thing.

[sumutcan]

@danbri This is very good news, as we (I and my colleagues from STI Innsbruck) have been working towards this topic for a long time.
This is basically a vendor-independent implementation of SDTT with more advanced reporting features [1].

We have also a validator based on SHACL (a subset of SHACL) [2]. We have had very good experience with our approach in different sectors like tourism and public service (they are used as patterns for creating sdo annotations). See here for some shapes for tourism domain https://ds.sti2.org

Looking forward to a cooperation on this topic. I have dropped a similar comment on the GDoc document, the source code of the SDTT implementation will be open-sourced this week, I'll update it here again.

[1] https://sdocheck.semantify.it.
[2] https://semantify.it/validator/

[danbri]

@sumutcan - that sounds like a useful tool to be opensourcing - let's investigate interop testing in 2021!

[westurner]

FWIW; resources for the background document:

re: book.validatingrdf.com, ShEx and SHACL:

Chapter 4 Shape Expressions (ShEx)
http://book.validatingrdf.com/bookHtml010.html
Chapter 5 SHACL
http://book.validatingrdf.com/bookHtml011.html
Chapter 7 Comparing ShEx and SHACL
http://book.validatingrdf.com/bookHtml013.html

And then, practically, there are already many JSONschema validation tools (JS implementations that work in Node and in browsers): can we use those with SHACL?

https://github.com/mulesoft-labs/json-ld-schema ::

JSON Schema/SHACL based validation of JSON-LD documents

Use case:

• I want to add (e.g. bibliographic, document-level) metadata to a Jupyter notebook with a widget at the top that lets me append a new Person inline form in order to add another author and affiliated Organization; and it needs to let me edit the produced JSON-LD, which needs to be validated with appropriate feedback in the form.

If google/schemarama (mentioned in the linked gdoc) does not support dynamic forms-based validations, what would it take to support such an essential data data quality use case?

In regards to interactive data validation as a primary use case,
What are these for:

• https://github.com/google/schema-dts
• https://github.com/google/react-schemaorg

Minimally, what's the form widget and client-side validators story for a ScholarlyArticle Thing with Person authors an Organization funders?

[ktk]

@westurner the library that should be used in Javascript is https://github.com/zazuko/rdf-validate-shacl/, if something is missing, it should be extended there.

It is an independent fork of the reference implementation in Javascript but on top of RDFJS. The modern RDF stack/standard for Javascript.

(Full disclosure: My colleagues wrote it)

[chrisspradling1980]

Thank you for your services. Currently, I am awaiting the arrival of an important Google verification to ascend the self service worker to independently verify and attest the "multi user-agent" flowing editions which will adopt our new found glorious application servants within adoption. You all will soon be very appropriate to instantiate. Something tells me the industry will be in demand to acquire this new sense "nuisance"(get it lol?) of fashion to implore our friends. The salutation should greet: whom which have applied passion"allocating outliers'"correcting mistakes (even noticing corrections after the fact SPACE BAR HIJACKED)the punctuation being online with autocorrect* hang in there ladies and gentlemen _respectfully concerned with the internet____ Christopher M. SpradlingScheme check Front0-end-Front <https://sdocheck.semantify.it/?url=https://independent-consulting.business.site/?m=true-verified>

On Tue, Dec 15, 2020 at 10:10 AM Dan Brickley ***@***.***> wrote: I have messed with the subject line after realizing on Twitter I had given the impression that "validator.schema.org" was already working. We are setting a direction here not announcing a finished thing. — You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub <#2790 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/ADFVNUQYFTQMNGYHC2EWT7DSU6DAXANCNFSM4U4K2D4A> .

{ "@context": "https://schema.org/", "@type": "LocalBusiness", "name": "Independent Consulting Services", "description": "Research And Product Development" }

[westurner]

@ktk As a user, I can click '+' next to 'author', fill out the Person form that appears, and have that email address column validated client-side and serverside.

Things to add to
https://www.w3.org/community/rdfjs/wiki/Comparison_of_RDFJS_libraries :

• react-schemaorg
• rdf-validate-shacl

Which of these RDFJS libraries have been evaluated for e.g. appropriate query parameterization (and string concatenation removal)? Are backticks in react JSX fine?

[chrisspradling1980]

Welcome to greatness Wes. Gratefully, Christopher M. Spradling

…

On Wed, Dec 16, 2020 at 3:51 PM Wes Turner ***@***.***> wrote: @ktk <https://github.com/ktk> As a user, I can click '+' next to 'author', fill out the Person form that appears, and have that email address column validated client-side and serverside. Things to add to https://www.w3.org/community/rdfjs/wiki/Comparison_of_RDFJS_libraries : - react-schemaorg - rdf-validate-shacl Which of these RDFJS libraries have been evaluated for e.g. appropriate query parameterization (and string concatenation removal)? Are backticks in react JSX fine? — You are receiving this because you commented. Reply to this email directly, view it on GitHub <#2790 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/ADFVNUR6RAPU7IK6EJ7M23TSVETWLANCNFSM4U4K2D4A> .