Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Create Quiz type #2611

Open
lucy-kind opened this issue Jun 24, 2020 · 18 comments
Open

Create Quiz type #2611

lucy-kind opened this issue Jun 24, 2020 · 18 comments
Assignees
Labels
no-issue-activity schema.org vocab

Comments

@lucy-kind
Copy link
Contributor

lucy-kind commented Jun 24, 2020

Create Quiz as subtype of LearningResource. Inherits all properties; no new properties at this time.

@lucy-kind lucy-kind self-assigned this Jun 24, 2020
@danbri danbri added the schema.org vocab label Jun 30, 2020
@danbri
Copy link
Contributor

danbri commented Jun 30, 2020

Context - This is a proposal from Google based on our experience with actively consuming schema.org edu-related markup. If it were accepted, it would make it easier for us and others to understand when a piece of web content is some kind of Quiz.

@Aaranged
Copy link

Aaranged commented Jun 30, 2020

Quick thought on this is that a quiz can be for entertainment as well as educational purposes. That is, while there's obviously value in modeling this Thing, I think it might cause future problems if a quiz were restricted to the LearningResource domain (indeed, Google itself promotes the creation "quizzes" that are not necessarily "educational").

@lifan0127
Copy link

lifan0127 commented Jun 30, 2020

Reference #1401 for context. I understand that LearningResource has an explicit orientation for education.

Quick thought on this is that a quiz can be for entertainment as well as educational purposes. That is, while there's obviously value in modeling this Thing, I think it might cause future problems if a quiz were restricted to the LearningResource domain (indeed, Google itself promotes the creation "quizzes" that are not necessarily "educational").

@philbarker
Copy link
Contributor

philbarker commented Jun 30, 2020

The name Quiz and definition suggested in the PR (Quiz: A test of knowledge.) does look more like the entertainment type of quiz. No matter what it is a subtype of, I think you will see a lot of people using it for pub quizzes and the like.

The definition ought at least cover assessment of skils and abilities as well as knowledge.

@danbri
Copy link
Contributor

danbri commented Jun 30, 2020

@philbarker the current draft definition is "Quiz: A test of knowledge."; how about "Quiz: A test of knowledge, skills and abilities."? /cc @lucy-kind

@Aaranged I think we can take a somewhat broad view of educational vs entertainment purposes. If someone makes a quiz which is "Dan's Quiz - learn what your spirit animal is by sharing your mother's maiden name and date of birth!", ... the fact that this isn't really very educational isn't the real problem. There will be good and bad LearningResource-tagged content, as with everything else. Maybe there will be some quizzes that are only tenuously educational but I think we can deal with that problem if it proves to be one.

@philbarker
Copy link
Contributor

philbarker commented Jun 30, 2020

@danbri Yup that's better. Are you set on the name "Quiz" rather than "Assessment" or "Test". The boring more edu-speak Assessment might help avoid some of the more trival quizzes. If you want to avoid any suggestion that exams are included, then "Formative" in the name and definition would do it. But not all assessments are quiz-like (think driving test). Naming things is hard, who knew?

@danbri
Copy link
Contributor

danbri commented Jun 30, 2020

I think "Quiz" works for now. Formative is a bit too much of a technical term for us here, I think.

Our proposal for a type is coming from a more educational angle but SEOs will see this and immediately wonder whether content like https://www.capitalfm.com/features/quizzes/one-direction-tattoo-trivia-quiz/ is also a Quiz. I would like to be able to answer "yeah, just a kinda trashy / fun one". Is it a LearningResource? Barely, but since it does evaluate one's knowledge of a particular domain, I could defend the claim that it was. Rather than being snooty about whether things are learning-oriented enough to deserve being called a LearningResource I think we'll get more value from using other (LRMI etc.) properties to help distinguish the different kinds of learning resources (quizzes or whatever) that are out there... Does that perspective work for you folks?

@philbarker
Copy link
Contributor

philbarker commented Jul 1, 2020

@danbri I'll check with other folk in LRMI, but like you, I think Quiz works for now. We can always build in other assessment terms around it if/when we need them. There will always be edge cases and different perspectives about quality for what is a learning resource.

@jgoodell2
Copy link

jgoodell2 commented Jul 1, 2020

I think this would be a valuable addition to LRMI & Schema. We should consider whether the use case also includes formal assessments (test, exam) in addition to informal checks for understanding (quiz). The ceds.ed.gov Assessment domain has a plethora of terms that apply to all kinds of assessments and assessment items, and data used to manage delivery of assessments and assessment results...too many concepts for practical use by Schema.org, but it gives a catalog of concepts and properties to consider.

@science
Copy link

science commented Jul 1, 2020

Since we have general consensus that schema.org models educational things that "teach" or things that "measure," having an explicit type for the "measure" side of things is useful. Quiz seems like an accessible term for this type, at the level of schema.org.

I'll be interested in potentially subclassing/profiling this in the OCX schema to include additional metadata around measurement, so this is a useful type for that type of use-case also.

+1

@testometrika
Copy link

testometrika commented Jul 31, 2020

The type Test or Quiz is sorely lacking for online tests. We specialize in tests https://en.testometrika.com and can provide advice. Test type more appropriate for the name.

We are currently using an inappropriate CreativeWork, but there is a problem with AggregateRating. Invalid target type for itemReviewed property.

The test can contain title, description, rating, author, datePublished, dateModified, list of questions (if not ajax) with answer options .

@github-actions
Copy link

github-actions bot commented Sep 30, 2020

This issue is being tagged as Stale due to inactivity.

@github-actions github-actions bot added the no-issue-activity label Sep 30, 2020
@psychology-tools
Copy link

psychology-tools commented Nov 16, 2020

We've added a first-draft implementation of the pending Quiz schema to all the multiple choice self-assessments on our site (e.g. https://psychology-tools.com/test/gad-7. Combined with the Question and Answer (as an array of suggestedAnswer types). Just wanted to provide an in-the-wild example and say this is a really useful schema!

@macgyver
Copy link

macgyver commented Feb 15, 2021

I work at a media organization that does a quiz (more entertainment than assessment) with ~28k readers each week, what is the incentive for me to implement the Quiz schema?

@westcoast42
Copy link

westcoast42 commented Jan 26, 2022

Founder of FunTrivia.com here. We host 150,000+ community sourced and maintained quizzes across 25,000 topics. Everything from particle physics to Seinfeld. We totally support the addition of LearningResource:Quiz. Right now we are using Article to describe our quizzes, but clearly Quiz would be more accurate.

I suggest Question/Answer be included as optional sub-elements of this type.

@psychology-tools
Copy link

psychology-tools commented Jan 26, 2022

Founder of FunTrivia.com here. We host 150,000+ community sourced and maintained quizzes across 25,000 topics. Everything from particle physics to Seinfeld. We totally support the addition of LearningResource:Quiz. Right now we are using Article to describe our quizzes, but clearly Quiz would be more accurate.

I suggest Question/Answer be included as optional sub-elements of this type.

I think the Quiz/Question/Answer structure works well for both "Learning Resource" type quizzes as well for the "Subjective Assessment" type of Quizzes (with the exception of a required "expectedAnswer" field, which can be kludged by expecting all answers).

I would include in the "Subjective Assessment" category both highly serious, rigorously scored, psychological self-assessment tools and informal "what flavor of dinosaur" buzz-feed type quizzes.

It appears to me that the LearningResource/Quiz and the above described "Subjective Assessment" Quiz, although being almost identical in their structure, are very different in their contexts and purposes. And I would venture to guess that the two types are about equally prevalent in the wild.

The only two ways I can see to resolve this would be either:

Option 1

Make Quiz a direct subtype of CreativeWork and have two subtypes like ObjectiveQuiz and SubjectiveQuiz or LearningResourceQuiz and AssessmentResourceQuiz.

This would have the benefit of allowing both types of quiz to inherit mostly all of their properties, and keeping their mostly identical schemas in line with each other in future.

Furthermore, per the specification LearningResource is "expected to be used as an addition to a primary type such as Book, VideoObject, Product etc." So it is unclear to me why LearningResource would have any direct subtypes given this.

Option 2

Create a separate type of quiz for the non-learning resource type. It would have to be called something other than Quiz, and could not be a subtype of Quiz.

Excluding roughly half of the objects commonly called "quiz" with nearly idential structure and properties from the Quiz schema based on a single point of distinction (educational/subjective) does not seem like the cleanest solution.

@psychology-tools
Copy link

psychology-tools commented Jan 26, 2022

The Course type (the only other subtype of LearningResource) is both a primary direct subtype of CreativeWork and a subtype of LearningResource.

Wouldn't treating Quiz the same way as its only sibling subtype resolve this issue?

Wouldn't either eliminating all subtypes of LearningResource also solve this problem?

@westcoast42
Copy link

westcoast42 commented Jan 26, 2022

It might be most straightforward to just have an attribute under “Quiz” to differentiate the type of quiz.
QuizType : text: “Factual”, “Personality”, Etc or something.

Definitely worth disambiguating though because a “What Harry Potter character are you?” Quiz And a “French Revolution” Quiz are worlds apart.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
no-issue-activity schema.org vocab
Projects
None yet
Development

No branches or pull requests