Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update 89.md and 90.md with Customer Feedback Data #985

Open
wants to merge 6 commits into
base: master
Choose a base branch
from

Conversation

dtdannen
Copy link

This adds an additional protocol flow step to Nip-90 where a Customer can provide feedback back to the service provider.

@dtdannen
Copy link
Author

Actually, this should really be a kind 7 event from NIP-25:

nips/25.md

Line 5 in 8331354

Reactions

@dtdannen
Copy link
Author

I updated 90.md to use kind:7 instead, like:

image

@dtdannen
Copy link
Author

Updated both NIP-89 and NIP-90 to be aligned. The overall process for DVMs to receive additional feedback from Customers is the following:

  • NIP-89 applications can include an optional pff tag specifying preferred feedback format
  • NIP-90 customer feedback events should attempt to align the data in the additional feedback tag to align with the instructions from the pff tag from NIP-89.

Note 1: Customer feedback may not be from a human but from another DVM or application.

Note 2: These new tags for preferred feedback format pff and feedback are both placeholders for data, and no other commitments are made about their contents (other than they should be strings). It is between any application and customer to work together to ensure consistency.

The use case for this additional feedback is for DVMs that have AI components (or human components) that may learn over time. The additional feedback could include, but is not limited, to such values like Likert scale scores 1-5, numeric or floating point scores between arbitrary ranges, qualitative descriptions of feedback in natural language, or symbolic structured representations.

@dtdannen dtdannen changed the title Update 90.md with Customer Feedback Event Update 89.md and 90.md with Customer Feedback Data Jan 12, 2024
@believethehype
Copy link
Contributor

believethehype commented Jan 23, 2024

Do i get it right that the kind of feedback is always up to the dvm? (in their preferred format etc).

I could imagine it would be useful to have some sort of standardised feedback or rating for dvms (maybe additionally to what they ask for). I'm thinking about apps using dvms that want to filter out bad actors/dead dvms/dvms that generally don't work as expected). It could be something like "2 out of 5 stars" etc. Apps could then collect ratings, build average ratings and decide if they include them in their offers/results. This only works if the kind of feedback is somehow standardised. Users would also know if it's worth to pay more for a 4.9/5 compared to a 3/5. (Doesn't have to be 0-5, could be 0-10 or 0-1, just something standardized)

@dtdannen
Copy link
Author

With this update, there would be two ways to give feedback:

  1. regular reactions (kind:7) that are limited to emojis or '+' / '-'
  2. feedback in the form of a string as described in this PR

The reason for introducing additional feedback (#2) is to enable DVMs to get richer feedback data that isn't possible via the reaction events, where the point of the feedback is to help the DVM which processed the request get better over time, the DVM should specify the format of the feedback it would like to receive.

What you're talking about seems more along the lines of reputation or reviews about DVMs. That's certainly a fine idea, although the purpose of it is different than the feedback I proposed here. The feedback you're talking about would serve to help users choose which DVM to use. The main question with that is whether kind:7 reactions are good enough.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants