Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

external research- choose relevant reporter + submit relevant UID [6h] #337

Closed
noamoss opened this issue May 24, 2020 · 31 comments
Closed
Assignees
Labels
bug Something isn't working content QA feedback

Comments

@noamoss
Copy link
Contributor

noamoss commented May 24, 2020

1. simplify pre-questions [1h]

א) לאחד את שתי השאלות לגבי המחקר הנוסף לשאלה אחת כי אנשים נופליפ ביניה

omit the first general research question [0.5h]

2. choose specific reporter and submit uid to the google form [3h]

ב) לוודא עם המשתמש עבור מי ממלאים את השאלון הנוסף

a. when the user clicks 'yes', to fill the external questionnaire, before opening the external research link, ask:

q: "עבור מי מהמדווחים תמלאו את השאלון?"

b. submit the reporter uid to the relevant field in the form

3. update the "end of report text" [1h]

ג) לעדכן את הניסוח לגב סיום מילוי לבני הבית, כי אנשים חושבים שסיימו לגמרי וסוגרים את הדפדפן

this part will not be applied before getting suggestions from the client ( cc @dorit102 )

@noamoss
Copy link
Contributor Author

noamoss commented May 24, 2020

@akariv please approve/update my time estimation. If it seems ok, just remove the label and it is ready to apply.

@noamoss noamoss changed the title external research- choose relevant reporter + submit relevant UID [3h] external research- choose relevant reporter + submit relevant UID [6h] May 24, 2020
@akariv
Copy link
Member

akariv commented May 25, 2020

For (2) we have what we planned for #190 - ask for each reporter 'is it you or someone else' (and stop asking once we get a 'yes' to that question.
For (3) - I think that's already done.

Other than that estimations seem fine.

@noamoss
Copy link
Contributor Author

noamoss commented May 25, 2020 via email

@noamoss
Copy link
Contributor Author

noamoss commented May 26, 2020

@akariv

They still prefer a a single selection question, we verified it today.This is the deinition (1-3, did not touch the description, to prevet confusion):

"ומה עכשיו...?"
א. סיימתי, ואני מעונין גם לענות על שאלות לגבי תחושת לחץ ומצב רוח
ב. סיימתי להיום, אינני מעוניין לענות על שאלות נוספות

if yes:

מדובר במחקר של פרופ' אלון חן ממכון ויצמן בנוגע לתחושת לחץ באוכלוסיה.
מי ישיב על השאלון?
(בלחצנים שמעבירים לגוגל)
-בת 46 מאליקום
-בן 49 מאליקום
-אולי בפעם אחרת

(each click will submit to the google form the relevant uid)

@akariv
Copy link
Member

akariv commented May 26, 2020 via email

@noamoss
Copy link
Contributor Author

noamoss commented May 26, 2020

@akariv I agree - but it seems like both teams are seeing both parts as a related research data set.
In this offer the user get an explanation about the relevancy of the external research to the data they just provided and we don't add a question - they ca finish their report without jumping in or reading about the other research if they don't want to (in other words, they don't pay in their attention unless they are interested doing so). It combined the end report and the extra_research question

@akariv akariv closed this as completed in 5c7c060 May 27, 2020
@noamoss
Copy link
Contributor Author

noamoss commented May 27, 2020

@akariv

QA Finding 1:

מי ישיב על השאלון?

-->

מי מכם ישתתף במחקר?

@noamoss noamoss reopened this May 27, 2020
@noamoss
Copy link
Contributor Author

noamoss commented May 27, 2020

@akariv

Qa finding 2:

finished an initial report for a first user on a device. Later (a couple of days later) I created a new reporter on the same address - but only one option was given to choose:

image

The following screenshot was taken later (after a refresh) to show two reporters still exist in the device:

image

@noamoss
Copy link
Contributor Author

noamoss commented May 27, 2020

@akariv

QA finding no. 3:

update loop question:

"זהו להיום" --->

"כולם דיווחו"

image

see finding 7 below, related to this one.

@noamoss noamoss added bug Something isn't working QA feedback labels May 27, 2020
@noamoss
Copy link
Contributor Author

noamoss commented May 27, 2020

@akariv QA finding 5:

after creating a user with a different address on the same device the new question

shows no options and freezes the chat:

image

(device reporters:)

image

@noamoss
Copy link
Contributor Author

noamoss commented May 27, 2020

@akariv

QA finding 6:

no " אולי בפעם אחרת" option in the new choose reporter question - this option should practically enable users to take a backward step to keep me in the current site/chatbot.

@noamoss
Copy link
Contributor Author

noamoss commented May 27, 2020

@akariv finding 7 which should be handled together with finding 3:

questions order should be different:

  • after choosing "כולם דיווחו" (finding 3):
  1. "ומה עכשיו...?"
    א. סיימתי, ואני מעונין גם לענות על שאלות לגבי תחושת לחץ ומצב רוח
    ב. סיימתי להיום, אינני מעוניין לענות על שאלות נוספות

2a. if A --> choose which reporter and lead to the external research
2b. if B --> offer reminder and share

@akariv
Copy link
Member

akariv commented May 27, 2020

QA Finding 1: But... #337 (comment)
QA Finding 2: Only people that reported today appear in the list
QA Finding 3: This was a recurring comment - people not pressing that as not 'everyone reported', and not getting to the next phase:
Screen Shot 2020-05-27 at 21 03 33
QA Finding 4: no number 4!!!!
QA Finding 5: if a full day had passed (i.e. a minute on staging), the list of today's reporters will be empty. This is an edge case, not very interesting in production imo
QA Finding 6: This is exactly the 'לא תודה, סיימתי' option.
QA Finding 7: Why throw users out of the flow before they set a reminder? Didn't you say "It combined the end report and the extra_research question"?

@noamoss
Copy link
Contributor Author

noamoss commented May 27, 2020

@akariv

QA Finding 1: But... #337 (comment)

right, but now I see that, and notice the gender effect.

QA Finding 2: Only people that reported today appear in the list

makes sense. still should enable the "אולי בפעם אחרת" options

QA Finding 3: This was a recurring comment - people not pressing that as not 'everyone reported', and not getting to the next phase:

Screen Shot 2020-05-27 at 21 03 33

ok - let's go with "אפשר להמשיך", anyway, it is still connected to 7.

QA Finding 4: no number 4!!!!

that was exactly the bug I found :)

QA Finding 5: if a full day had passed (i.e. a minute on staging), the list of today's reporters will be empty. This is an edge case, not very interesting in production imo

a. Is it just for a full day, or also for reporters starting at 23:55 and getting to this question on 00:02?

b. why not set a fallback rule to skip this question (and prevent similar future feedbacks on QA) if there are not active reporters on the device for the last day?

QA Finding 6: This is exactly the 'לא תודה, סיימתי' option.

not exactly, I might want to stay in the bot in the name choosing step. I know I can change my last answer, but it is not explicit enough (in this use case, I think).

QA Finding 7: Why throw users out of the flow before they set a reminder? Didn't you say "It combined the end report and the extra_research question"?

The reason? because currently, they care more about collecting more data (and combine it) than encouraging the user to become a returning reporter and/or share. I think it is a mistake, and assume it will be changed in case of a massive need for symptoms report.

by "end of report" I meant, literally, the end of the reports section and not the end of the flow. Sorry if that was too vague.

@noamoss
Copy link
Contributor Author

noamoss commented May 27, 2020

(just updated no. 6 above)

@akariv
Copy link
Member

akariv commented May 27, 2020

right, but now I see that, and notice the gender effect.
למה ישיב זה בעיה וישתתף זה סבבה?

still should enable the "אולי בפעם אחרת" options
This is exactly the 'לא תודה, סיימתי' option.

אפשר להמשיך
אפשר להמשיך לאן? התוכן צריך לענות באיזשהו אופן על השאלה

reporters starting at 23:55 and getting to this question on 00:02?

reporters ending their last report before 23:59:59 and getting to that question after 00:00. As I said, an edge case

if there are not active reporters on the device for the last day

You can't get to that question without having at least one report. not worth handling imo

not exactly, I might want to stay in the bot in the name choosing step

That is true for all questions in the bot. Since you just said you'd like to answer these questions, so no point in providing an 'umm, I changed my mind' option

I think it is a mistake

So the option would say "סיימתי להיום, אינני מעוניין לענות על שאלות נוספות" and then we would ask a few more questions?

@noamoss
Copy link
Contributor Author

noamoss commented May 27, 2020

  1. right. update:

" מי ישיב על השאלון?" --> "עבור מי הדיווח"?

still should enable the "אולי בפעם אחרת" options This is exactly the 'לא תודה, סיימתי' option.

how come - these are two different steps - here I got stuck:

image

אפשר להמשיך
אפשר להמשיך לאן? התוכן צריך לענות באיזשהו אופן על השאלה

makes sense, what about fitting the intro question to:

"ועכשיו - דיווח נוסף, או שנמשיך לשאלות אחרונות?"

reporters ending their last report before 23:59:59 and getting to that question after 00:00. As I said, an edge case

  • preventing future QA... I assume it is not a quick fix? If so, let's leave as is - and agree in advance that if we will get this question more than 3 times (from QA people or real users) we will handle it.

That is true for all questions in the bot. Since you just said you'd like to answer these questions, so no point in providing an 'umm, I changed my mind' option

I disagree, actually it is not the same IMO - no other question throws the user/reporter out of the site and out of the current tab. This is what I want to prevent/ensure before the click.

So the option would say "סיימתי להיום, אינני מעוניין לענות על שאלות נוספות" and then we would ask a few more questions?

ok, let's keep it strict - what bout : "סיימתי להיום" vs. "אני מעונין גם לענות על שאלות לגבי תחושת לחץ ומצב רוח"

@akariv
Copy link
Member

akariv commented May 27, 2020

עבור מי הדיווח

👍

how come - these are two different steps - here I got stuck:

You said 'כן בשמחה' a second ago - why are you stuck?

"ועכשיו - דיווח נוסף, או שנמשיך לשאלות אחרונות?"

The current wording 'עבור מי ברצונך לדווח עכשיו?' fits the first interaction and subsequent interactions, your proposal doesn't :)

"more than 3 times"

👍

I want to prevent/ensure before the click

You know what, let's consult with the WIS team if they want to add a mechanism allowing the users to skip the questionnaire after they explicitly said 'yes' to answering it. 😉

סיימתי להיום

still, you say סיימתי להיום and then you keep asking more questions...

@noamoss
Copy link
Contributor Author

noamoss commented May 27, 2020

You said 'כן בשמחה' a second ago - why are you stuck?

because I changed my mind. can't you imagine a scenario of regret? (I would honestly like the user to reconsider before flying out of the chatbot). Also - showing a single option in a question is very confusing. It would be much easier to show this functionality, than auto submitting the single uid to the external research, right?

...let's consult with the WIS team if they want to add a mechanism allowing the users to skip the questionnaire after they explicitly said 'yes' to answer it. wink

surprisingly, it was their offer... can't promise it will not change their mind :)

סיימתי להיום

still, you say סיימתי להיום and then you keep asking more questions...

--> "אולי בפעם הבאה" vs. "אני מעונין גם לענות על שאלות לגבי תחושת לחץ ומצב רוח"

@noamoss
Copy link
Contributor Author

noamoss commented May 27, 2020

The current wording 'עבור מי ברצונך לדווח עכשיו?' fits the first interaction and subsequent interactions, your proposal doesn't :)

correct. let's leave the current wording. The last option to "דיווחתי עבור כולם, עוד משהו?"

@akariv
Copy link
Member

akariv commented May 27, 2020

Also - showing a single option in a question is very confusing

We could open the questionnaire immediately in that case.

אולי בפעם הבאה

ok

דיווחתי עבור כולם, עוד משהו

we're back to square one where people who didn't report for "everybody" get stuck - #337 (comment)

@noamoss
Copy link
Contributor Author

noamoss commented May 27, 2020

let's go back to square one:

עבור מי תרצו לדווח?

  • option a
  • option b
  • דיווחנו עבור כל בני הבית
  • דיווחנו עבור כולם, אשמח להשיב גם לשאלון מחקר נוסף בנושאי לחץ ומצב רוח

@noamoss
Copy link
Contributor Author

noamoss commented May 27, 2020

update last comment

@akariv
Copy link
Member

akariv commented May 27, 2020

That's even more problematic as
a) it still mentions everybody and
b) it encourages people to leave the loop

what's so bad with זהו להיום?

@noamoss
Copy link
Contributor Author

noamoss commented May 27, 2020

what's so bad with זהו להיום?

the feedback they got (a signle feedback, AFAIK) that people thought's it is the end of the flow, and did not bother to click. There is something correct in this feedback.

but let's leave as is - if we both can't come with a better idea, this will remain for now - maybe something will come up on the QA, or later.

@noamoss
Copy link
Contributor Author

noamoss commented May 27, 2020

you know what- I think that chaging "זהו להיום" to "זהו" might do the job. WDYT?

@noamoss
Copy link
Contributor Author

noamoss commented May 27, 2020

@akariv

Summarizing (with a minor update) this long QA discussion, hope it will make things clearer:

  1. we are not touching the main report loop, except for changing the label זהו להיום --> זהו.

  2. the next question should be the external research question:

ועכשיו...רוצה לענות גם על מספר שאלות לגבי תחושת לחץ ומצב רוח?

א. כן, רוצה -->3
ב. בפעם אחרת -->4

  1. external reporter chooser

    • ( " מי ישיב על השאלון?" --> "עבור מי הדיווח"?)
    • add a static option: בעצם, לא היום
  2. reminder, sharing questions

@akariv
Copy link
Member

akariv commented May 28, 2020 via email

@noamoss
Copy link
Contributor Author

noamoss commented May 28, 2020 via email

@akariv akariv closed this as completed in 3acd1bc Jun 1, 2020
@noamoss noamoss assigned noamoss and unassigned akariv Jun 1, 2020
@noamoss
Copy link
Contributor Author

noamoss commented Jun 1, 2020

@akariv

  1. "רוצה לענות גם על מספר שאלות לגבי תחושת לחץ ומצב רוח?" -->
    "ועכשיו, רוצה לענות גם על מספר שאלות לגבי תחושת לחץ ומצב רוח?"

  2. "כן, בשמחה" -->
    "כן, רוצה"

(I don't think happiness fits here)

  1. when I click on "בעצם לא היום", the research link is being opened (with an no-uid value.

@noamoss noamoss reopened this Jun 1, 2020
@noamoss noamoss assigned akariv and unassigned noamoss Jun 1, 2020
@akariv akariv closed this as completed in 39b00bf Jun 1, 2020
@noamoss
Copy link
Contributor Author

noamoss commented Jun 1, 2020

checked and approved.

@akariv akariv reopened this Jun 10, 2020
@akariv akariv closed this as completed Jun 10, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working content QA feedback
Projects
None yet
Development

No branches or pull requests

2 participants