Skip to content

Conversation

@nmdefries
Copy link
Contributor

Description

Make tool to parse survey .qsf files and create a codebook with information about each survey item in a given wave.

Changelog

  • Create generate-codebook.R based off of Jacob's Wave 7 processing code.
  • Create qsf-utils.R to share some basic utilities with qsf-differ.R.
  • Create qsf tools directory and README.

Copy link
Contributor

@capnrefsmmat capnrefsmmat left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Overall this looks good. I think the only thing I'd add is documenting the spreadsheets in the README, so operators adopting a new survey wave know which spreadsheets they need to update and how

# get the text of the question:
questions <- displayed_questions %>%
map_chr(~ .x$Payload$QuestionText) %>%
str_remove_all("<[^<>]+>") %>%
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I realize that the survey only contains limited HTML and this is completely harmless here, but I can't resist linking this https://stackoverflow.com/a/1732454

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lol a classic 😂

@nmdefries
Copy link
Contributor Author

the only thing I'd add is documenting the spreadsheets in the README

Do these exist yet?

@capnrefsmmat
Copy link
Contributor

capnrefsmmat commented Jun 22, 2021

Do these exist yet?

By "spreadsheets" I mean item_replacement_map.csv, item_shortquestion_map.csv, etc.

@nmdefries nmdefries requested a review from capnrefsmmat June 24, 2021 19:26
Copy link
Contributor

@capnrefsmmat capnrefsmmat left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think this looks good. I think the next steps are:

  1. Get all the QSFs together
  2. Run and produce a "prototype" codebook
  3. Have Wichada and Facebook review it and suggest changes to the data (e.g. I'd probably add the timezone to the date column descriptions in static_microdata_fields.csv
  4. Release to data users

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants