April 2024 Survey #261

marco-ippolito · 2024-03-20T14:51:26Z

Fixes: #250
I've copy pasted 2023 survey, feel free to add/remove question

kyliewd · 2024-03-20T17:21:43Z

Thanks @marco-ippolito @mhdawson. I have this started, but I think its a bit too long and users might not complete the full survey. Is there any questions that can be removed? It's best to have 10-12 questions maximum to get the best response.

surveys/2024-04/questions.md

marco-ippolito

left some comments, I think we should be more specific with multiple choice questions and less with open questions

AugustinMauroy · 2024-03-21T10:43:12Z

I know that the discussion is tense on this subject. But we should have some stats/question on Corepack.

for me the two questions that are missing:

do you know corepack
do you use it

mhdawson · 2024-03-21T13:48:38Z

We should also look at the results from the last survey. Even though overall the answers/data was great, I know there were a few questions were the answers suggested the question was not very clear. We should identify those and make sure to tweak the related questions.

kyliewd · 2024-03-25T21:53:33Z

i just went through last year's survey data and i recommend the following:

no open ended questions (many people skipped)
we need to condense the number of choices on "what is important to you" (many people skipped this one too)
dropdown for list of countries (this one is on me)
people skipped questions re: ESM, lets remove those if we can

kyliewd · 2024-04-03T16:03:12Z

@mhdawson @marco-ippolito here is what i have right now: https://www.surveymonkey.com/r/Preview/?sm=azuRRBptcGtNPJ1HXU5pgFGqa9o53iCd8PmuDc0c_2FMfpPH9Tqx_2FPQV1lAeZ7BYY7

please note that i don't think we should have open ended questions. this doesn't guarantee a good answer rate. recommend that if there is one i didn't add due to that, we make it multiple choice if possible.

mhdawson · 2024-04-04T13:48:45Z

no open ended questions (many people skipped)

I agree we should limit these, but we got a lot of very interesting responses in the last survey (several hundred) even if many people skipped (since we got a lot of responses).

surveys/2024-04/questions.md

GeoffreyBooth · 2024-04-10T19:14:56Z

I remember digging through the feedback from the last one, to try to identify biggest pain points: nodejs/TSC#1445 (comment). It would be nice if we can somehow gather this information in a more structured way than a free response “what issues are you having with Node.js” open question.

It was clear from the last survey’s data that many users struggle with ESM and TypeScript, and that’s probably our biggest user complaint. What’s less clear is why they struggle, which is what we need to know in order to help them. Anecdotally it seems that the largest group of such struggling users are ones building React apps with Webpack, implying that it’s something about older build tools not keeping current with modern APIs; but I don’t really know much more than that. In a perfect world I’d somehow be able to get 100 responses from people who struggle with TypeScript and ESM, and they could be categorized into groups where these 50 are on this particular tech stack and are getting this particular error; and these 30 are on this other one, etc. Then we could reproduce the problems, and try to find solutions for them; better error messages if nothing else. But I don’t know how to get anywhere close to getting data like this. Perhaps “Have you run into issues with TypeScript and/or ES modules, and if so, what errors did you encounter and what tech stack are you using?”

surveys/2024-04/questions.md

kyliewd · 2024-04-10T21:06:30Z

This is the current survey draft, which should reflect all of the comments above: https://www.surveymonkey.com/r/Preview/?sm=azuRRBptcGtNPJ1HXU5pgFGqa9o53iCd8PmuDc0c_2FMfpPH9Tqx_2FPQV1lAeZ7BYY7

surveys/2024-04/questions.md

marco-ippolito · 2024-04-13T05:52:18Z

I'll try to gather everyone's feedback and update the survey.
Remember we are having a next 10 meeting Wed 17th April.

GeoffreyBooth · 2024-04-21T03:31:05Z

Questions 13 and 15 are duplicates. It's also missing the question about typescript.

Co-authored-by: Trivikram Kamat <16024985+trivikr@users.noreply.github.com>

surveys/2024-04/questions.md

marco-ippolito · 2024-04-21T10:47:05Z

@kyliewd I updated 16 and 12 also as @GeoffreyBooth mentioned 13 and 15 are duplicates

sheplu · 2024-04-21T14:42:46Z

Some comments. we are close :)

Question 5 and 7 seems to be the same
Question 9 should be a multiple choice - and do we want to keep all sub example with docker? Or just a global docker ? @marco-ippolito
Question 10, change ia32 by x32
Question 20 should be a multiple choice
Question 21 should be a multiple choice

kyliewd · 2024-04-22T17:13:55Z

I have updated all of these. Please have all final edits in by end of day today, april 22.

marco-ippolito · 2024-04-22T18:45:52Z

I have updated all of these. Please have all final edits in by end of day today, april 22.

Can you provide the link of the updated survey?

kyliewd · 2024-04-22T19:26:30Z

I have updated all of these. Please have all final edits in by end of day today, april 22.

Can you provide the link of the updated survey?

Same link as before

GeoffreyBooth · 2024-04-22T19:35:56Z

Same link as before

On that link, two questions both ask “How do you manage the package manager for your project?” We don’t need two copies of this.

I’d like this question added please:

If you use or have attempted to use TypeScript with ES module syntax, whether ESM dependencies or running your production code using ESM syntax, what issues (if any) have you encountered? Please be as specific as possible and please include your tech stack (build tool, application framework, testing framework, runtime customizations, etc.).

kyliewd · 2024-04-22T19:42:50Z

Same link as before

On that link, two questions both ask “How do you manage the package manager for your project?” We don’t need two copies of this.

I’d like this question added please:

If you use or have attempted to use TypeScript with ES module syntax, whether ESM dependencies or running your production code using ESM syntax, what issues (if any) have you encountered? Please be as specific as possible and please include your tech stack (build tool, application framework, testing framework, runtime customizations, etc.).

The duplicate was fixed. I will let @marco-ippolito and @mhdawson chime in but i strongly recommend that we don't have that broad of an open question + we cannot add another question, as we are well over the recommended limit

GeoffreyBooth · 2024-04-22T19:47:25Z

I suggest we find some other questions to cut, then, because I really need this information and we’ve been discussing it for the last few years, and the survey is the way it was suggested that we get this data.

mhdawson · 2024-04-23T15:07:36Z

we cannot add another question, as we are well over the recommended limit

@kyliewd, is this a hard limit of the tool.

If we just add the open ended question at the end of the survey, that should not affect the likelyhood that people don't complete the questions up till then right?

kyliewd · 2024-04-23T17:25:51Z

we cannot add another question, as we are well over the recommended limit

@kyliewd, is this a hard limit of the tool.

If we just add the open ended question at the end of the survey, that should not affect the likelyhood that people don't complete the questions up till then right?

Not a hard limit but you really start to lose folks after question 10 - so you're at risk for that. my goal is to help you all get the best response / completion rate here! 😄

kyliewd · 2024-04-23T17:27:21Z

@mhdawson if we need to add the question suggestion from @GeoffreyBooth it needs to be shortened/simplified.

GeoffreyBooth · 2024-04-24T02:26:59Z

Here’s a shortened version:

Have you encountered any issues writing TypeScript where the production code used ES module syntax? If so, please include as much detail as possible such as tech stack.

kyliewd · 2024-04-24T15:32:22Z

Survey is live: https://linuxfoundation.surveymonkey.com/r/nodenext10survey24

styfle · 2024-04-24T15:51:57Z

We make the distinction between local OS vs production OS, but then the next question for architecture does not make that distinction.

I think we need it there too. For example, macOS and arm for local vs Linux and x84 for production.

TLDR

Change this question:

What is your architecture in which you are running Node.js?

Into two questions:

What architecture is your local development environment?
What architecture is your production environment?

wesleytodd · 2024-04-24T20:31:06Z

https://x.com/justinfagnani/status/1783231031396721131

I thought this was good feedback. Is this something we can change while it is inflight?

mhdawson · 2024-04-24T20:31:15Z

@kyliewd thanks for all of your help on the survey so far.

kyliewd · 2024-04-24T21:16:34Z

This survey is already out in the field and gathering responses. We will not be making anymore changes as that messes with the data.

wesleytodd · 2024-04-25T20:49:30Z

~~Cool, I assume though fixing the missing "USA" would not mess with the data? Just making sure both of their feedback bits landed.~~ EDIT: just checked, which I should have done before posting and I see it is already addressed. Great job @kyliewd! Sorry for the noise.

kyliewd · 2024-04-26T15:29:59Z

EOW Update: 494 responses. I will update y'all weekly on the numbers. Keep promoting / telling your communities.

The survey will close on May 24.

kyliewd · 2024-05-06T16:36:19Z

Survey update: We have 1,612 responses. Please take the survey + tell your collaborator friends!

YamiOdymel · 2024-05-07T09:01:31Z

I told my collaborator friends and they said Taiwan and Hong Kong are not in the country list 💀

GeoffreyBooth · 2024-05-07T15:11:55Z

I told my collaborator friends and they said Taiwan and Hong Kong are not in the country list 💀

And yet the list includes some questionable options:

Austrian Empire
Brunswick and Lüneburg
Central American Federation
Congo Free State
Czechoslovakia
Duchy of Parma
East Germany (German Democratic Republic)
Grand Duchy of Tuscany
Hanover
Hanseatic Republics
Hesse
Kingdom of Serbia/Yugoslavia
Lew Chew
Mecklenburg-Schwerin
Mecklenburg-Strelitz
Nassau
North German Confederation
North German Union
Oldenburg*
Orange Free State
Papal States
Piedmont-Sardinia
Republic of Genoa
Schaumburg-Lippe
Two Sicilies
Union of Soviet Socialist Republics
Württemberg

The list in the survey appears to be derived from this list of all countries with which the United States has ever had diplomatic relations, which would explain why an earlier version excluded the United States. A better list might be ISO 3166: https://en.wikipedia.org/wiki/List_of_ISO_3166_country_codes

kyliewd · 2024-05-07T16:53:28Z

I told my collaborator friends and they said Taiwan and Hong Kong are not in the country list 💀

And yet the list includes some questionable options:

Austrian Empire

Brunswick and Lüneburg

Central American Federation

Congo Free State

Czechoslovakia

Duchy of Parma

East Germany (German Democratic Republic)

Grand Duchy of Tuscany

Hanover

Hanseatic Republics

Hesse

Kingdom of Serbia/Yugoslavia

Lew Chew

Mecklenburg-Schwerin

Mecklenburg-Strelitz

Nassau

North German Confederation

North German Union

Oldenburg*

Orange Free State

Papal States

Piedmont-Sardinia

Republic of Genoa

Schaumburg-Lippe

Two Sicilies

Union of Soviet Socialist Republics

Württemberg

The list in the survey appears to be derived from this list of all countries with which the United States has ever had diplomatic relations, which would explain why an earlier version of excluded the United States. A better list might be ISO 3166: https://en.wikipedia.org/wiki/List_of_ISO_3166_country_codes

This has been adjusted.

kyliewd · 2024-05-13T15:46:09Z

we are at 2,312 responses for the survey. 🎉 A little less than 2 weeks until the survey closes. Thanks for your promotion and help here.

doc: create 2024 survey

93aea32

marco-ippolito commented Mar 21, 2024

View reviewed changes