🧑‍💻 StackOverflowSurvey

Data Analytics Project in Qlik Sense Analyzing StackOverflow Survey Data

🔎 What You'll Find

This repository contains the ETL process, Qlik Script and Qlik App for the StackOverflow annual survey data spanning from 2021 to 2023. The data has been analyzed using QlikSense, resulting in an application that presents various analyses:

1. DB Engines and Languages Analysis
2. Salary Analysis
3. Developer Roles Analysis
4. Data Roles Preferences

🏗️ Project Structure

The project follows a Best Practices Framework and is organized into the following folders:

• 📁 00_Configuration: global configuration storing main variables, routes, and functions.
• 📁 01_Data: contains source files used for data extraction.
• 📁 02_Qvd: stores data in Qlik Sense proprietary file types. Includes 'Extraction (Ext)' and 'Transformation (Tra)' folders for raw and transformed data respectively.
• 📁 03_Qvs: holds Qlik Sense scripts for data extraction and transformation, organized into 'Extraction (Ext)' and 'Transformation (Tra)' sub-divisions.
• 📁 04_Py: contains Python scripts for more complex transformations not feasible in Qlik Sense.

🤔 Key Differences from StackOverflow's Analysis

While StackOverflow provides its own survey analysis, this project differs in several ways:

• Currency Conversion: utilizes average monthly rates from a trusted source (BIS) for consistent compensation data across years.
• Salary Data Adjustments: addresses inconsistencies in SO's salary data, standardizing values and filtering outliers for clarity.
• Years Considered: includes data from 2021 to 2023 for comparative analysis, unlike SO which focuses on 2022 and 2023.
• Fields Considered: considers only fields available across all surveyed years for consistent analysis.

⚠️ Considerations

• Questionnaire Changes: note changes in answer types over survey years, affecting comparability.
• Scope of Analysis: while robust, some fields may not have been utilized; future iterations could deepen the analysis.
• Currency Mapping: some currencies are not mapped in BIS; alternative sources may be considered in future updates.

🔗 Sources

• Stack Overflow Annual Developer Survey
• BIS Bilateral Exchange Rates

This project offers a comprehensive view of developer's and data role's landscapes, based on StackOverflow survey data. Feel free to explore, contribute, or extend the analysis as needed.