AI is significantly impacting data jobs, such as data science, analysis, and engineering. With AI, these jobs are becoming more efficient and effective, leading to faster and more accurate analysis. However, as AI continues to develop rapidly with the emergence of new tools and implementations, some individuals may struggle to adapt to the changes. This may result in a scarcity of professionals, particularly as the new AI tools replace some jobs, leading to layoffs and unemployment.
- The goal of this project is to analyze the sentiment and public opinion surrounding AI and data jobs on Twitter.
The data was scrapped by the snscrape python module, the scrapping code is on a google colab notebook, for some reason i keep getting network errors when i run the code inside a kaggle notebook. Please leave a comment below if you know how to address this issue.
The sentiment analysis showed that most tweets' sentiments were neutral. However, after six months of decline, the sentiment score spiked following the release of ChatGPT. The analysis also revealed that the topic of AI and its tools is still relatively new, with people unsure of what to think about these emerging technologies. As AI continues to evolve, it will undoubtedly impact the data professions and jobs landscape, leading to significant changes in the field.
-
Most of the tweets sentiments labels are Neutral by ~69%.
-
The topic of AI related to data jobs has seen a decline in the sentiment score from the beginning of July to December.
-
The release of Chat-GPT on November 30, 2022 spiked the sentiment score up again.
-
Data analysis has the most steady and consistent sentiment trend COMPARED to data science and data engineering.
-
Data engineering sentiment score didn't increase like the other job titles on the release date of chat-GPT, but a significant increase on the month of February.
-
Chat-GPT - Editing and modifying visualizations.
-
Rob Mulla Video about scrapping Twitter using snscrape. - Scrapping Twitter.
-
Canva - Banner design.