Dasboard Link https://www.novypro.com/profile_about/saquibahmad?Popup=memberProject&Data=1702386090197x145537296668321280
Note:- For this project, I scraped data on electric scooters from the 91wheels website as of 10th of November, 2023, focusing on the models currently available for sale in India.
ScreenShot Click Here
.png){kind=link}
• Background
• Project Goal
• Key Components
➡ Background
In today's world, the surge in popularity of electric vehicles is evident, driven by factors such as affordability and environmental friendliness. The transition from fuel-based to electric vehicles marks a significant shift in consumer preferences. As a result, electric scooters have become a focal point of interest of the two vehicle drivers, reflecting the rapid evolution and adoption of electric scooters. In India, there are 85 companies which manufacturing of total 288 scooters with 436 variants. This project aims to delve into this evolving landscape, examining manufacturers, specifications, and the changing preferences of consumers.
➡ Project Goal
The primary goal of this project is to compile, analyze, and present comprehensive data on electric scooters in India.
The main focus of this project are:-
① Provide real-time information about electric scooters available for sale in India.
② Offer a detailed list of technical information and characteristics for each brand of electric scooter and the availability in different parts of India.
③ Explore and present information about the 85 companies actively manufacturing electric scooters in India.
④ Understand and illustrate how consumer preferences have shifted from fuel-based vehicles to electric scooters.
➡ Key Components
The Electric Scooters Pipeline comprises four crucial stages:-
① Data Collection
② Data Storage
③ Data Extraction and Data Preprocessing
④ Data Visualization
Each stage is meticulously designed to ensure the accuracy, integrity, and reliability of the extracted information.
At the heart of our project lies the data collection process, where we employ webscraping techniques to gather a representative of electric scooters currently available in India.
This involves the use of cutting-edge technologies to navigate through individual electric scooter webpage to extract relevant information, and transform it into structured data.
• Using this code, extract all EV scooters webpage URL related to the particular company - Click Here (Used for Data Extraction)
• Using this code, extract all URL from the electric scooters webpage - Click Here (Used for Data Extraction)
• All electric scooter URL - Click Here (Used for Data Extraction)
- Table Creation Code Click Here
- Data Extracted Code Click Here
- Table Creation Code Click Here
- Data Extracted Code Click Here
- Table Creation Code Click Here
- Data Extracted Code Click Here
- Table Creation Code Click Here
- Data Extracted Code Click Here
• To ensure seamless and efficient data management, we leverage Azure SQL Database, a powerful cloud-based relational database service.
• Our collected data are stored securely, guaranteeing data availability, scalability, and robustness.
• This integration facilitates easy data retrieval and forms the foundation for subsequent analysis.
Database Connection Information
• In this section, we navigate the technical intricacies of data preprocessing, initially utilizing Pyspark for the extraction phase.
• Pyspark, a powerful tool for large-scale data analysis, efficiently processes and extracts the raw data.
• Following the extraction, the data is stored in CSV file format in the local system.
• The subsequent preprocessing stage is then seamlessly executed using Pyspark again.
All Raw Data's file in CSV format : Click Here
• We embark on an exploratory journey to uncover hidden patterns, anomalies.
• Employing Exploratory Data Analysis (EDA) techniques, we visualize and summarize the data.
• The process provides an initial glimpse into customer's rating and reviews, electric scooters features and characteristic, availability in different part of India.
Data Preprocessing using Pyspark : All File Click
All Clean Data's file in CSV format : Click Here
• After obtaining All Clean Data's file in CSV format, utilize Power BI for creating interactive and visually appealing dashboards and reports.
• Power BI allows for seamless visualization of insights, making it easy to communicate and interpret complex information.
Brand Image Enhancement:
Leverage insights to enhance the brand image by aligning electric scooters with features that resonate positively with consumers.
Sustainability Messaging:
Use consumer preferences and reviews to emphasize the environmental benefits of electric scooters, contributing to sustainability messaging.
Customer-Centric Improvements:
Focus on customer-centric improvements by addressing issues raised in reviews, leading to enhanced customer satisfaction and loyalty.
Reflect on how the project contributes to the evolution of the electric industry and fosters a culture of data-driven decision-making.
• No project is without its challenges and learning experiences.
• In this subsection, we candidly discuss the hurdles we encountered during the project's lifecycle and the strategies we employed to overcome them.
• These insights serve as a valuable resource for future endeavors.
• As technology and data science methodologies evolve, so too will our project.
• We outline potential avenues for future enhancements, including the integration of additional data sources, implementation of more advanced analytics, and exploration of predictive modeling.
• Webscraping - Python
• Data Storage - Azure SQL Database
• Data Extraction and Preprocessing - Pyspark
• Data Visualization - Power Bi