Tayio_AI Web Scrapping Assignment(Data Engineer) --Anurag Krishnan #74
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
In the web scraping assignment, I have set up a web scraper using Selenium and Python to extract data from a specific website related to tenders. The scraper utilized Selenium WebDriver to interact with the website, input a search query, and navigate through multiple pages to collect tender-related information. I modularized the code and organized it into a Python class, promoting reusability and maintainability. Additionally, I successfully handled web scraping, data extraction, and data transformation, ultimately saving the collected data to a CSV file for further analysis and visualization. Lastly, you followed best practices in Git, forking a repository, creating branches, committing changes, and creating a pull request to contribute your code.