GitHub - rakeshgowdan/WebScraping-using-SeleniumWebDriver-And-PhantomJS

Branches Tags

Name		Name	Last commit message	Last commit date
Latest commit History 1 Commit
01webScrap_Selenium_ChromeWebDriver.py		01webScrap_Selenium_ChromeWebDriver.py
02webScrap_Selenium_Phantomjs.py		02webScrap_Selenium_Phantomjs.py
03 create-soup.py		03 create-soup.py
04 search-all-tag.py		04 search-all-tag.py
05 search-with-tag-name-and-other-attribute.py		05 search-with-tag-name-and-other-attribute.py
06 search-with-tag-name-and-string.py		06 search-with-tag-name-and-string.py
07 search-parent-child-sibling.py		07 search-parent-child-sibling.py
08 search-scope-in-beautifulsoup-object.py		08 search-scope-in-beautifulsoup-object.py
09 scrape-text-data.py		09 scrape-text-data.py
10 scrape-link.py		10 scrape-link.py
11 scrape-data-inside-table.py		11 scrape-data-inside-table.py
ghostdriver.log		ghostdriver.log
readMe.txt		readMe.txt

Repository files navigation

python 3.7
Anaconda
Sublime Text
------------------------------
pip's::
->bs4
->selenium
->requests
-----------------------------------
webpage-> locate the tag(inspect)->selenium web driver-> beautiful soup 
-----------------------------------------
selenium webdriver: because urlib or request cannot handle dynamic webpages

with chrome driver v73 and chrome v73
-----------------------------------------------------
PhantomJS:
helpless in headless webscrapping
i.e..,
when using selenium webdriver it opens up browser and freezes keyboard and mouse for a instance of time so PhantomJS is a headless webKit JavaScript API.