Skip to content

Kab777/FundsCrawler

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

28 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Funds Bot

Param Type Description
code text (255) The id of the fund you wish to search for. (ex: TDB970)
type text (255) The type of the afund you wish to search for. (ex: Balanced)

Run example

online version available at here: http://junyuzhou.com/funds.html

As of Sep 23, there are 673 unique users registered for daily investment notification.

A Python 3 based Web-Crawler/Scraper for TD Mutual Funds Website (a JS rendered website). https://www.tdcanadatrust.com/products-services/investing/mutual-funds/fund_prices.jsp

Including Crawling, Parsing, Inserting into database process.

Sample data is avaliable.

Crawling:

Using Selenium webdriver and PhantomJS to create headless browser, making javascript rendered source code avaliable for crawling.

Parsing:

Combining Regex and Beautifulsoup4 to parse html file.

Inserting:

MySQL connector/API

About

TD Mutual Funds Crawler

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages