Skip to content
TD Mutual Funds Crawler
Python
Branch: master
Clone or download
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Permalink
Type Name Latest commit message Commit time
Failed to load latest commit information.
Data
Logo
Crawling_Engine.py
README.md
analyser.py
fundsC.png
insert.py
main.py

README.md

Funds Bot

Param Type Description
code text (255) The id of the fund you wish to search for. (ex: TDB970)
type text (255) The type of the afund you wish to search for. (ex: Balanced)

Run example

online version available at here: http://junyuzhou.com/funds.html

As of Sep 23, there are 673 unique users registered for daily investment notification.

A Python 3 based Web-Crawler/Scraper for TD Mutual Funds Website (a JS rendered website). https://www.tdcanadatrust.com/products-services/investing/mutual-funds/fund_prices.jsp

Including Crawling, Parsing, Inserting into database process.

Sample data is avaliable.

Crawling:

Using Selenium webdriver and PhantomJS to create headless browser, making javascript rendered source code avaliable for crawling.

Parsing:

Combining Regex and Beautifulsoup4 to parse html file.

Inserting:

MySQL connector/API

You can’t perform that action at this time.