-
Notifications
You must be signed in to change notification settings - Fork 2
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
- Loading branch information
Showing
11 changed files
with
13,122 additions
and
5 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,94 @@ | ||
| <!DOCTYPE html PUBLIC "-//W3C//DTD HTML 4.0 Transitional//EN"> | ||
| <html><head><title>Python: module btc_data_collector</title> | ||
| <meta http-equiv="Content-Type" content="text/html; charset=utf-8"> | ||
| </head><body bgcolor="#f0f0f8"> | ||
|
|
||
| <table width="100%" cellspacing=0 cellpadding=2 border=0 summary="heading"> | ||
| <tr bgcolor="#7799ee"> | ||
| <td valign=bottom> <br> | ||
| <font color="#ffffff" face="helvetica, arial"> <br><big><big><strong>btc_data_collector</strong></big></big></font></td | ||
| ><td align=right valign=bottom | ||
| ><font color="#ffffff" face="helvetica, arial"><a href=".">index</a><br><a href="file:c%3A%5Cusers%5Cvivan%5Cdesktop%5Ccl%5Cseds%5Cpybcoin%5Cpybcoin%5Cdatacollector%5Cbtc_data_collector.py">c:\users\vivan\desktop\cl\seds\pybcoin\pybcoin\datacollector\btc_data_collector.py</a></font></td></tr></table> | ||
| <p><tt>Module name: btc_data_collector<br> | ||
| Description: Module for collecting day level Bitcoin specific data<br> | ||
| like, price, number of tweets, volume of buy and sell transactions.</tt></p> | ||
| <p> | ||
| <table width="100%" cellspacing=0 cellpadding=2 border=0 summary="section"> | ||
| <tr bgcolor="#aa55cc"> | ||
| <td colspan=3 valign=bottom> <br> | ||
| <font color="#ffffff" face="helvetica, arial"><big><strong>Modules</strong></big></font></td></tr> | ||
|
|
||
| <tr><td bgcolor="#aa55cc"><tt> </tt></td><td> </td> | ||
| <td width="100%"><table width="100%" summary="list"><tr><td width="25%" valign=top><a href="logging.html">logging</a><br> | ||
| </td><td width="25%" valign=top><a href="pandas.html">pandas</a><br> | ||
| </td><td width="25%" valign=top><a href="quandl.html">quandl</a><br> | ||
| </td><td width="25%" valign=top><a href="requests.html">requests</a><br> | ||
| </td></tr></table></td></tr></table><p> | ||
| <table width="100%" cellspacing=0 cellpadding=2 border=0 summary="section"> | ||
| <tr bgcolor="#ee77aa"> | ||
| <td colspan=3 valign=bottom> <br> | ||
| <font color="#ffffff" face="helvetica, arial"><big><strong>Classes</strong></big></font></td></tr> | ||
|
|
||
| <tr><td bgcolor="#ee77aa"><tt> </tt></td><td> </td> | ||
| <td width="100%"><dl> | ||
| <dt><font face="helvetica, arial"><a href="builtins.html#object">builtins.object</a> | ||
| </font></dt><dd> | ||
| <dl> | ||
| <dt><font face="helvetica, arial"><a href="btc_data_collector.html#BtcDataCollector">BtcDataCollector</a> | ||
| </font></dt></dl> | ||
| </dd> | ||
| </dl> | ||
| <p> | ||
| <table width="100%" cellspacing=0 cellpadding=2 border=0 summary="section"> | ||
| <tr bgcolor="#ffc8d8"> | ||
| <td colspan=3 valign=bottom> <br> | ||
| <font color="#000000" face="helvetica, arial"><a name="BtcDataCollector">class <strong>BtcDataCollector</strong></a>(<a href="builtins.html#object">builtins.object</a>)</font></td></tr> | ||
|
|
||
| <tr bgcolor="#ffc8d8"><td rowspan=2><tt> </tt></td> | ||
| <td colspan=2><tt>The <a href="builtins.html#object">object</a> for retrieving daily data for bitcoin specific<br> | ||
| factors.The prices are retreived once a day at a predefined<br> | ||
| time. If the current for the current day is not available,<br> | ||
| latest available data is used.<br> | ||
| :member attributes: logger: logger instance<br> | ||
| api_key: Quandl API key<br> | ||
| tweet_count_url: Url to retrieve<br> | ||
| tweets count<br> | ||
| <br> | ||
| :member functions: fetch_btc_price<br> | ||
| fetch_tweet_counts<br> | ||
| fetch_transaction_volume<br> </tt></td></tr> | ||
| <tr><td> </td> | ||
| <td width="100%">Methods defined here:<br> | ||
| <dl><dt><a name="BtcDataCollector-__init__"><strong>__init__</strong></a>(self, params)</dt><dd><tt>Initialize self. See help(type(self)) for accurate signature.</tt></dd></dl> | ||
|
|
||
| <dl><dt><a name="BtcDataCollector-fetch_btc_price"><strong>fetch_btc_price</strong></a>(self)</dt><dd><tt>Method to fetch the current bitcoin price.<br> | ||
| The price is in USD and is retreived from<br> | ||
| the CoinDesk index.<br> | ||
| : param self<br> | ||
| : return btc_price(float)<br> | ||
| error_val(int)</tt></dd></dl> | ||
|
|
||
| <dl><dt><a name="BtcDataCollector-fetch_transaction_volume"><strong>fetch_transaction_volume</strong></a>(self)</dt><dd><tt>Method to fetch the daily bitcoin transaction<br> | ||
| volume in USD.<br> | ||
| : param self<br> | ||
| : return nyse_index(pandas Dataframe)<br> | ||
| error_val(int)</tt></dd></dl> | ||
|
|
||
| <dl><dt><a name="BtcDataCollector-fetch_tweet_counts"><strong>fetch_tweet_counts</strong></a>(self)</dt><dd><tt>Method to fetch the daily estimated number of tweets<br> | ||
| with bitcoin related hastags. The function parses the<br> | ||
| HTML page to retrieve the tweet counts.<br> | ||
| <br> | ||
| : param self<br> | ||
| : return tweet_count(pandas Dataframes)<br> | ||
| error_val(int)</tt></dd></dl> | ||
|
|
||
| <hr> | ||
| Data descriptors defined here:<br> | ||
| <dl><dt><strong>__dict__</strong></dt> | ||
| <dd><tt>dictionary for instance variables (if defined)</tt></dd> | ||
| </dl> | ||
| <dl><dt><strong>__weakref__</strong></dt> | ||
| <dd><tt>list of weak references to the object (if defined)</tt></dd> | ||
| </dl> | ||
| </td></tr></table></td></tr></table> | ||
| </body></html> |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,72 @@ | ||
| <!DOCTYPE html PUBLIC "-//W3C//DTD HTML 4.0 Transitional//EN"> | ||
| <html><head><title>Python: module controller_collector</title> | ||
| <meta http-equiv="Content-Type" content="text/html; charset=utf-8"> | ||
| </head><body bgcolor="#f0f0f8"> | ||
|
|
||
| <table width="100%" cellspacing=0 cellpadding=2 border=0 summary="heading"> | ||
| <tr bgcolor="#7799ee"> | ||
| <td valign=bottom> <br> | ||
| <font color="#ffffff" face="helvetica, arial"> <br><big><big><strong>controller_collector</strong></big></big></font></td | ||
| ><td align=right valign=bottom | ||
| ><font color="#ffffff" face="helvetica, arial"><a href=".">index</a><br><a href="file:c%3A%5Cusers%5Cvivan%5Cdesktop%5Ccl%5Cseds%5Cpybcoin%5Cpybcoin%5Cdatacollector%5Ccontroller_collector.py">c:\users\vivan\desktop\cl\seds\pybcoin\pybcoin\datacollector\controller_collector.py</a></font></td></tr></table> | ||
| <p><tt>Module name: controller_collector<br> | ||
| Description: Controller module for all data collection.</tt></p> | ||
| <p> | ||
| <table width="100%" cellspacing=0 cellpadding=2 border=0 summary="section"> | ||
| <tr bgcolor="#aa55cc"> | ||
| <td colspan=3 valign=bottom> <br> | ||
| <font color="#ffffff" face="helvetica, arial"><big><strong>Modules</strong></big></font></td></tr> | ||
|
|
||
| <tr><td bgcolor="#aa55cc"><tt> </tt></td><td> </td> | ||
| <td width="100%"><table width="100%" summary="list"><tr><td width="25%" valign=top><a href="logging.html">logging</a><br> | ||
| </td><td width="25%" valign=top><a href="os.html">os</a><br> | ||
| </td><td width="25%" valign=top><a href="pandas.html">pandas</a><br> | ||
| </td><td width="25%" valign=top><a href="sys.html">sys</a><br> | ||
| </td></tr></table></td></tr></table><p> | ||
| <table width="100%" cellspacing=0 cellpadding=2 border=0 summary="section"> | ||
| <tr bgcolor="#ee77aa"> | ||
| <td colspan=3 valign=bottom> <br> | ||
| <font color="#ffffff" face="helvetica, arial"><big><strong>Classes</strong></big></font></td></tr> | ||
|
|
||
| <tr><td bgcolor="#ee77aa"><tt> </tt></td><td> </td> | ||
| <td width="100%"><dl> | ||
| <dt><font face="helvetica, arial"><a href="builtins.html#object">builtins.object</a> | ||
| </font></dt><dd> | ||
| <dl> | ||
| <dt><font face="helvetica, arial"><a href="controller_collector.html#ControllerCollector">ControllerCollector</a> | ||
| </font></dt></dl> | ||
| </dd> | ||
| </dl> | ||
| <p> | ||
| <table width="100%" cellspacing=0 cellpadding=2 border=0 summary="section"> | ||
| <tr bgcolor="#ffc8d8"> | ||
| <td colspan=3 valign=bottom> <br> | ||
| <font color="#000000" face="helvetica, arial"><a name="ControllerCollector">class <strong>ControllerCollector</strong></a>(<a href="builtins.html#object">builtins.object</a>)</font></td></tr> | ||
|
|
||
| <tr bgcolor="#ffc8d8"><td rowspan=2><tt> </tt></td> | ||
| <td colspan=2><tt>The controller <a href="builtins.html#object">object</a> for data collection pipeline. Responsible<br> | ||
| for triggering and monitoring the daily streaming data collection<br> | ||
| from all data sources.<br> | ||
| :member attributes: logger: logger instance<br> | ||
| config: config file path<br> | ||
| <br> | ||
| :member functions: data_collect_pipeline<br> </tt></td></tr> | ||
| <tr><td> </td> | ||
| <td width="100%">Methods defined here:<br> | ||
| <dl><dt><a name="ControllerCollector-__init__"><strong>__init__</strong></a>(self, config_file)</dt><dd><tt>Initialize self. See help(type(self)) for accurate signature.</tt></dd></dl> | ||
|
|
||
| <dl><dt><a name="ControllerCollector-data_collection_pipeline"><strong>data_collection_pipeline</strong></a>(self)</dt><dd><tt>Method to call the data collector modules to retreive latest<br> | ||
| data.<br> | ||
| : param self<br> | ||
| : return ret_val(int)</tt></dd></dl> | ||
|
|
||
| <hr> | ||
| Data descriptors defined here:<br> | ||
| <dl><dt><strong>__dict__</strong></dt> | ||
| <dd><tt>dictionary for instance variables (if defined)</tt></dd> | ||
| </dl> | ||
| <dl><dt><strong>__weakref__</strong></dt> | ||
| <dd><tt>list of weak references to the object (if defined)</tt></dd> | ||
| </dl> | ||
| </td></tr></table></td></tr></table> | ||
| </body></html> |
69 changes: 69 additions & 0 deletions
69
doc/documentation/DataCollector/google_trends_collector.html
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,69 @@ | ||
| <!DOCTYPE html PUBLIC "-//W3C//DTD HTML 4.0 Transitional//EN"> | ||
| <html><head><title>Python: module google_trends_collector</title> | ||
| <meta http-equiv="Content-Type" content="text/html; charset=utf-8"> | ||
| </head><body bgcolor="#f0f0f8"> | ||
|
|
||
| <table width="100%" cellspacing=0 cellpadding=2 border=0 summary="heading"> | ||
| <tr bgcolor="#7799ee"> | ||
| <td valign=bottom> <br> | ||
| <font color="#ffffff" face="helvetica, arial"> <br><big><big><strong>google_trends_collector</strong></big></big></font></td | ||
| ><td align=right valign=bottom | ||
| ><font color="#ffffff" face="helvetica, arial"><a href=".">index</a><br><a href="file:c%3A%5Cusers%5Cvivan%5Cdesktop%5Ccl%5Cseds%5Cpybcoin%5Cpybcoin%5Cdatacollector%5Cgoogle_trends_collector.py">c:\users\vivan\desktop\cl\seds\pybcoin\pybcoin\datacollector\google_trends_collector.py</a></font></td></tr></table> | ||
| <p><tt>Module name: google_trends_collector<br> | ||
| Description: Module for collecting data on how bitcoin<br> | ||
| is trending on google.</tt></p> | ||
| <p> | ||
| <table width="100%" cellspacing=0 cellpadding=2 border=0 summary="section"> | ||
| <tr bgcolor="#aa55cc"> | ||
| <td colspan=3 valign=bottom> <br> | ||
| <font color="#ffffff" face="helvetica, arial"><big><strong>Modules</strong></big></font></td></tr> | ||
|
|
||
| <tr><td bgcolor="#aa55cc"><tt> </tt></td><td> </td> | ||
| <td width="100%"><table width="100%" summary="list"><tr><td width="25%" valign=top><a href="logging.html">logging</a><br> | ||
| </td><td width="25%" valign=top><a href="pandas.html">pandas</a><br> | ||
| </td><td width="25%" valign=top></td><td width="25%" valign=top></td></tr></table></td></tr></table><p> | ||
| <table width="100%" cellspacing=0 cellpadding=2 border=0 summary="section"> | ||
| <tr bgcolor="#ee77aa"> | ||
| <td colspan=3 valign=bottom> <br> | ||
| <font color="#ffffff" face="helvetica, arial"><big><strong>Classes</strong></big></font></td></tr> | ||
|
|
||
| <tr><td bgcolor="#ee77aa"><tt> </tt></td><td> </td> | ||
| <td width="100%"><dl> | ||
| <dt><font face="helvetica, arial"><a href="builtins.html#object">builtins.object</a> | ||
| </font></dt><dd> | ||
| <dl> | ||
| <dt><font face="helvetica, arial"><a href="google_trends_collector.html#GTrendsDataCollector">GTrendsDataCollector</a> | ||
| </font></dt></dl> | ||
| </dd> | ||
| </dl> | ||
| <p> | ||
| <table width="100%" cellspacing=0 cellpadding=2 border=0 summary="section"> | ||
| <tr bgcolor="#ffc8d8"> | ||
| <td colspan=3 valign=bottom> <br> | ||
| <font color="#000000" face="helvetica, arial"><a name="GTrendsDataCollector">class <strong>GTrendsDataCollector</strong></a>(<a href="builtins.html#object">builtins.object</a>)</font></td></tr> | ||
|
|
||
| <tr bgcolor="#ffc8d8"><td rowspan=2><tt> </tt></td> | ||
| <td colspan=2><tt>The <a href="builtins.html#object">object</a> for retrieving current day level data from google<br> | ||
| trends.<br> | ||
| :member attributes: logger: logger instance<br> | ||
| :member functions: fetch_trends<br> </tt></td></tr> | ||
| <tr><td> </td> | ||
| <td width="100%">Methods defined here:<br> | ||
| <dl><dt><a name="GTrendsDataCollector-__init__"><strong>__init__</strong></a>(self, params=None)</dt><dd><tt>Initialize self. See help(type(self)) for accurate signature.</tt></dd></dl> | ||
|
|
||
| <dl><dt><a name="GTrendsDataCollector-fetch_trends"><strong>fetch_trends</strong></a>(self, params=None)</dt><dd><tt>Method to fetch the google trends data for bitcoin<br> | ||
| and related keywords, for the given date.<br> | ||
| : param self<br> | ||
| : return google_trend(DataFrame)<br> | ||
| error_val(int)</tt></dd></dl> | ||
|
|
||
| <hr> | ||
| Data descriptors defined here:<br> | ||
| <dl><dt><strong>__dict__</strong></dt> | ||
| <dd><tt>dictionary for instance variables (if defined)</tt></dd> | ||
| </dl> | ||
| <dl><dt><strong>__weakref__</strong></dt> | ||
| <dd><tt>list of weak references to the object (if defined)</tt></dd> | ||
| </dl> | ||
| </td></tr></table></td></tr></table> | ||
| </body></html> |
Oops, something went wrong.