Navigation Menu

Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Blaze loader #775

Merged
merged 46 commits into from Oct 21, 2015
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
46 commits
Select commit Hold shift + click to select a range
b032b68
ENH: Adds a blaze pipeline loader.
Sep 22, 2015
8f66138
ENH: allows any iterator to be the return of load_adjusted_arrays
Oct 3, 2015
6e43358
ENH: preallocate the output dataframe
Oct 3, 2015
f88cd17
TST: adds tmp_assets_db and tmp_asset_finder so we don't need an enti…
Oct 3, 2015
4d7d5ce
TST: Adds some test cases for the blaze loader
Oct 3, 2015
4c98c94
ENH: Adds repr for datasets
Oct 5, 2015
22a2277
ENH: adds CustomFactor.from_function
Oct 5, 2015
d621f1e
ENH: Updates the blaze loader and adds more tests
Oct 5, 2015
e3bf786
BLD: blaze it up
Oct 6, 2015
898fbad
BLD: Can't use setup.py with git reqs unless you want to do a lot of …
Oct 6, 2015
f7ad82f
TST: updates tests after rebasing
Oct 6, 2015
8c1bcd6
BLD: show versions on travis
Oct 6, 2015
a58fe4b
BUG: python2 implicit import is the worst feature ever
Oct 6, 2015
0ec1cbc
MAINT: rename pipeline_api_from_blaze to from_blaze
Oct 6, 2015
26b47a1
MAINT: treat Pipeline API as a proper noun
Oct 6, 2015
78101fd
MAINT: Cleanup docstrings and comments
Oct 6, 2015
2df4dfd
MAINT: name filter predicate
Oct 6, 2015
8ec562e
DOC: blaze loader docstring
Oct 6, 2015
9c37011
BUG: Only simple expressions for array-like dshape
Oct 6, 2015
a18b1d7
ENH: PY2 compat with blaze loader
Oct 7, 2015
fca637a
ENH: Adds a better error if root mask is empty
Oct 9, 2015
345a7ea
ENH: Fix nop adjustments
Oct 9, 2015
11ba768
ENH: allow columns from different datasets
Oct 9, 2015
1e8d4dd
ENH: Allows blaze loader to be used as a loader_dispatcher
Oct 9, 2015
a776367
MAINT: remove from_function. We can revisit this later
Oct 12, 2015
22ffe3f
ENH: adds expect_element preprocessor
Oct 12, 2015
d3c0463
ENH: Addresses comments
Oct 12, 2015
1e05a1c
TST: fix py2 compat for test
Oct 13, 2015
f897bcd
rename expr to dataset in type error
Oct 13, 2015
971848f
MAINT: reshuffle logic in from_blaze to make the control flow easier
Oct 13, 2015
c7ca016
MAINT: refactor tmp_db_uri to use make_simple_assetinfo
Oct 13, 2015
0183d0a
ENH: Allows Float64Adjustments to act on a range of columns
Oct 13, 2015
1db29a9
ENH: handle amendments between trading days
Oct 13, 2015
0fff04d
DOC: update doctest
Oct 14, 2015
e9ec709
MAINT: expect_value doctest and lambda over toolz
Oct 14, 2015
c58f013
MAINT: map(retrieve_asset) -> retrieve_all
Oct 14, 2015
3fb91e4
MAINT: cleanup doctests
Oct 14, 2015
e4abddd
ENH: updates tests to use first and last col
Oct 14, 2015
aedbbcc
BLD: blaze ecosystem commits
Oct 14, 2015
c714fe5
BUG: Makes macro dataset loader return a concrete ndarray.
Oct 16, 2015
7afe7d6
ENH: remove blazeloader repr, too verbose
Oct 16, 2015
4238391
DOC: docstring cleanup
Oct 16, 2015
1371bf2
BUG: support case there are more sids requested than available in a b…
Oct 16, 2015
b8452b8
TST: test case where there are more sids requested than available
Oct 16, 2015
5112421
BUG: Fix the firstlineno of the validated functions
Oct 19, 2015
420df53
ENH: pull sentinel construction into a function
Oct 19, 2015
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Jump to
Jump to file
Failed to load files.
Diff view
Diff view
2 changes: 2 additions & 0 deletions .travis.yml
Expand Up @@ -21,7 +21,9 @@ install:
- conda install --yes -c https://conda.binstar.org/Quantopian numpy=$NUMPY_VERSION pandas=$PANDAS_VERSION scipy==$SCIPY_VERSION matplotlib Cython patsy statsmodels tornado pyparsing xlrd mock pytz requests six dateutil ta-lib logbook
- pip install --upgrade pip nose-timer coverage
- pip install -e .[dev]
- pip install -r etc/requirements_blaze.txt
before_script:
- pip freeze | sort
- "flake8 zipline tests"
script:
- nosetests --with-timer --exclude=^test_examples --with-coverage --cover-package=zipline
Expand Down
3 changes: 3 additions & 0 deletions etc/requirements_blaze.txt
@@ -0,0 +1,3 @@
-e git://github.com/quantopian/blaze.git@787e79850a5e1ed3072a15f3d6d1acb6308af051#egg=blaze-dev
-e git://github.com/quantopian/odo.git@a79cef896ad13afe356fd104714d74a5019eb761#egg=odo-dev
-e git://github.com/quantopian/datashape.git@8896ab63fee76100769404abb6b2676dc8cab3f1#egg=datashape-dev
24 changes: 12 additions & 12 deletions tests/pipeline/test_adjusted_array.py
Expand Up @@ -95,7 +95,7 @@ def _gen_multiplicative_adjustment_cases(dtype):

# Note that row indices are inclusive!
adjustments[1] = [
adjustment_type(0, 0, 0, dtype(2)),
adjustment_type(0, 0, 0, 0, dtype(2)),
]
buffer_as_of[1] = array([[2, 1, 1],
[1, 1, 1],
Expand All @@ -108,8 +108,8 @@ def _gen_multiplicative_adjustment_cases(dtype):
buffer_as_of[2] = buffer_as_of[1]

adjustments[3] = [
adjustment_type(1, 2, 1, dtype(3)),
adjustment_type(0, 1, 0, dtype(4)),
adjustment_type(1, 2, 1, 1, dtype(3)),
adjustment_type(0, 1, 0, 0, dtype(4)),
]
buffer_as_of[3] = array([[8, 1, 1],
[4, 3, 1],
Expand All @@ -119,7 +119,7 @@ def _gen_multiplicative_adjustment_cases(dtype):
[1, 1, 1]], dtype=dtype)

adjustments[4] = [
adjustment_type(0, 3, 2, dtype(5))
adjustment_type(0, 3, 2, 2, dtype(5))
]
buffer_as_of[4] = array([[8, 1, 5],
[4, 3, 5],
Expand All @@ -129,8 +129,8 @@ def _gen_multiplicative_adjustment_cases(dtype):
[1, 1, 1]], dtype=dtype)

adjustments[5] = [
adjustment_type(0, 4, 1, dtype(6)),
adjustment_type(2, 2, 2, dtype(7)),
adjustment_type(0, 4, 1, 1, dtype(6)),
adjustment_type(2, 2, 2, 2, dtype(7)),
]
buffer_as_of[5] = array([[8, 6, 5],
[4, 18, 5],
Expand Down Expand Up @@ -162,7 +162,7 @@ def _gen_overwrite_adjustment_cases(dtype):

# Note that row indices are inclusive!
adjustments[1] = [
adjustment_type(0, 0, 0, dtype(1)),
adjustment_type(0, 0, 0, 0, dtype(1)),
]
buffer_as_of[1] = array([[1, 2, 2],
[2, 2, 2],
Expand All @@ -175,8 +175,8 @@ def _gen_overwrite_adjustment_cases(dtype):
buffer_as_of[2] = buffer_as_of[1]

adjustments[3] = [
adjustment_type(1, 2, 1, dtype(3)),
adjustment_type(0, 1, 0, dtype(4)),
adjustment_type(1, 2, 1, 1, dtype(3)),
adjustment_type(0, 1, 0, 0, dtype(4)),
]
buffer_as_of[3] = array([[4, 2, 2],
[4, 3, 2],
Expand All @@ -186,7 +186,7 @@ def _gen_overwrite_adjustment_cases(dtype):
[2, 2, 2]], dtype=dtype)

adjustments[4] = [
adjustment_type(0, 3, 2, dtype(5))
adjustment_type(0, 3, 2, 2, dtype(5))
]
buffer_as_of[4] = array([[4, 2, 5],
[4, 3, 5],
Expand All @@ -196,8 +196,8 @@ def _gen_overwrite_adjustment_cases(dtype):
[2, 2, 2]], dtype=dtype)

adjustments[5] = [
adjustment_type(0, 4, 1, dtype(6)),
adjustment_type(2, 2, 2, dtype(7)),
adjustment_type(0, 4, 1, 1, dtype(6)),
adjustment_type(2, 2, 2, 2, dtype(7)),
]
buffer_as_of[5] = array([[4, 6, 5],
[4, 6, 5],
Expand Down