Skip to content
This repository

HTTPS clone URL

Subversion checkout URL

You can clone with HTTPS or Subversion.

Download ZIP

Flexible and powerful data analysis / manipulation library for Python, providing labeled data structures similar to R data.frame objects, statistical functions, and much more

This branch is 0 commits ahead and 0 commits behind master

Merge pull request #3569 from cpcloud/iterrows-doc-3566

DOC: document non-preservation of dtypes across rows with iterrows
latest commit d9dc1cbc4c
jreback jreback authored May 11, 2013
Octocat-spinner-32 LICENSES RLS: Version 0.10.0 final December 17, 2012
Octocat-spinner-32 bench PERF: added vb_suite test for groupby_transform March 25, 2013
Octocat-spinner-32 ci ENH: add ability to read html tables directly into DataFrames May 03, 2013
Octocat-spinner-32 doc DOC: document non-preservation of dtypes across rows with iterrows May 10, 2013
Octocat-spinner-32 examples Using autopep8 (https://github.com/hhatto/autopep8) on all py files. January 03, 2013
Octocat-spinner-32 fake_pyrex BLD: add back fake_pyrex January 08, 2012
Octocat-spinner-32 pandas DOC: document non-preservation of dtypes across rows with iterrows May 10, 2013
Octocat-spinner-32 scripts DOC: RELEASE.rst mention new options disp.height/width and deprecated… April 22, 2013
Octocat-spinner-32 vb_suite BUG: fix df repr troubles GH3337 April 22, 2013
Octocat-spinner-32 .coveragerc misc documentation, some work on rpy2 interface. near git migration September 19, 2010
Octocat-spinner-32 .gitignore BLD: test_perf will read BUILD_CACHE_DIR from .build_cache_dir if it … March 27, 2013
Octocat-spinner-32 .travis.yml BLD: travis network cache April 17, 2013
Octocat-spinner-32 CONTRIBUTING.md DOC: CONTRIBUTING.md, add link to discussion on plotting code convent… May 03, 2013
Octocat-spinner-32 LICENSE RLS: Version 0.10.0 final December 17, 2012
Octocat-spinner-32 MANIFEST.in BLD: include licenses directory December 10, 2012
Octocat-spinner-32 Makefile BLD: pandas imports. lot of stuff still broken though November 30, 2012
Octocat-spinner-32 README.rst DOC: readme.rst May 10, 2013
Octocat-spinner-32 RELEASE.rst DOC: minor release.rst changes May 10, 2013
Octocat-spinner-32 ez_setup.py Using autopep8 (https://github.com/hhatto/autopep8) on all py files. January 03, 2013
Octocat-spinner-32 setup.py ENH: add ability to read html tables directly into DataFrames May 03, 2013
Octocat-spinner-32 test.sh TST: skip test raising unsortable warning on 32-bit windows, other pl… June 28, 2012
Octocat-spinner-32 test_fast.sh TST: use nose feature to allow rerunning only failed tests December 12, 2012
Octocat-spinner-32 test_multi.sh TST: script for splitting test suite over processes December 01, 2012
Octocat-spinner-32 test_perf.sh BLD: fix path handling in test_perf March 27, 2013
Octocat-spinner-32 test_rebuild.sh TST: pass cmd line args to test scripts so can append -v etc May 07, 2012
Octocat-spinner-32 tox.ini BLD: tox, don't clean up build dir, permissions often get in the way March 31, 2013
Octocat-spinner-32 tox.sh BLD: Add 2to3 caching, move the build cache logic into use_build_cach… April 14, 2013
Octocat-spinner-32 tox_prll.ini BLD: tox, don't clean up build dir, permissions often get in the way March 31, 2013
Octocat-spinner-32 tox_prll.sh BLD: Add 2to3 caching, move the build cache logic into use_build_cach… April 14, 2013
README.rst

pandas: powerful Python data analysis toolkit

https://travis-ci.org/pydata/pandas.png

What is it

pandas is a Python package providing fast, flexible, and expressive data structures designed to make working with "relational" or "labeled" data both easy and intuitive. It aims to be the fundamental high-level building block for doing practical, real world data analysis in Python. Additionally, it has the broader goal of becoming the most powerful and flexible open source data analysis / manipulation tool available in any language. It is already well on its way toward this goal.

Main Features

Here are just a few of the things that pandas does well:

  • Easy handling of missing data (represented as NaN) in floating point as well as non-floating point data
  • Size mutability: columns can be inserted and deleted from DataFrame and higher dimensional objects
  • Automatic and explicit data alignment: objects can be explicitly aligned to a set of labels, or the user can simply ignore the labels and let Series, DataFrame, etc. automatically align the data for you in computations
  • Powerful, flexible group by functionality to perform split-apply-combine operations on data sets, for both aggregating and transforming data
  • Make it easy to convert ragged, differently-indexed data in other Python and NumPy data structures into DataFrame objects
  • Intelligent label-based slicing, fancy indexing, and subsetting of large data sets
  • Intuitive merging and joining data sets
  • Flexible reshaping and pivoting of data sets
  • Hierarchical labeling of axes (possible to have multiple labels per tick)
  • Robust IO tools for loading data from flat files (CSV and delimited), Excel files, databases, and saving / loading data from the ultrafast HDF5 format
  • Time series-specific functionality: date range generation and frequency conversion, moving window statistics, moving window linear regressions, date shifting and lagging, etc.

Where to get it

The source code is currently hosted on GitHub at: http://github.com/pydata/pandas

Binary installers for the latest released version are available at the Python package index:

http://pypi.python.org/pypi/pandas/

And via easy_install or pip:

easy_install pandas
pip install pandas

Dependencies

Highly Recommended Dependencies

  • numexpr
    • Needed to accelerate some expression evaluation operations
    • Required by PyTables
  • bottleneck
    • Needed to accelerate certain numerical operations

Optional dependencies

  • Cython: Only necessary to build development version. Version 0.17.1 or higher.

  • SciPy: miscellaneous statistical functions

  • PyTables: necessary for HDF5-based storage

  • matplotlib: for plotting

  • statsmodels
  • openpyxl, xlrd/xlwt
    • openpyxl version 1.6.1 or higher, for writing .xlsx files
    • xlrd >= 0.9.0
    • Needed for Excel I/O
  • lxml, or Beautiful Soup 4: for reading HTML tables
    • The differences between lxml and Beautiful Soup 4 are mostly speed (lxml is faster), however sometimes Beautiful Soup returns what you might intuitively expect. Both backends are implemented, so try them both to see which one you like. They should return very similar results.
    • Note that lxml requires Cython to build successfully
  • boto: necessary for Amazon S3 access.

Installation from sources

To install pandas from source you need cython in addition to the normal dependencies above, which can be installed from pypi:

pip install cython

In the pandas directory (same one where you found this file after cloning the git repo), execute:

python setup.py install

or for installing in development mode:

python setup.py develop

Alternatively, you can use pip if you want all the dependencies pulled in automatically (the optional -e option is for installing it in development mode):

pip install -e .

On Windows, you will need to install MinGW and execute:

python setup.py build --compiler=mingw32
python setup.py install

See http://pandas.pydata.org/ for more information.

License

BSD

Documentation

The official documentation is hosted on PyData.org: http://pandas.pydata.org/

The Sphinx documentation should provide a good starting point for learning how to use the library. Expect the docs to continue to expand as time goes on.

Background

Work on pandas started at AQR (a quantitative hedge fund) in 2008 and has been under active development since then.

Discussion and Development

Since pandas development is related to a number of other scientific Python projects, questions are welcome on the scipy-user mailing list. Specialized discussions or design issues should take place on the pystatsmodels mailing list / Google group, where scikits.statsmodels and other libraries will also be discussed:

http://groups.google.com/group/pystatsmodels

Something went wrong with that request. Please try again.