Demo notebook of Ibis for "Spark + Python + Dita science Festival"
Jupyter Notebook
Switch branches/tags
Nothing to show
Clone or download
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Permalink
Failed to load latest commit information.
.gitignore
LICENSE
README.md
create_parquet_table.sql
create_table.sql
ibis_demo.ipynb
ibis_demo_en.ipynb
ibis_demo_en_short.ipynb
ibis_demo_redshift.ipynb
ibis_demo_short.ipynb
requirements.txt

README.md

Ibis demo notebook

This is the demo notebook of Ibis.

This demo use MovieLens 20M data.

  • ibis_demo_en.ipynb
    • Full demo of ibis, seaborn and scikit-learn
  • ibis_demo_en_short.ipynb
    • Short version of ibis_demo_en.ipynb
  • ibis_demo.ipynb
    • Full demo (Japanese version)
  • ibis_demo_short.ipynb
    • Short version of ibis_demo.ipynb
  • ibis_demo_redshift.ipynb
    • Redshift version of ibis_demo.ipynb. Not working correctly

For Japanese

日本語のIbis導入の説明はこちらのblogがわかりやすいです。

概要はこちらのスライドも参考にしてください。

Requirements

  • Impala cluster
  • ibis-framework
  • scikit-learn
  • matplotlib
  • seaborn

It is assume the following tables:

  • tags_pq_s3
  • ratings_pq_s3
  • movies_pq_s3

You can use create_table.sql and create_parquet_table.sql to create tables.

License

MIT License