Skip to content
This repository has been archived by the owner on Dec 31, 2019. It is now read-only.
/ ibis-demo Public archive

Demo notebook of Ibis for "Spark + Python + Dita science Festival"

License

Notifications You must be signed in to change notification settings

chezou/ibis-demo

Repository files navigation

Ibis demo notebook

This is the demo notebook of Ibis.

This demo use MovieLens 20M data.

  • ibis_demo_en.ipynb
    • Full demo of ibis, seaborn and scikit-learn
  • ibis_demo_en_short.ipynb
    • Short version of ibis_demo_en.ipynb
  • ibis_demo.ipynb
    • Full demo (Japanese version)
  • ibis_demo_short.ipynb
    • Short version of ibis_demo.ipynb
  • ibis_demo_redshift.ipynb
    • Redshift version of ibis_demo.ipynb. Not working correctly

For Japanese

日本語のIbis導入の説明はこちらのblogがわかりやすいです。

概要はこちらのスライドも参考にしてください。

Requirements

  • Impala cluster
  • ibis-framework
  • scikit-learn
  • matplotlib
  • seaborn

It is assume the following tables:

  • tags_pq_s3
  • ratings_pq_s3
  • movies_pq_s3

You can use create_table.sql and create_parquet_table.sql to create tables.

License

MIT License

About

Demo notebook of Ibis for "Spark + Python + Dita science Festival"

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published