-
Notifications
You must be signed in to change notification settings - Fork 1
Home
Bin Shi edited this page Apr 27, 2018
·
4 revisions
- Data processing using Pig/Spark/Hive, writing custom UDF, loader and storer to implement business logic (Pig, Spark, Hive)
- Implementing a data processing pipeline (Oozie, Sqoop, Pig, Spark)
- Created a Hadoop web crawler based on Nutch (Hadoop, Nutch)
- Real-time data ingestion (Flink) (todo)
- Interactive query and data visualization (Presto, Superset)
Skills: Hadoop, Pig, Spark, Hive, Oozie, Sqoop, Nutch, Flink, Presto, Superset