Name		Name	Last commit message	Last commit date
Latest commit History 8 Commits
data		data
hive_scripts		hive_scripts
json_files		json_files
nag_issues		nag_issues
pyspark_scripts		pyspark_scripts
shell_scripts		shell_scripts
spark_sql_scripts		spark_sql_scripts
--conf		--conf
Euro_2012_stats_TEAM.csv		Euro_2012_stats_TEAM.csv
README.md		README.md
col_2_row.csv		col_2_row.csv
copy_folders_from_local_to_hdfs.py		copy_folders_from_local_to_hdfs.py
document.txt		document.txt
dummy_text.csv		dummy_text.csv
employees.csv		employees.csv
fox_n_crow.txt		fox_n_crow.txt
orders_by_date_log.log		orders_by_date_log.log
orders_by_date_out.txt		orders_by_date_out.txt
output_lqs_souvik.csv		output_lqs_souvik.csv
pyspark_int_1.txt		pyspark_int_1.txt
table_list.txt		table_list.txt
table_orders_count.txt		table_orders_count.txt
test.ipynb		test.ipynb
test.py		test.py
test_file_append.ipynb		test_file_append.ipynb
test_orders.ipynb		test_orders.ipynb
test_orders_rdd.ipynb		test_orders_rdd.ipynb
test_practice_interview.ipynb		test_practice_interview.ipynb
test_practice_interview_v2.ipynb		test_practice_interview_v2.ipynb
test_practice_interview_v3.ipynb		test_practice_interview_v3.ipynb
test_practice_interview_v4.ipynb		test_practice_interview_v4.ipynb
test_process.py		test_process.py
test_process.scala		test_process.scala
test_process.sql		test_process.sql
test_scaler_eda.ipynb		test_scaler_eda.ipynb
test_word_count.ipynb		test_word_count.ipynb

Repository files navigation

Project Codes

All the codes on HiveQL,SparkQL and Pyspark

All codes used for data engineering using spark

No releases published