GitHub - zhanxiage1994/hadoop_generate_tfrecord: generate tfrecord based on hadoop MR

Branches Tags

Name		Name	Last commit message	Last commit date
Latest commit History 2 Commits
.gitattributes		.gitattributes
.gitignore		.gitignore
Readme.txt		Readme.txt
gen_tfrecord.py		gen_tfrecord.py
haha.sh		haha.sh
tf_read_tfrecord.py		tf_read_tfrecord.py

Repository files navigation

input data format:([one,another'\t'label],split(',' and '\t'))
1 2 3 4 5 6 7 0 8 9 10,1 2 3 4 5 6 7 0 8 9 10	0



mapper:
shuffle data

reducer:
generate tfrecord