Join GitHub today
GitHub is home to over 50 million developers working together to host and review code, manage projects, and build software together.Sign up
how to collect the .adam files from Spark cluster multiple nodes and some questions about avocado #1140
Hi @fnothaft , i'm sorry to disturb you again, i have two questions:
After I ran ADAM on Spark cluster by running ./bin/adam-submit --master spark://spark03:7077,spark04:7077 -- vcf2adam hdfs://192.168.2.85:9000/user/ALL.vcf /home/file/2.adam, but the .adam files are spread across multiple nodes,how can i get all the .adam files in one folder?
now i'm learning avocado , also have some different versions from what i'm using , dose it work well with the environment including adam 0.19.0 , spark 1.6.1 ,jdk1.8? And i will try it . Is the submit command like that :