Join GitHub today
GitHub is home to over 28 million developers working together to host and review code, manage projects, and build software together.Sign up
using NetcdfFile to create scisparkcontext encounters arrayoutofindexbounds. #93
netcdfDFSfile isn't intended to split a single file, but rather a collection of files under a directory.
It would help greatly if you could provide the information in a gist.
thanks for the reply，my code and stack trace are list below, "gist.github" is somehow not available for me.
my code is just simply the getting started code
16/08/02 23:30:18 ERROR TaskSetManager: Task 0 in stage 0.0 failed 1 times; aborting job
NetcdfFile is intended to read a file containing a list of paths pointing to netcdf files served by opendap servers. In your case you want to use NetcdfDFSFile.
If you have a collection of files on an opendap server, append their urls to a file and pass that file path to the NetcdfFile function.