We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
I set "es.mapping.date.rich" to false My mapping in elasticsearch(version: 2.1.1) is:
"collectionTimestamp" : { "type" : "date", "format" : "strict_date_optional_time||epoch_millis" }
when i want to read from elasticsearch by this code:
sqlContext.read() .format("org.elasticsearch.spark.sql") .load("events");
i get:
java.lang.ClassCastException: java.lang.String cannot be cast to java.sql.Timestamp
because my dataframe schema is:
StructField(collectionTimestamp,TimestampType,true)
it seems "es.mapping.date.rich" not change the dataFrame schema
The text was updated successfully, but these errors were encountered:
[SPARK] Take into account rich data when generating the schema
16f42ac
relates #672
Fixed in master. A nightly build has been pushed as well. Please try it out.
Thanks,
Sorry, something went wrong.
Fixed. Thanks
No branches or pull requests
I set "es.mapping.date.rich" to false
My mapping in elasticsearch(version: 2.1.1) is:
when i want to read from elasticsearch by this code:
i get:
because my dataframe schema is:
it seems "es.mapping.date.rich" not change the dataFrame schema
The text was updated successfully, but these errors were encountered: