Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Array encoders break on take/collect #193

Closed
imarios opened this issue Oct 8, 2017 · 3 comments
Closed

Array encoders break on take/collect #193

imarios opened this issue Oct 8, 2017 · 3 comments
Assignees
Labels

Comments

@imarios
Copy link
Contributor

imarios commented Oct 8, 2017

case class X(m: Array[String])
val g = TypedDataset.create(Seq(X(Array("a","b"))))

g.collect().run() // OR
g.take(1).run()

17/10/07 21:08:30 ERROR CodeGenerator: failed to compile: org.codehaus.commons.compiler.CompileException: File 'generated.java', Line 107, Column 88: No applicable constructor/method found for actual parameters "java.lang.Object[]"; candidates are: "$line54.$read$$iw$$iw$$iw$$iw$$iw$$iw$$iw$$iw$X(java.lang.String[])"
/* 001 */ public java.lang.Object generate(Object[] references) {
/* 002 */   return new SpecificSafeProjection(references);
/* 003 */ }
/* 004 */
/* 005 */ class SpecificSafeProjection extends org.apache.spark.sql.catalyst.expressions.codegen.BaseProjection {
/* 006 */
/* 007 */   private Object[] references;
/* 008 */   private InternalRow mutableRow;
@imarios
Copy link
Contributor Author

imarios commented Oct 8, 2017

Hi @jeremyrsmith, can you take a look at this issue?

@imarios
Copy link
Contributor Author

imarios commented Oct 9, 2017

Hey @iravid, maybe you can also see what is going on here? Thanks!

@iravid
Copy link
Contributor

iravid commented Oct 9, 2017 via email

iravid pushed a commit to iravid/frameless that referenced this issue Oct 9, 2017
iravid pushed a commit to iravid/frameless that referenced this issue Oct 14, 2017
iravid pushed a commit to iravid/frameless that referenced this issue Oct 14, 2017
iravid pushed a commit to iravid/frameless that referenced this issue Oct 15, 2017
iravid pushed a commit to iravid/frameless that referenced this issue Oct 15, 2017
iravid pushed a commit to iravid/frameless that referenced this issue Oct 15, 2017
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

3 participants