New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
ARROW-6435: [Python] Use pandas null coding consistently on List and Struct types #5302
Conversation
@@ -626,8 +644,82 @@ class ListConverter : public TypedConverter<TypeClass, ListConverter<TypeClass>> | |||
} | |||
|
|||
template <int NUMPY_TYPE, typename Type> | |||
Status AppendNdarrayTypedItem(PyArrayObject* arr); | |||
Status AppendNdarrayItem(PyObject* arr); | |||
Status AppendNdarrayTypedItem(PyArrayObject* arr) { |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Moved code. Unchanged
#define LIST_SLOW_CASE(TYPE) \ | ||
case Type::TYPE: { \ | ||
return value_converter_->AppendMultiple(obj, value_length); \ | ||
} |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Moved code
template <typename TypeClass, NullCoding null_coding> | ||
class ListConverter | ||
: public TypedConverter<TypeClass, ListConverter<TypeClass, null_coding>, | ||
null_coding> { |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Relevant changes
} else { | ||
*out = std::unique_ptr<SeqConverter>( | ||
new StructConverter<NullCoding::NONE_ONLY>(from_pandas, strict_conversions)); | ||
} |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Relevant changes
OK, the Dask integration tests are passing again. Checking HDFS |
OK, HDFS docker-compose job passing also now |
@ursabot crossbow test docker-hdfs-integration docker-dask-integration |
AMD64 Conda Crossbow (#59368) builder has been succeeded. Revision: 68b8443 Submitted crossbow builds: ursa-labs/crossbow @ ursabot-150
|
@ursabot crossbow test docker-hdfs-integration |
AMD64 Conda Crossbow (#59373) builder has been succeeded. Revision: 68b8443 Submitted crossbow builds: ursa-labs/crossbow @ ursabot-155
|
The HDFS build was cancelled, don't know why. |
…y dictionary type
…ist or struct type and from_pandas=False
Rebased this and fixed the conflict from #5299 (which should not have been merged) |
also fixes ARROW-6434