Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

ARROW-7430: [Python] Add more docstrings to dataset bindings #6059

Conversation

jorisvandenbossche
Copy link
Member

No description provided.

@@ -134,6 +135,31 @@ cdef class DefaultPartitionScheme(PartitionScheme):


cdef class SchemaPartitionScheme(PartitionScheme):
"""
A PartitionScheme based on a specified Schema.
Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

There is still discussion to remove those classes, but already wrote those docstrings last week, so including here any way.

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Either way, we can reuse these docstring because the schemes must be explained.

@github-actions
Copy link

Copy link
Member

@pitrou pitrou left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Just a couple details.

@@ -270,19 +331,48 @@ cdef class DataSourceDiscovery:
return schemas

def inspect(self):
"""
Insects all data fragments and returns a common Schema.
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

"Inspect" and "return"

cdef CResult[shared_ptr[CDataSource]] result
with nogil:
result = self.discovery.Finish()
return DataSource.wrap(GetResultValue(result))


cdef class FileSystemDataSourceDiscovery(DataSourceDiscovery):
"""
Creates a DataSource from a list of paths with schema inspection.
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

"Create"?

Copy link
Member

@pitrou pitrou left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Just a couple nits. You may ignore them if you want :-)

python/pyarrow/_dataset.pyx Outdated Show resolved Hide resolved
python/pyarrow/_dataset.pyx Outdated Show resolved Hide resolved
@pitrou pitrou force-pushed the ARROW-7430-dataset-docstrings branch from fb51e29 to 127dd80 Compare January 6, 2020 14:45
Copy link
Member

@pitrou pitrou left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

+1

@pitrou
Copy link
Member

pitrou commented Jan 6, 2020

@pitrou pitrou force-pushed the ARROW-7430-dataset-docstrings branch from 127dd80 to 4e8fa9f Compare January 6, 2020 17:09
@pitrou pitrou closed this in dcf0647 Jan 6, 2020
@jorisvandenbossche jorisvandenbossche deleted the ARROW-7430-dataset-docstrings branch January 7, 2020 10:09
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants