Skip to content

[BEAM-5315] Python 3 port io.filebased_* modules#7386

Merged
aaltay merged 3 commits intoapache:masterfrom
RobbeSneyders:filebased
Jan 2, 2019
Merged

[BEAM-5315] Python 3 port io.filebased_* modules#7386
aaltay merged 3 commits intoapache:masterfrom
RobbeSneyders:filebased

Conversation

@RobbeSneyders
Copy link
Contributor

@RobbeSneyders RobbeSneyders commented Jan 2, 2019

This is is part of a series of PRs with goal to make Apache Beam PY3 compatible. The proposal with the outlined approach has been documented here: https://s.apache.org/beam-python-3.

Since the io package is quite big, with a large amount of open issues, I've decided to split up the porting of this package into multiple PRs.

This PR ports the io.filebasedsource.py module and adds the already passing io.filebasedsink_test.py module to the Python 3 test suite.

Post-Commit Tests Status (on master branch)

Lang SDK Apex Dataflow Flink Gearpump Samza Spark
Go Build Status --- --- --- --- --- ---
Java Build Status Build Status Build Status Build Status Build Status Build Status Build Status Build Status
Python Build Status --- Build Status
Build Status
Build Status --- --- ---

@RobbeSneyders
Copy link
Contributor Author

This PR is rebased on top of #7358 since it is dependent on those changes.

@RobbeSneyders
Copy link
Contributor Author

R: @tvalentyn @aaltay

@aaltay aaltay merged commit 4b039e4 into apache:master Jan 2, 2019
kanterov pushed a commit to kanterov/beam that referenced this pull request Jan 3, 2019
* Add apache_beam.io.filebasedsink_test to Python 3 test suite

* Python 3 port filebasedsource
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants