Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[BEAM-244] Add JDBC IO #942

Closed
wants to merge 18 commits into from
Closed

[BEAM-244] Add JDBC IO #942

wants to merge 18 commits into from

Commits on Sep 30, 2016

  1. [BEAM-244] Add JDBC IO

    @jbonofre
    jbonofre committed Sep 30, 2016
    Configuration menu
    Copy the full SHA
    14f431d View commit details
    Browse the repository at this point in the history

  2. [BEAM-244] Refactore to use first simple composite DoFn instead of so… 

    …urce
    @jbonofre
    jbonofre committed Sep 30, 2016
    Configuration menu
    Copy the full SHA
    4d4be1f View commit details
    Browse the repository at this point in the history

  3. [BEAM-244] Directly use JdbcOptions in Read and use JdbcOptions as st… 

    …art of the pipeline
    @jbonofre
    jbonofre committed Sep 30, 2016
    Configuration menu
    Copy the full SHA
    cecf39e View commit details
    Browse the repository at this point in the history

  4. [BEAM-244] Fix checkstyle

    @jbonofre
    jbonofre committed Sep 30, 2016
    Configuration menu
    Copy the full SHA
    089ef5c View commit details
    Browse the repository at this point in the history

  5. [BEAM-244] Add RowMapper and ElementInserter to allow user customize … 

    …the "parsing" of ResultSet/PCollection element
    @jbonofre
    jbonofre committed Sep 30, 2016
    Configuration menu
    Copy the full SHA
    89cf44e View commit details
    Browse the repository at this point in the history

  6. [BEAM-244] Javadoc fixes

    @jbonofre
    jbonofre committed Sep 30, 2016
    Configuration menu
    Copy the full SHA
    4aed92a View commit details
    Browse the repository at this point in the history

  7. [BEAM-244] Add batching for write, use preparedStatementSetter

    @jbonofre
    jbonofre committed Sep 30, 2016
    Configuration menu
    Copy the full SHA
    d26353f View commit details
    Browse the repository at this point in the history

  8. [BEAM-244] Rename query to statement, rename JdbcWriter to WriteFn, u… 

    …se an unique PreparedStatement for write, simplify tests, fix indentation and comments
    @jbonofre
    jbonofre committed Sep 30, 2016
    Configuration menu
    Copy the full SHA
    d3227dd View commit details
    Browse the repository at this point in the history

  9. [BEAM-244] Minor fix on main comment section

    @jbonofre
    jbonofre committed Sep 30, 2016
    Configuration menu
    Copy the full SHA
    23c6e19 View commit details
    Browse the repository at this point in the history

  10. [BEAM-244] Use preparedStatement batch, simplify test

    @jbonofre
    jbonofre committed Sep 30, 2016
    Configuration menu
    Copy the full SHA
    5a8a21e View commit details
    Browse the repository at this point in the history

  11. [BEAM-244] Introduce DataSourceConfiguration POJO to bootstrap DataSo… 

    …urce provided by user or created by DBCP2 using configuration, DataSourceConfiguration is used by both Read and Write
    @jbonofre
    jbonofre committed Sep 30, 2016
    Configuration menu
    Copy the full SHA
    a2b94e1 View commit details
    Browse the repository at this point in the history

  12. [BEAM-244] Add connection pool configuration properties, use try-on-r… 

    …esource, improve main javadoc
    @jbonofre
    jbonofre committed Sep 30, 2016
    Configuration menu
    Copy the full SHA
    3a8b613 View commit details
    Browse the repository at this point in the history

  13. [BEAM-244] Finishing touches on JdbcIO, using AutoValue, abstracts Da… 

    …taSourceConfiguration, improve tests and some cleanups
    @jkff @jbonofre
    jkff authored and jbonofre committed Sep 30, 2016
    Configuration menu
    Copy the full SHA
    d7669c4 View commit details
    Browse the repository at this point in the history

  14. [BEAM-244] Add connection pool configuration

    @jbonofre
    jbonofre committed Sep 30, 2016
    Configuration menu
    Copy the full SHA
    759650f View commit details
    Browse the repository at this point in the history

  15. [BEAM-244] Remove connection pool properties as they don't make lot o… 

    …f sense for users to change default values
    @jbonofre
    jbonofre committed Sep 30, 2016
    Configuration menu
    Copy the full SHA
    fd15a44 View commit details
    Browse the repository at this point in the history

  16. [BEAM-244] Add Fn to prevent fusion in the Read PTransform

    @jbonofre
    jbonofre committed Sep 30, 2016
    Configuration menu
    Copy the full SHA
    7f734cf View commit details
    Browse the repository at this point in the history

  17. [BEAM-244] Move Random in @setup and use nextInt in @ProcessElement

    @jbonofre
    jbonofre committed Sep 30, 2016
    Configuration menu
    Copy the full SHA
    0f07d39 View commit details
    Browse the repository at this point in the history

  18. [BEAM-244] Prevent executeBatch() in WriteFn if the batch is empty

    @jbonofre
    jbonofre committed Sep 30, 2016
    Configuration menu
    Copy the full SHA
    ba2c4bf View commit details
    Browse the repository at this point in the history