Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[BEAM-244] Add JDBC IO #942

Closed
wants to merge 18 commits into from
Closed

[BEAM-244] Add JDBC IO #942

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
18 commits
Select commit Hold shift + click to select a range
14f431d
[BEAM-244] Add JDBC IO
jbonofre Sep 5, 2016
4d4be1f
[BEAM-244] Refactore to use first simple composite DoFn instead of so…
jbonofre Sep 13, 2016
cecf39e
[BEAM-244] Directly use JdbcOptions in Read and use JdbcOptions as st…
jbonofre Sep 14, 2016
089ef5c
[BEAM-244] Fix checkstyle
jbonofre Sep 14, 2016
89cf44e
[BEAM-244] Add RowMapper and ElementInserter to allow user customize …
jbonofre Sep 23, 2016
4aed92a
[BEAM-244] Javadoc fixes
jbonofre Sep 23, 2016
d26353f
[BEAM-244] Add batching for write, use preparedStatementSetter
jbonofre Sep 25, 2016
d3227dd
[BEAM-244] Rename query to statement, rename JdbcWriter to WriteFn, u…
jbonofre Sep 26, 2016
23c6e19
[BEAM-244] Minor fix on main comment section
jbonofre Sep 26, 2016
5a8a21e
[BEAM-244] Use preparedStatement batch, simplify test
jbonofre Sep 26, 2016
a2b94e1
[BEAM-244] Introduce DataSourceConfiguration POJO to bootstrap DataSo…
jbonofre Sep 28, 2016
3a8b613
[BEAM-244] Add connection pool configuration properties, use try-on-r…
jbonofre Sep 29, 2016
d7669c4
[BEAM-244] Finishing touches on JdbcIO, using AutoValue, abstracts Da…
jkff Sep 29, 2016
759650f
[BEAM-244] Add connection pool configuration
jbonofre Sep 30, 2016
fd15a44
[BEAM-244] Remove connection pool properties as they don't make lot o…
jbonofre Sep 30, 2016
7f734cf
[BEAM-244] Add Fn to prevent fusion in the Read PTransform
jbonofre Sep 30, 2016
0f07d39
[BEAM-244] Move Random in @Setup and use nextInt in @ProcessElement
jbonofre Sep 30, 2016
ba2c4bf
[BEAM-244] Prevent executeBatch() in WriteFn if the batch is empty
jbonofre Sep 30, 2016
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
138 changes: 138 additions & 0 deletions sdks/java/io/jdbc/pom.xml
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,138 @@
<?xml version="1.0" encoding="UTF-8"?>
<!--
Licensed to the Apache Software Foundation (ASF) under one or more
contributor license agreements. See the NOTICE file distributed with
this work for additional information regarding copyright ownership.
The ASF licenses this file to You under the Apache License, Version 2.0
(the "License"); you may not use this file except in compliance with
the License. You may obtain a copy of the License at

http://www.apache.org/licenses/LICENSE-2.0

Unless required by applicable law or agreed to in writing, software
distributed under the License is distributed on an "AS IS" BASIS,
WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
See the License for the specific language governing permissions and
limitations under the License.
-->
<project xmlns="http://maven.apache.org/POM/4.0.0" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://maven.apache.org/POM/4.0.0 http://maven.apache.org/xsd/maven-4.0.0.xsd">

<modelVersion>4.0.0</modelVersion>

<parent>
<groupId>org.apache.beam</groupId>
<artifactId>beam-sdks-java-io-parent</artifactId>
<version>0.3.0-incubating-SNAPSHOT</version>
<relativePath>../pom.xml</relativePath>
</parent>

<artifactId>beam-sdks-java-io-jdbc</artifactId>
<name>Apache Beam :: SDKs :: Java :: IO :: JDBC</name>
<description>IO to read and write on JDBC datasource.</description>

<build>
<plugins>
<plugin>
<groupId>org.apache.maven.plugins</groupId>
<artifactId>maven-compiler-plugin</artifactId>
</plugin>
<plugin>
<groupId>org.apache.maven.plugins</groupId>
<artifactId>maven-source-plugin</artifactId>
</plugin>
<plugin>
<groupId>org.apache.maven.plugins</groupId>
<artifactId>maven-surefire-plugin</artifactId>
</plugin>
<plugin>
<groupId>org.apache.maven.plugins</groupId>
<artifactId>maven-jar-plugin</artifactId>
</plugin>
<plugin>
<groupId>org.apache.maven.plugins</groupId>
<artifactId>maven-checkstyle-plugin</artifactId>
</plugin>
<plugin>
<groupId>org.apache.maven.plugins</groupId>
<artifactId>maven-javadoc-plugin</artifactId>
</plugin>
</plugins>
</build>

<dependencies>
<dependency>
<groupId>org.apache.beam</groupId>
<artifactId>beam-sdks-java-core</artifactId>
</dependency>

<dependency>
<groupId>org.slf4j</groupId>
<artifactId>slf4j-api</artifactId>
</dependency>

<dependency>
<groupId>com.google.guava</groupId>
<artifactId>guava</artifactId>
</dependency>

<dependency>
<groupId>com.google.code.findbugs</groupId>
<artifactId>annotations</artifactId>
</dependency>

<dependency>
<groupId>org.apache.commons</groupId>
<artifactId>commons-dbcp2</artifactId>
<version>2.1.1</version>
</dependency>

<!-- compile dependencies -->
<dependency>
<groupId>com.google.auto.value</groupId>
<artifactId>auto-value</artifactId>
<scope>provided</scope>
</dependency>

<!-- test dependencies -->
<dependency>
<groupId>org.apache.derby</groupId>
<artifactId>derby</artifactId>
<version>10.12.1.1</version>
<scope>test</scope>
</dependency>
<dependency>
<groupId>org.apache.derby</groupId>
<artifactId>derbyclient</artifactId>
<version>10.12.1.1</version>
<scope>test</scope>
</dependency>
<dependency>
<groupId>org.apache.derby</groupId>
<artifactId>derbynet</artifactId>
<version>10.12.1.1</version>
<scope>test</scope>
</dependency>
<dependency>
<groupId>org.apache.beam</groupId>
<artifactId>beam-runners-direct-java</artifactId>
<version>${project.version}</version>
<scope>test</scope>
</dependency>
<dependency>
<groupId>junit</groupId>
<artifactId>junit</artifactId>
<scope>test</scope>
</dependency>
<dependency>
<groupId>org.hamcrest</groupId>
<artifactId>hamcrest-all</artifactId>
<scope>test</scope>
</dependency>
<dependency>
<groupId>org.slf4j</groupId>
<artifactId>slf4j-jdk14</artifactId>
<scope>test</scope>
</dependency>
</dependencies>

</project>
Loading