Skip to content

Commit

Permalink
Merge pull request #3382 from Mattang-Dan/patch-49
Browse files Browse the repository at this point in the history
Update tableinput.adoc
  • Loading branch information
hansva committed Nov 14, 2023
2 parents 038d3a9 + caa11d0 commit 9e1a7e4
Showing 1 changed file with 13 additions and 20 deletions.
Original file line number Diff line number Diff line change
Expand Up @@ -24,20 +24,27 @@ under the License.
|===
|
== Description

The Table Input transform is used to read information from a database, using a connection and SQL. Basic SQL statements can be generated automatically by clicking Get SQL select statement. SQL queries can be parameterized through variables and can accept input from previous transform fields.
|
== Supported Engines
[%noheader,cols="2,1a",frame=none, role="table-supported-engines"]
!===
!Hop Engine! image:check_mark.svg[Supported, 24]
!Spark! image:check_mark.svg[Supported, 24]
!Flink! image:check_mark.svg[Supported, 24]
!Dataflow! image:check_mark.svg[Supported, 24]
!===
|===

Table input does not pass input data to the output, only fields inside the query are returned to the pipeline so all other variables and data will be lost. You can solve this by adding the variable as a field in the query or put a Get variables transform behind the table input.

To use data fields from a transform, you will have to select it in the dropdown "Insert data from transform". Note that if you are using a parametrized query using question marks, you must limit the stream to exactly the fields you need as input to the table input. This can also be done with a Select values transform.

== Tips

If you are getting unexpected query results, (and on some other action/transforms) there is a clear database cache icon (broom). Or you can use the Hop menu icon: Tools / Clear DB Cache.
TIP: If you are getting unexpected query results, (and on some other action/transforms) there is a clear database cache icon (broom). Or you can use the Hop menu icon: Tools / Clear DB Cache.

A cartesian join transform will combine a different number of fields from multiple table inputs without requiring key join fields.
TIP: A cartesian join transform will combine a different number of fields from multiple table inputs without requiring key join fields.

== Parmeterized Query Examples
== Examples

*Example to use data row field(s) parameterized query:*

Expand All @@ -47,7 +54,6 @@ A cartesian join transform will combine a different number of fields from multip

* Insert data from transform: <point to the transform with the fields>


*Example to use a variable value parameterized query*:

This examples uses an integer. If you were using a string you most likely will have to use syntax ‘${PRM_NAME}’
Expand All @@ -58,24 +64,11 @@ This examples uses an integer. If you were using a string you most likely will h

* Insert data from transform: <empty>


*Example using a date range*:

``SELECT * FROM customers WHERE changed_date BETWEEN ? AND ?``

This SQL statement requests two calendar dates, to create a range, that are read from the Insert data from transform option. The target date range can be provided using the Get System Info transform. For example, if you want to read all customers that have had their data changed yesterday, you can get a target range for yesterday and read the customer data.

|
== Supported Engines
[%noheader,cols="2,1a",frame=none, role="table-supported-engines"]
!===
!Hop Engine! image:check_mark.svg[Supported, 24]
!Spark! image:check_mark.svg[Supported, 24]
!Flink! image:check_mark.svg[Supported, 24]
!Dataflow! image:check_mark.svg[Supported, 24]
!===
|===

== Options

[options="header"]
Expand Down

0 comments on commit 9e1a7e4

Please sign in to comment.