Skip to content

Latest commit

 

History

History
164 lines (104 loc) · 6.64 KB

sqlflow_guide.md

File metadata and controls

164 lines (104 loc) · 6.64 KB

SQLFlow frontend guide

1

video

1. editor

Enter the sql into the input box, and then choose the database accordingly from the dbvendor menu, then click visualize or visualize join button to get a clear nice data lineage diagram.

1.1 dbvendor

Select the corresponding database.

1.2 sample sql

Click sample sql button will load the sample SQL for the current selected database to the input box.

1.3 upload

upload a single SQL file, or a zip file includes multiple SQL files for processing. A job will be created for the uploaded file.

1.4 visualize

click visualize button will call graph interface, and pass the following parameters: API used when click the button.

name value
sqltext SQL query in the input box
dbvendor database from the dbvendor menu
showRelationType fdd
ignoreFunction true

1.5 visualize join

click visualize join button will call graph interface, and pass the following parameters: API used when click the visualize join button.

name value
sqltext SQL query in the input box
dbvendor database from the dbvendor menu
showRelationType join
ignoreFunction true

1.6 login

You have to login in order to upload a SQL or zip file for processing.

2. schema

show the schema objects returned by the backend. you can select a schema/database/table and click the right mouse button to visualize the data lineage of the selected schema object.

3

  • global, green color, means all data lineage information is returned for this object.
  • summary, black color, means summary information returned for this object.
  • ignore record, orange color, means data lineage is returned without intermediate result.

image

the color of DATAMART、DBO is orange, means the returned data linege doesn't include the intermediate result. the color of LOAN is greeen, means all data lineage informaiton is returned. node in gray means it's not visualized yet.

seach schema

your can search database,schema,table,schema in the schema tree.

动画

seach schema path

you can search database.schema.table.column ,schema.table,table.column or someting else like it. When you type dot, the schema tree will expand the next level.

2

collapse all

3

3. setting

image

set the graph interface

name value
hideColumn false/true,hide all columns
showRelationType dataflow=true, impact=false, then value is fdd.
dataflow=true, impact=true, the value is fdd,ddi,fdr,frd;
if dataflow=false, impact=true, the value is: fddi,fdr,frd;
ignoreRecordSet false/true,show intermediate recordset
ignoreFunction false/true,show function

4. job

image

click upload button to create a job by submit SQL text file or zip file including multiple SQL files or connect to a database.

5. download

export result to json or png file for download.

6. sqlflow diagram panel

select a column to highlight the data flow, click cancel button to cancel the highlight.

3

right mouse click the menu item table lineage or column lineage to show the table or column relation, click cancel to back to the previous state.

3

How it works

SQLFlow frontend communicates with the backend using the RESTFul API /sqlflow/generation/sqlflow/graph。 Once it fetchs data from the backend, the frontend will analyze the graph and sqlflow and draw an interactive diagram accordingly.

Click the button or change the value in the setting panel will result in calling different API or call the same API with the different parameters, and get the different data from the backend consequence.

Reference:SQLFlow api doc

Restful API

Reference:SQLFlow api doc

graph interfact: post /sqlflow/generation/sqlflow/graph