We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
DataVines is an easy-to-use data quality service platform that supports multiple metric. https://github.com/datavane/datavines
config data quality job in datavines
get the job config scipt file
Add datavines job node in workflow, and configure the script
get the jobId
Add datavines job node in workflow, and configure the datavines api address and jobId
No response
The text was updated successfully, but these errors were encountered:
It would be nice if you could submit a task here and see the status of the task in ds and stop it via datavines
Sorry, something went wrong.
very useful for data pipeLine
If the datavines are incorporated into the ds, it will be easier to integrate project management and data inspection
+1
You should provide a detail design related of the how to use the new task and how does the task work in ds, rather than some pictures of ui.
No branches or pull requests
Search before asking
Motivation
DataVines is an easy-to-use data quality service platform that supports multiple metric.
https://github.com/datavane/datavines
Design Detail
Sript mode
config data quality job in datavines
![image](https://private-user-images.githubusercontent.com/58384836/336126375-8ff2cf5e-4d09-4199-96bb-7a9326fcf8f2.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MTk1OTE4MzUsIm5iZiI6MTcxOTU5MTUzNSwicGF0aCI6Ii81ODM4NDgzNi8zMzYxMjYzNzUtOGZmMmNmNWUtNGQwOS00MTk5LTk2YmItN2E5MzI2ZmNmOGYyLnBuZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNDA2MjglMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjQwNjI4VDE2MTg1NVomWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPWFmMWUyZGZlNDAzMjRjYjk1Nzk5NTk0ZGMwZTU4ZDQ5ZTc5MGU5MzY4YzQzOWEzZGMyM2Q2NGVhNTdmOTU3ZjAmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0JmFjdG9yX2lkPTAma2V5X2lkPTAmcmVwb19pZD0wIn0.XZ2DvbvSYUAsq-59KA9ErKlumqArGoku478HLDzWup4)
get the job config scipt file
Add datavines job node in workflow, and configure the script
![image](https://private-user-images.githubusercontent.com/58384836/336128733-888a9950-e4c2-49e7-ab2f-f9eb38aa5c4c.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MTk1OTE4MzUsIm5iZiI6MTcxOTU5MTUzNSwicGF0aCI6Ii81ODM4NDgzNi8zMzYxMjg3MzMtODg4YTk5NTAtZTRjMi00OWU3LWFiMmYtZjllYjM4YWE1YzRjLnBuZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNDA2MjglMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjQwNjI4VDE2MTg1NVomWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPTY1Y2U4N2RiMzVkODg0OWJiOTNhNjUwZjg1OTZkNDAxYmQxN2Y4OGU5NWZiNzUwMGQ2ZTVmOTlkOWVlOTgxNDYmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0JmFjdG9yX2lkPTAma2V5X2lkPTAmcmVwb19pZD0wIn0.URjSbebEGL3MJDwlX0rwM34PVCRy3qhq8nxglTZ5kMw)
API Mode
config data quality job in datavines
![image](https://private-user-images.githubusercontent.com/58384836/336126375-8ff2cf5e-4d09-4199-96bb-7a9326fcf8f2.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MTk1OTE4MzUsIm5iZiI6MTcxOTU5MTUzNSwicGF0aCI6Ii81ODM4NDgzNi8zMzYxMjYzNzUtOGZmMmNmNWUtNGQwOS00MTk5LTk2YmItN2E5MzI2ZmNmOGYyLnBuZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNDA2MjglMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjQwNjI4VDE2MTg1NVomWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPWFmMWUyZGZlNDAzMjRjYjk1Nzk5NTk0ZGMwZTU4ZDQ5ZTc5MGU5MzY4YzQzOWEzZGMyM2Q2NGVhNTdmOTU3ZjAmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0JmFjdG9yX2lkPTAma2V5X2lkPTAmcmVwb19pZD0wIn0.XZ2DvbvSYUAsq-59KA9ErKlumqArGoku478HLDzWup4)
get the jobId
Add datavines job node in workflow, and configure the datavines api address and jobId
Compatibility, Deprecation, and Migration Plan
No response
Test Plan
No response
Code of Conduct
The text was updated successfully, but these errors were encountered: