Skip to content

App produces Apache Avro schemas from a .CSV files or from relational database

Notifications You must be signed in to change notification settings

romaanankin/avro-schema-manager

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

22 Commits
 
 
 
 
 
 
 
 

Repository files navigation

Avro schema manager for Apache Avro

The application allows you to generate Avro schemas right from RDBS and other sources which can produce CSV file containing params such as field name and data type.

alt text

Setup tips

  • git clone

In the root directory of the project launch Maven build using command below:

  • mvn clean install

Get a schema-validator-1.0-SNAPSHOT.uber.jar from generated /target

Launch app in terminal choosing one of three available mods and provided database.properties file from src/main/resources directory

  1. -g generates an Avro schemas if .CSV files provided

  2. -v verifies provided Avro schemas with provided .CSV producing verification .CSV file

  3. gv generates and verify Avro schemas using database information schemas and producing .CSV verification file

java -jar <path-to-jar> <mode> <path-to-propetties>   <coma-separeted-tables-to-genegate-of-verify> - optional field (could be defined in properties)

EXAMPLE: java -jar schema-validator-1.0-SNAPSHOT.uber.jar -gv database.properties bet,client,partner

#####NOTE THAT IF YOU WANT TO VALIDATE FILES MANUALLY JUST PUT THEM INTO CORRESPONDING DIRECTORIES, DEFINED IN A PROPERTIES FILE, AND GIVE THE SAME NAME

TODO: generate schemas straight from rabbit MQ

Built With

  • Maven - Dependency Management

About

App produces Apache Avro schemas from a .CSV files or from relational database

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages