plugin-parquet.adoc

Parquet Plugin

The plugin provides the ability to create Parquet files.

partial$plugin-installation.adoc

Properties

Property Name	Acceptable values	Default	Description
expression.csv-to-parquet.csv-format	DEFAULT EXCEL INFORMIX_UNLOAD INFORMIX_UNLOAD_CSV MYSQL RFC4180 ORACLE POSTGRESQL_CSV POSTGRESQL_TEXT TDF	DEFAULT	Specifies the format of a CSV file to create a Parquet file from.

Expressions

Note	The expression parameters marked with bold are mandatory.

convertCsvToParquetFile

Creates temporary Parquet file, writes CSV data records to the file using Avro schema and returns its path.

#{convertCsvToParquetFile($csv-resource-path, $avro-schema-resource-path)}

• $csv-resource-path - The path to a resource containing CSV data.

• $avro-schema-resource-path - The path to a resource containing Avro schema.

Initialize a variable with a path to a Parquet file

Given I initialize scenario variable `parquet-path` with value `#{convertCsvToParquetFile(data/pets.csv, data/pets-schema.avsc)}`