No description, website, or topics provided.
Clone or download
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Permalink
Type Name Latest commit message Commit time
Failed to load latest commit information.
docker
src
tests
.dockerignore
.gitignore
.travis.yml
Dockerfile
LICENSE
README.md
composer.json
composer.lock
deploy.sh
docker-compose.yml
phpcs.xml
phpstan.neon

README.md

processor-skip-lines

Build Status

Removes a given number of lines from each file in /data/in/files and /data/in/tables (including sliced tables). Copies manifest files.

This processor uses Linux tail and head commands, so it does not correctly interpret multiline CSV rows.

Usage

Sample configuration

{  
    "definition": {
        "component": "keboola.processor-skip-lines"
    },
    "parameters": {
        "lines": 1,
        "direction_from": "top"
    }
}

Parameters

lines

Number of lines to remove from each file.

direction_from

Direction to skip lines from. Possible values are top or bottom. The default value is top

Development

Clone this repository and init the workspace with following commands:

  • docker-compose build

TDD

  • Edit the code
  • Run docker-compose run --rm dev php ./tests/run.php
  • Repeat

Integration

  • Build is started after push on Travis CI
  • Build steps
    • build image
    • execute tests against new image
    • publish image to AWS ECR if the release is tagged