Create release version 1.0

INSTALLING.md

@@ -24,13 +24,13 @@ packages being provided, for different Spark and Hadoop versions. The naming is
 flowman-dist-<version>-oss-spark<spark-version>-hadoop<hadoop-version>-bin.tar.gz
 ```
 You simply have to use the package which fits to the Spark and Hadoop versions of your environment. For example, the
-package of Flowman 0.30.0 and for Spark 3.3 and Hadoop 3.3 would be
+package of Flowman 1.0.0 and for Spark 3.3 and Hadoop 3.3 would be
 ```
-flowman-dist-0.30.0-oss-spark3.3-hadoop3.3-bin.tar.gz
+flowman-dist-1.0.0-oss-spark3.3-hadoop3.3-bin.tar.gz
 ```
 and the full URL then would be
 ```
-https://github.com/dimajix/flowman/releases/download/0.30.0/flowman-dist-0.30.0-oss-spark3.3-hadoop3.3-bin.tar.gz
+https://github.com/dimajix/flowman/releases/download/1.0.0/flowman-dist-1.0.0-oss-spark3.3-hadoop3.3-bin.tar.gz
 ```
 
 ## Supported Spark Environments

QUICKSTART.md

@@ -16,7 +16,7 @@ Fortunately, Spark is rather simple to install locally on your machine:
 
 ### Download & Install Spark
 
-As of this writing, the latest release of Flowman is 0.30.0 and is available prebuilt for Spark 3.3.1 on the Spark
+As of this writing, the latest release of Flowman is 1.0.0 and is available prebuilt for Spark 3.3.2 on the Spark
 homepage. So we download the appropriate Spark distribution from the Apache archive and unpack it.
 
 ```shell
@@ -25,10 +25,10 @@ mkdir playground
 cd playground
 
 # Download and unpack Spark & Hadoop
-curl -L https://archive.apache.org/dist/spark/spark-3.3.1/spark-3.3.1-bin-hadoop3.2.tgz | tar xvzf -
+curl -L https://archive.apache.org/dist/spark/spark-3.3.2/spark-3.3.2-bin-hadoop3.tgz | tar xvzf -
 
 # Create a nice link
-ln -snf spark-3.3.1-bin-hadoop3.2 spark
+ln -snf spark-3.3.2-bin-hadoop3 spark
 ```
 
 The Spark package already contains Hadoop, so with this single download you already have both installed and integrated with each other.
@@ -47,14 +47,14 @@ environment variables:
 ## 2. Install Flowman
 
 You find prebuilt Flowman packages on the corresponding release page on GitHub. For this quickstart, we chose
-`flowman-dist-0.30.0-oss-spark3.3-hadoop3.3-bin.tar.gz` which nicely fits to the Spark package we just downloaded before.
+`flowman-dist-1.0.0-oss-spark3.3-hadoop3.3-bin.tar.gz` which nicely fits to the Spark package we just downloaded before.
 
 ```shell
 # Download and unpack Flowman
-curl -L https://github.com/dimajix/flowman/releases/download/0.30.0/flowman-dist-0.30.0-oss-spark3.3-hadoop3.3-bin.tar.gz | tar xvzf -
+curl -L https://github.com/dimajix/flowman/releases/download/1.0.0/flowman-dist-1.0.0-oss-spark3.3-hadoop3.3-bin.tar.gz | tar xvzf -
 
 # Create a nice link
-ln -snf flowman-0.30.0-oss-spark3.3-hadoop3.3 flowman
+ln -snf flowman-1.0.0-oss-spark3.3-hadoop3.3 flowman
 ```
 
 ### Flowman Configuration

devtools/build-release.sh

@@ -1,7 +1,7 @@
 #!/usr/bin/env bash
 
-SELF=$(cd $(dirname $0) && pwd)
-cd $SELF/..
+SELF=$(cd "$(dirname "$0")" && pwd)
+cd "$SELF"/..
 
 set -e
 set -o pipefail
@@ -14,18 +14,17 @@ mkdir -p release
 
 
 build_profile() {
-    profiles=$@
+    profiles=( "$@" )
 
     # Set new version
-    HADOOP_DIST=$(mvn $profiles -q -N help:evaluate -Dexpression=hadoop.dist -DforceStdout)
-    SPARK_API_VERSION=$(mvn $profiles -q -N help:evaluate -Dexpression=spark-api.version -DforceStdout)
-    HADOOP_API_VERSION=$(mvn $profiles -q -N help:evaluate -Dexpression=hadoop-api.version -DforceStdout)
+    HADOOP_DIST=$(mvn "${profiles[@]}" -q -N help:evaluate -Dexpression=hadoop.dist -DforceStdout)
+    SPARK_API_VERSION=$(mvn "${profiles[@]}" -q -N help:evaluate -Dexpression=spark-api.version -DforceStdout)
+    HADOOP_API_VERSION=$(mvn "${profiles[@]}" -q -N help:evaluate -Dexpression=hadoop-api.version -DforceStdout)
 
-    echo "Building for dist $HADOOP_DIST with Spark $SPARK_API_VERSION and Hadoop $HADOOP_API_VERSION"
+    echo "Building for dist '$HADOOP_DIST' with Spark $SPARK_API_VERSION and Hadoop $HADOOP_API_VERSION"
     mvn -q versions:set -DnewVersion=${FLOWMAN_VERSION}-${HADOOP_DIST}-spark${SPARK_API_VERSION}-hadoop${HADOOP_API_VERSION}
 
-    mvn clean deploy $profiles -DskipTests -Dflowman.dist.suffix="" -Ddockerfile.skip
-    #mvn clean install $profiles -DskipTests -Dflowman.dist.suffix="" -Ddockerfile.skip
+    mvn clean deploy "${profiles[@]}" -DskipTests -Dflowman.dist.suffix="" -Ddockerfile.skip
 
     cp flowman-dist/target/flowman-dist-*.tar.gz release
 

docker/pom.xml

@@ -11,7 +11,7 @@
     <parent>
         <groupId>com.dimajix.flowman</groupId>
         <artifactId>flowman-root</artifactId>
-        <version>1.0.0-SNAPSHOT</version>
+        <version>1.0.0</version>
         <relativePath>../pom.xml</relativePath>
     </parent>
 

docs/quickstart.md

@@ -14,7 +14,7 @@ Of course, you need a working Docker installation, which should be quite easy. T
 containing Flowman via the following command:
 
 ```shell
-docker run --rm -ti dimajix/flowman:0.30.0-oss-spark3.3-hadoop3.3 bash   
+docker run --rm -ti dimajix/flowman:1.0.0-oss-spark3.3-hadoop3.3 bash   
 ```
 
 Note that this simply starts a bash shell, but Flowman is only away some fingertips. 
@@ -26,7 +26,7 @@ may want to make local data accessible to Flowman or you may simply want to exec
 on your local machine. This can be easily achieved as follows:
 
 ```shell
-docker run --rm -ti -v /home/kaya/flowman/example/weather:/home/flowman/local dimajix/flowman:0.30.0-oss-spark3.3-hadoop3.3 bash   
+docker run --rm -ti -v /home/kaya/flowman/example/weather:/home/flowman/local dimajix/flowman:1.0.0-oss-spark3.3-hadoop3.3 bash   
 ```
 
 This will mount the local directory `/home/kaya/flowman/example/weather` on your host computer into the Docker

docs/setup/docker.md

@@ -15,12 +15,12 @@ We publish Flowman Docker images on [Docker Hub](https://hub.docker.com/reposito
 which are good enough for local work. You can easily start a Flowman session in Docker as follows:
 
 ```shell
-docker run --rm -ti dimajix/flowman:0.30.0-oss-spark3.3-hadoop3.3 bash
+docker run --rm -ti dimajix/flowman:1.0.0-oss-spark3.3-hadoop3.3 bash
 ```
 When you are using [git bash](https://git-scm.com/download/win), you will probably need to use `winpty`, which 
 translates to the following command
 ```shell
-winpty docker run --rm -ti dimajix/flowman:0.30.0-oss-spark3.3-hadoop3.3 bash
+winpty docker run --rm -ti dimajix/flowman:1.0.0-oss-spark3.3-hadoop3.3 bash
 ```
 
 Once the Docker image has started, you will be presented with a bash prompt. Then you can easily build the
@@ -35,7 +35,7 @@ flowexec -f examples/weather job build main
 By using Docker volumes, you can easily mount a Flowman project into the Docker container, for example
 
 ```shell
-docker run --rm -ti --mount type=bind,source=$(pwd)/my_project,target=/home/flowman/my_project dimajix/flowman:0.30.0-oss-spark3.3-hadoop3.3 bash
+docker run --rm -ti --mount type=bind,source=$(pwd)/my_project,target=/home/flowman/my_project dimajix/flowman:1.0.0-oss-spark3.3-hadoop3.3 bash
 ```
 The command above will start a Docker container running Flowman, and the local subdirectory `my_project` within the 
 current working directory is mounted into the container at `/home/flowman/my_project`. Then you open your project
@@ -58,7 +58,7 @@ version: "3"
 services:
   flowman:
     # Set the appropriate Flowman Docker image of your choice.
-    image: dimajix/flowman:0.30.0-oss-spark3.3-hadoop3.3
+    image: dimajix/flowman:1.0.0-oss-spark3.3-hadoop3.3
     # Let Docker start a bash if nothing else is specified.
     command: bash
     # Mount local volumes into the Docker container. Adjust the example entries to your needs!

docs/setup/emr.md

@@ -4,7 +4,7 @@ Since version 0.30.0, Flowman officially supports AWS EMR (Elastic Map Reduce) a
 to provide a high degree of compatibility with EMR, Flowman provides special build variants for AWS, which can be
 identified via the term "emr" in their version.
 
-For example, the Flowman version `0.30.0-emr6.9-spark3.3-hadoop3.3` contains a build specifically crafted for EMR
+For example, the Flowman version `1.0.0-emr6.10-spark3.3-hadoop3.3` contains a build specifically crafted for EMR
 version 6.9, which contains Spark 3.3 and Hadoop 3.3. You should always use a Flowman version which matches your
 EMR version (or the other way round) in order to avoid incompatibilities between libraries.
 
@@ -29,13 +29,13 @@ opening firewall ports, providing your public ssh key and more. You can read det
 Once you successfully logged in to the master node, you need to download an EMR optimized version of Flowman using
 `wget` or `curl`:
 ```shell
-wget https://github.com/dimajix/flowman/releases/download/0.30.0/flowman-dist-0.30.0-emr6.9-spark3.3-hadoop3.3-bin.tar.gz
+wget https://github.com/dimajix/flowman/releases/download/1.0.0/flowman-dist-1.0.0-emr6.10-spark3.3-hadoop3.3-bin.tar.gz
 ```
 Next you unpack Flowman as follows:
 ```shell
-tar xvzf flowman-dist-0.30.0-emr6.9-spark3.3-hadoop3.3-bin.tar.gz
+tar xvzf flowman-dist-1.0.0-emr6.10-spark3.3-hadoop3.3-bin.tar.gz
 ```
-This will create a directory `flowman-0.30.0-emr6.9-spark3.3-hadoop3.3` which contains all executables and libraries
+This will create a directory `flowman-1.0.0-emr6.10-spark3.3-hadoop3.3` which contains all executables and libraries
 of Flowman.
 
 #### Directory Layout
@@ -139,7 +139,7 @@ Finally, you can now start Flowman. For example, if you wanted to run the weathe
 as follows
 ```shell
 # Enter installation directory of Flowman
-cd flowman-0.30.0-emr6.9-spark3.3-hadoop3.3
+cd flowman-1.0.0-emr6.10-spark3.3-hadoop3.3
 
 # Start Flowman shell with the weather example
 bin/flowshell -f examples/weather

docs/setup/index.md

@@ -18,7 +18,7 @@ Moreover, managed Spark environments like AWS EMR or Azure Synapse are supported
 ## Supported Spark Environments
 Flowman is available for a large number of different Spark/Hadoop environments. Flowman provides different packages
 for each of these environments to ensure a high degree of compatibility. Each variant is identified by its suffix
-appended to the Flowman version, i.e. `<flowman-version>-<flowman-variant>`. So for example the full version tag
+appended to the Flowman version, i.e. `<flowman-version>-<flowman-variant>`. So for example, the full version tag
 of Flowman 0.30.0 for Cloudera CDP 7.1 and Spark 3.3 would be `0.30.0-cdp7-spark3.3-hadoop3.1`.
 
 The following environments are officially supported with corresponding build variants:

docs/setup/installation.md

@@ -21,7 +21,7 @@ needs to match the ones of your platform
 
 ### Download & Install Spark
 
-As of this writing, the latest release of Flowman is 0.27.0 and is available prebuilt for Spark 3.3.0 on the Spark
+As of this writing, the latest release of Flowman is 1.0.0 and is available prebuilt for Spark 3.3.2 on the Spark
 homepage. So we download the appropriate Spark distribution from the Apache archive and unpack it.
 
 ```shell
@@ -30,8 +30,8 @@ mkdir playground
 cd playground
 
 # Download and unpack Spark & Hadoop
-curl -L https://archive.apache.org/dist/spark/spark-3.3.0/spark-3.3.0-bin-hadoop3.tgz | tar xvzf -# Create a nice link
-ln -snf spark-3.3.0-bin-hadoop3 spark
+curl -L https://archive.apache.org/dist/spark/spark-3.3.2/spark-3.3.2-bin-hadoop3.tgz | tar xvzf -# Create a nice link
+ln -snf spark-3.3.2-bin-hadoop3 spark
 ```
 The Spark package already contains Hadoop, so with this single download you already have both installed and integrated with each other.
 
@@ -64,13 +64,13 @@ versions. The naming is straight forward:
 flowman-dist-<version>-oss-spark<spark-version>-hadoop<hadoop-version>-bin.tar.gz
 ```
 You simply have to use the package which fits to the Spark and Hadoop versions of your environment. For example, the
-package of Flowman 0.30.0 and for Spark 3.3 and Hadoop 3.3 would be
+package of Flowman 1.0.0 and for Spark 3.3 and Hadoop 3.3 would be
 ```
-flowman-dist-0.30.0-oss-spark3.3-hadoop3.3-bin.tar.gz
+flowman-dist-1.0.0-oss-spark3.3-hadoop3.3-bin.tar.gz
 ```
 and the full URL then would be
 ```
-https://github.com/dimajix/flowman/releases/download/0.30.0/flowman-dist-0.30.0-oss-spark3.3-hadoop3.3-bin.tar.gz
+https://github.com/dimajix/flowman/releases/download/1.0.0/flowman-dist-1.0.0-oss-spark3.3-hadoop3.3-bin.tar.gz
 ```
 
 ### Supported Spark Environments

docs/workflow/maven-classic.md

@@ -265,7 +265,7 @@ A much simpler option than setting up a local Flowman development installation i
 images. This approach is recommended especially for Windows users, but is also very simple for Linux and Mac users.
 
 ```shell
-docker run --rm -ti --mount type=bind,source=<your-project-dir>,target=/opt/flowman/project dimajix/flowman:0.30.0-oss-spark3.3-hadoop3.3 bash
+docker run --rm -ti --mount type=bind,source=<your-project-dir>,target=/opt/flowman/project dimajix/flowman:1.0.0-oss-spark3.3-hadoop3.3 bash
 ```
 
 ### Using Flowman Shell

docs/workflow/maven-plugin.md

@@ -202,7 +202,7 @@ A much simpler option than setting up a local Flowman development installation i
 images. This approach is recommended especially for Windows users, but is also very simple for Linux and Mac users.
 
 ```shell
-docker run --rm -ti --mount type=bind,source=<your-project-dir>,target=/opt/flowman/project dimajix/flowman:0.30.0-oss-spark3.3-hadoop3.3 bash
+docker run --rm -ti --mount type=bind,source=<your-project-dir>,target=/opt/flowman/project dimajix/flowman:1.0.0-oss-spark3.3-hadoop3.3 bash
 ```
 
 ### Using Flowman Shell

flowman-common-java/pom.xml

@@ -10,7 +10,7 @@
     <parent>
         <groupId>com.dimajix.flowman</groupId>
         <artifactId>flowman-root</artifactId>
-        <version>1.0.0-SNAPSHOT</version>
+        <version>1.0.0</version>
     </parent>
 
     <profiles>

flowman-common/pom.xml

@@ -10,7 +10,7 @@
     <parent>
 	    <groupId>com.dimajix.flowman</groupId>
 	    <artifactId>flowman-root</artifactId>
-        <version>1.0.0-SNAPSHOT</version>
+        <version>1.0.0</version>
         <relativePath>../pom.xml</relativePath>
     </parent>
 

flowman-core/pom.xml

@@ -10,7 +10,7 @@
     <parent>
 	    <groupId>com.dimajix.flowman</groupId>
 	    <artifactId>flowman-root</artifactId>
-        <version>1.0.0-SNAPSHOT</version>
+        <version>1.0.0</version>
         <relativePath>../pom.xml</relativePath>
     </parent>
 

flowman-dist/pom.xml

@@ -11,7 +11,7 @@
     <parent>
 	    <groupId>com.dimajix.flowman</groupId>
 	    <artifactId>flowman-root</artifactId>
-        <version>1.0.0-SNAPSHOT</version>
+        <version>1.0.0</version>
         <relativePath>../pom.xml</relativePath>
     </parent>
 

flowman-dsl/pom.xml

@@ -10,7 +10,7 @@
     <parent>
         <artifactId>flowman-root</artifactId>
         <groupId>com.dimajix.flowman</groupId>
-        <version>1.0.0-SNAPSHOT</version>
+        <version>1.0.0</version>
         <relativePath>../pom.xml</relativePath>
     </parent>
 

flowman-hub/pom.xml

@@ -10,7 +10,7 @@
     <parent>
         <artifactId>flowman-root</artifactId>
         <groupId>com.dimajix.flowman</groupId>
-        <version>1.0.0-SNAPSHOT</version>
+        <version>1.0.0</version>
         <relativePath>../pom.xml</relativePath>
     </parent>
 

flowman-kernel-api/pom.xml

@@ -10,7 +10,7 @@
     <parent>
         <artifactId>flowman-root</artifactId>
         <groupId>com.dimajix.flowman</groupId>
-        <version>1.0.0-SNAPSHOT</version>
+        <version>1.0.0</version>
         <relativePath>../pom.xml</relativePath>
     </parent>
 

flowman-kernel-common/pom.xml

@@ -10,7 +10,7 @@
     <parent>
         <artifactId>flowman-root</artifactId>
         <groupId>com.dimajix.flowman</groupId>
-        <version>1.0.0-SNAPSHOT</version>
+        <version>1.0.0</version>
         <relativePath>../pom.xml</relativePath>
     </parent>
 

flowman-kernel-server/pom.xml

@@ -10,7 +10,7 @@
     <parent>
         <artifactId>flowman-root</artifactId>
         <groupId>com.dimajix.flowman</groupId>
-        <version>1.0.0-SNAPSHOT</version>
+        <version>1.0.0</version>
         <relativePath>../pom.xml</relativePath>
     </parent>
 

flowman-kernel-tools/pom.xml

@@ -10,7 +10,7 @@
     <parent>
 	    <groupId>com.dimajix.flowman</groupId>
 	    <artifactId>flowman-root</artifactId>
-        <version>1.0.0-SNAPSHOT</version>
+        <version>1.0.0</version>
         <relativePath>../pom.xml</relativePath>
     </parent>
 

flowman-parent/pom.xml

@@ -11,7 +11,7 @@
     <parent>
 	    <groupId>com.dimajix.flowman</groupId>
 	    <artifactId>flowman-root</artifactId>
-        <version>1.0.0-SNAPSHOT</version>
+        <version>1.0.0</version>
         <relativePath>../pom.xml</relativePath>
     </parent>
 

flowman-plugins/avro/pom.xml

@@ -10,7 +10,7 @@
     <parent>
 	    <groupId>com.dimajix.flowman</groupId>
         <artifactId>flowman-plugin-parent</artifactId>
-        <version>1.0.0-SNAPSHOT</version>
+        <version>1.0.0</version>
         <relativePath>../parent/pom.xml</relativePath>
     </parent>
 

flowman-plugins/aws/pom.xml

@@ -10,7 +10,7 @@
     <parent>
         <groupId>com.dimajix.flowman</groupId>
         <artifactId>flowman-plugin-parent</artifactId>
-        <version>1.0.0-SNAPSHOT</version>
+        <version>1.0.0</version>
         <relativePath>../parent/pom.xml</relativePath>
     </parent>
 

flowman-plugins/azure/pom.xml

@@ -10,7 +10,7 @@
     <parent>
         <groupId>com.dimajix.flowman</groupId>
         <artifactId>flowman-plugin-parent</artifactId>
-        <version>1.0.0-SNAPSHOT</version>
+        <version>1.0.0</version>
         <relativePath>../parent/pom.xml</relativePath>
     </parent>
 

flowman-plugins/delta/pom.xml

@@ -10,7 +10,7 @@
     <parent>
 	    <groupId>com.dimajix.flowman</groupId>
         <artifactId>flowman-plugin-parent</artifactId>
-        <version>1.0.0-SNAPSHOT</version>
+        <version>1.0.0</version>
         <relativePath>../parent/pom.xml</relativePath>
     </parent>
 

flowman-plugins/impala/pom.xml

@@ -10,7 +10,7 @@
     <parent>
 	    <groupId>com.dimajix.flowman</groupId>
         <artifactId>flowman-plugin-parent</artifactId>
-        <version>1.0.0-SNAPSHOT</version>
+        <version>1.0.0</version>
         <relativePath>../parent/pom.xml</relativePath>
     </parent>