Skip to content

Commit

Permalink
doc and website updates for the 1.17 release
Browse files Browse the repository at this point in the history
  • Loading branch information
bridget committed Dec 26, 2019
1 parent 4c0bb7e commit 374f55c
Show file tree
Hide file tree
Showing 12 changed files with 533 additions and 36 deletions.
10 changes: 5 additions & 5 deletions _data/version.json
Original file line number Diff line number Diff line change
@@ -1,7 +1,7 @@
{
"display_version": "1.16",
"full_version": "1.16.0",
"release_date": "May 02, 2019",
"blog_post":"/blog/2019/05/02/drill-1.16-released",
"release_notes": "https://drill.apache.org/docs/apache-drill-1-16-0-release-notes/"
"display_version": "1.17",
"full_version": "1.17.0",
"release_date": "December 26, 2019",
"blog_post":"/blog/2019/12/26/drill-1.17-released",
"release_notes": "https://drill.apache.org/docs/apache-drill-1-17-0-release-notes/"
}
8 changes: 5 additions & 3 deletions _docs/configure-drill/120-configuring-the-drill-shell.md
Original file line number Diff line number Diff line change
@@ -1,11 +1,13 @@
---
title: "Configuring the Drill Shell"
date: 2019-05-02
date: 2019-12-26
parent: "Configure Drill"
---
Drill uses SQLLine as the Drill shell. SQLLine is a pure-Java console-based utility for connecting to relational databases and running SQL commands.
Drill uses SQLLine as the Drill shell. SQLLine is a pure-Java console-based utility for connecting to relational databases and running SQL commands.

Starting in Drill 1.16, Drill uses SQLLine 1.7. This upgrade changes the default Drill prompt to `apache drill>`. If you switch to a specific schema, for example `dfs.tmp`, the prompt includes the current schema, as shown:
Starting in Drill 1.17, Drill uses SQLLine 1.9.

Drill 1.16 uses SQLLine 1.7, which changes the default Drill prompt to `apache drill>`. If you switch to a specific schema, for example `dfs.tmp`, the prompt includes the current schema, as shown:

use dfs.tmp;
+------+-------------------------------------+
Expand Down
32 changes: 31 additions & 1 deletion _docs/getting-started/010-drill-introduction.md
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
---
title: "Drill Introduction"
date: 2019-05-02
date: 2019-12-26
parent: "Getting Started"
---
Drill is an Apache open-source SQL query engine for Big Data exploration.
Expand All @@ -10,6 +10,36 @@ applications, while still providing the familiarity and ecosystem of ANSI SQL,
the industry-standard query language. Drill provides plug-and-play integration
with existing Apache Hive and Apache HBase deployments.

## What's New in Apache Drill 1.17
* <a href='https://issues.apache.org/jira/browse/DRILL-6540'>DRILL-6540</a> - Upgrade to HADOOP-3.0 libraries. The hadoop-winutils version that worked for previous releases does not work with Drill 1.17 and later. Use the hadoop-winutils version provided with Drill 1.17 or use custom hadoop-winutils built for Hadoop 3.2.0.
* <a href='https://issues.apache.org/jira/browse/DRILL-6739'>DRILL-6739</a> - Update Kafka libs to 2.0.0+ version
* <a href='https://issues.apache.org/jira/browse/DRILL-7401'>DRILL-7401</a> - Upgrade to Sqlline 1.9
* <a href='https://issues.apache.org/jira/browse/DRILL-7200'>DRILL-7200</a> - Update Calcite to 1.19.0 / 1.20.0
* <a href='https://issues.apache.org/jira/browse/DRILL-5674'>DRILL-5674</a> - Support for .zip compression
* <a href='https://issues.apache.org/jira/browse/DRILL-6835'>DRILL-6835</a> - Schema provision using File / Table Function
* <a href='https://issues.apache.org/jira/browse/DRILL-7337'>DRILL-7337</a> - Support for vararg UDFs
* <a href='https://issues.apache.org/jira/browse/DRILL-7096'>DRILL-7096</a> - Develop vector for canonical Map<K,V>
* <a href='https://issues.apache.org/jira/browse/DRILL-7343'>DRILL-7343</a> - User-Agent UDFs added

Hive complex types support:
* <a href='https://issues.apache.org/jira/browse/DRILL-7251'>DRILL-7251</a> - Read Hive array without nulls
* <a href='https://issues.apache.org/jira/browse/DRILL-7252'>DRILL-7252</a> - Read Hive map using Dict<K,V> vector
* <a href='https://issues.apache.org/jira/browse/DRILL-7253'>DRILL-7253</a> - Read Hive struct without nulls
* <a href='https://issues.apache.org/jira/browse/DRILL-7254'>DRILL-7254</a> - Read Hive union without nulls
* <a href='https://issues.apache.org/jira/browse/DRILL-7268'>DRILL-7268</a> - Read Hive array with parquet native reader

New format plugins support:
* <a href='https://issues.apache.org/jira/browse/DRILL-4303'>DRILL-4303</a> - ESRI Shapefile (shp) format plugin
* <a href='https://issues.apache.org/jira/browse/DRILL-7177'>DRILL-7177</a> - Format Plugin for Excel Files
* <a href='https://issues.apache.org/jira/browse/DRILL-6096'>DRILL-6096</a> - Provide mechanisms to specify field delimiters and quoted text for TextRecordWriter
* Parquet format improvements, including runtime row group pruning (<a href='https://issues.apache.org/jira/browse/DRILL-7062'>DRILL-7062</a>), empty parquet creation (<a href='https://issues.apache.org/jira/browse/DRILL-7156'>DRILL-7156</a>), reading (<a href='https://issues.apache.org/jira/browse/DRILL-4517'>DRILL-4517</a>) support, and more.

Metastore support:
* <a href='https://issues.apache.org/jira/browse/DRILL-7272'>DRILL-7272</a> - Implement Drill Iceberg Metastore plugin
* <a href='https://issues.apache.org/jira/browse/DRILL-7273'>DRILL-7273</a> - Create operator for handling metadata
* <a href='https://issues.apache.org/jira/browse/DRILL-7357'>DRILL-7357</a> - Expose Drill Metastore data through INFORMATION_SCHEMA


## What's New in Apache Drill 1.16
- [ANALYZE TABLE statement]({{site.baseurl}}/docs/analyze-table/) to computes statistics on Parquet data ([DRILL-1328](https://issues.apache.org/jira/browse/DRILL-1328))
- [CREATE OR REPLACE SCHEMA command]({{site.baseurl}}/docs/create-or-replace-schema/) to define a schema for text files ([DRILL-6964](https://issues.apache.org/jira/browse/DRILL-6964))
Expand Down
8 changes: 4 additions & 4 deletions _docs/install/047-installing-drill-on-the-cluster.md
Original file line number Diff line number Diff line change
@@ -1,13 +1,13 @@
---
title: "Installing Drill on the Cluster"
date: 2019-05-02
date: 2019-12-26
parent: "Installing Drill in Distributed Mode"
---
You install Drill on nodes in the cluster, configure a cluster ID, and add Zookeeper information, as described in the following steps:

1. Download the latest version of Apache Drill [here](http://apache.mirrors.hoobly.com/drill/drill-1.16.0/apache-drill-1.16.0.tar.gz) or from the [Apache Drill mirror site](http://www.apache.org/dyn/closer.cgi/drill/drill-1.16.0/apache-drill-1.16.0.tar.gz) with the command appropriate for your system:
* `wget http://apache.mirrors.hoobly.com/drill/drill-1.16.0/apache-drill-1.16.0.tar.gz`
* `curl -o apache-drill-1.16.0.tar.gz http://apache.mirrors.hoobly.com/drill/drill-1.16.0/apache-drill-1.16.0.tar.gz`
1. Download the latest version of Apache Drill [here](http://apache.mirrors.hoobly.com/drill/drill-1.17.0/apache-drill-1.17.0.tar.gz) or from the [Apache Drill mirror site](http://www.apache.org/dyn/closer.cgi/drill/drill-1.17.0/apache-drill-1.17.0.tar.gz) with the command appropriate for your system:
* `wget http://apache.mirrors.hoobly.com/drill/drill-1.17.0/apache-drill-1.17.0.tar.gz`
* `curl -o apache-drill-1.17.0.tar.gz http://apache.mirrors.hoobly.com/drill/drill-1.17.0/apache-drill-1.17.0.tar.gz`
2. Extract the tarball to the directory of your choice, such as `/opt`:
`tar -xzvf apache-drill-<version>.tar.gz`
3. In `drill-override.conf,` use the Drill `cluster ID`, and provide ZooKeeper host names and port numbers to configure a connection to your ZooKeeper quorum.
Expand Down
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
---
title: "Running Drill on Docker"
date: 2019-05-31
date: 2019-12-26
parent: "Installing Drill in Embedded Mode"
---

Expand All @@ -27,20 +27,20 @@ Whether you run the Docker container in detached or foreground mode, you start D
| `-t` | Allocates a pseudo-tty (a shell). |
| `--name` | Identifies the container. If you do not use this option to identify a name for the container, the daemon generates a container ID for you. When you use this option to identify a container name, you can use the name to reference the container within a Docker network in foreground or detached mode. |
| `-p` | The TCP port for the Drill Web UI. If needed, you can change this port using the `drill.exec.http.port` [start-up option]({{site.baseurl}}/docs/start-up-options/). |
| `drill/apache-drill:<version>` | The Docker Hub repository and tag. In the following example, `drill/apache-drill` is the repository and `1.16.0` is the tag: `drill/apache-drill:1.16.0` The tag correlates with the version of Drill. When a new version of Drill is available, you can use the new version as the tag. |
| `drill/apache-drill:<version>` | The Docker Hub repository and tag. In the following example, `drill/apache-drill` is the repository and `1.17.0` is the tag: `drill/apache-drill:1.17.0` The tag correlates with the version of Drill. When a new version of Drill is available, you can use the new version as the tag. |
| `bin/bash` | Connects to the Drill container using a bash shell. |

### Running the Drill Docker Container in Foreground Mode

Open a terminal window (Command Prompt or PowerShell, but not PowerShell ISE) and then issue the following command and options to connect to SQLLine (the Drill shell):

docker run -i --name drill-1.16.0 -p 8047:8047 -t drill/apache-drill:1.16.0 /bin/bash
docker run -i --name drill-1.17.0 -p 8047:8047 -t drill/apache-drill:1.17.0 /bin/bash

When you issue the docker run command, the Drill process starts in a container. SQLLine prints a message, and the prompt appears:

Jun 29, 2018 3:28:21 AM org.glassfish.jersey.server.ApplicationHandler initialize
INFO: Initiating Jersey application, version Jersey: 2.8 2014-04-29 01:25:26...
apache drill 1.16.0
apache drill 1.17.0
"json ain't no thang"
0: jdbc:drill:zk=local>

Expand All @@ -54,17 +54,17 @@ Open a terminal window (Command Prompt or PowerShell, but not PowerShell ISE) an

**Note:** When you run the Drill Docker container in detached mode, you connect to SQLLine (the Drill shell) using drill-localhost.

$ docker run -i --name drill-1.16.0 -p 8047:8047 --detach -t drill/apache-drill:1.16.0 /bin/bash
$ docker run -i --name drill-1.17.0 -p 8047:8047 --detach -t drill/apache-drill:1.17.0 /bin/bash
<displays container ID>

$ docker exec -it drill-1.16.0 bash
$ docker exec -it drill-1.17.0 bash
<connects to container>

$ /opt/drill/bin/drill-localhost

After you issue the commands, the Drill process starts in a container. SQLLine prints a message, and the prompt appears:

apache drill 1.16.0
apache drill 1.17.0
"json ain't no thang"
0: jdbc:drill:drillbit=localhost>

Expand Down
Original file line number Diff line number Diff line change
@@ -1,16 +1,16 @@
---
title: "Installing Drill on Linux and Mac OS X"
date: 2019-05-02
date: 2019-12-26
parent: "Installing Drill in Embedded Mode"
---
First, check that you [meet the prerequisites]({{site.baseurl}}/docs/embedded-mode-prerequisites), and then install Apache Drill on Linux or Mac OS X:

Complete the following steps to install Drill:

1. In a terminal window, change to the directory where you want to install Drill.
2. Download the latest version of Apache Drill [here](http://apache.mirrors.hoobly.com/drill/drill-1.16.0/apache-drill-1.16.0.tar.gz) or from the [Apache Drill mirror site](http://www.apache.org/dyn/closer.cgi/drill/drill-1.16.0/apache-drill-1.16.0.tar.gz) with the command appropriate for your system:
* `wget http://apache.mirrors.hoobly.com/drill/drill-1.16.0/apache-drill-1.16.0.tar.gz`
* `curl -o apache-drill-1.16.0.tar.gz http://www.apache.org/dyn/closer.cgi/drill/drill-1.16.0/apache-drill-1.16.0.tar.gz`
2. Download the latest version of Apache Drill [here](http://apache.mirrors.hoobly.com/drill/drill-1.17.0/apache-drill-1.17.0.tar.gz) or from the [Apache Drill mirror site](http://www.apache.org/dyn/closer.cgi/drill/drill-1.17.0/apache-drill-1.17.0.tar.gz) with the command appropriate for your system:
* `wget http://apache.mirrors.hoobly.com/drill/drill-1.17.0/apache-drill-1.17.0.tar.gz`
* `curl -o apache-drill-1.17.0.tar.gz http://www.apache.org/dyn/closer.cgi/drill/drill-1.17.0/apache-drill-1.17.0.tar.gz`
3. Copy the downloaded file to the directory where you want to install Drill.
4. Extract the contents of the Drill `.tar.gz` file. Use sudo only if necessary:
`tar -xvzf <.tar.gz file name>`
Expand Down
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
---
title: "Installing Drill on Windows"
date: 2019-05-02
date: 2019-12-26
parent: "Installing Drill in Embedded Mode"
---

Expand Down Expand Up @@ -49,7 +49,7 @@ You, or the user that will start Drill, must manually create and own UDF directo

## Download and Install Drill

1. Download the latest version of Apache Drill [here](http://www-us.apache.org/dist/drill/drill-1.16.0/apache-drill-1.16.0.tar.gz).
1. Download the latest version of Apache Drill [here](http://www-us.apache.org/dist/drill/drill-1.17.0/apache-drill-1.17.0.tar.gz).
2. Move the downloaded file to the directory where you want to install Drill.
3. Unzip the GZ file using a third-party tool. If the tool you use does not unzip the underlying TAR file as well as the GZ file, perform a second unzip to extract the Drill software. The extraction process creates the installation directory containing the Drill software.
4. [Start Drill]({{site.baseurl}}/docs/starting-drill-on-windows).
Original file line number Diff line number Diff line change
@@ -1,26 +1,26 @@
---
title: "Starting Drill on Windows"
date: 2019-04-10
date: 2019-12-26
parent: "Installing Drill in Embedded Mode"
---
Complete the following steps to launch the Drill:

1. Open the Windows command prompt.
2. Navigate to the Drill installation folder, for example:
`cd \Users\user1\drill_repo\apache-drill-1.16.0-SNAPSHOT`
`cd \Users\user1\drill_repo\apache-drill-1.17.0-SNAPSHOT`
3. Go to the `bin` directory, for example:
`cd bin`
4. Enter either of the following commands to start Drill:
- `sqlline.bat -u "jdbc:drill:zk=local"`
- `drill-embedded.bat` (Supported in Drill 1.16 and later.)

C:\Users\user1\drill_repo\apache-drill-1.16.0-SNAPSHOT\bin>drill-embedded.bat
C:\Users\user1\drill_repo\apache-drill-1.17.0-SNAPSHOT\bin>drill-embedded.bat
DRILL_ARGS - " -u jdbc:drill:zk=local"
HADOOP_HOME not detected...
HBASE_HOME not detected...
Calculating Drill classpath...
Apache Drill 1.16.0-SNAPSHOT
Apache Drill 1.17.0-SNAPSHOT
"Drill never goes out of style."
apache drill>

Expand Down
Loading

0 comments on commit 374f55c

Please sign in to comment.