Treasure Data command line tool¶ ↑

<img src=“https://circleci.com/gh/treasure-data/td.svg?style=svg” alt=“Build Status” /> <img src=“https://ci.appveyor.com/api/projects/status/github/treasure-data/td?branch=master&svg=true” alt=“appveyor” /> <img src=“https://coveralls.io/repos/treasure-data/td/badge.svg?branch=master&service=github” alt=“Coverage Status” />

This CUI utility wraps the Ruby Client Library td-client-ruby to interact with the REST API in managing databases and jobs on the Treasure Data Cloud.

For more info about Treasure Data, see <www.treasuredata.com/>.

For full documentation see <docs.treasuredata.com/>.

Getting Started¶ ↑

Install td command as a gem.

> gem install td

See help message for details.

> td

You need to authorize the account, before executing any other commands.

> td account

Sample Workflow¶ ↑

> td account -f                       # authorize an account
user: k@treasure-data.com
password: **********
> td database:create mydb             # create a database
> td table:create mydb www_access     # create a table

Packaging¶ ↑

Mac OS X¶ ↑

Disable RVM or rbenv and use ruby.pkg’s ruby (/usr/local/td/ruby/bin/ruby). And then run following commands:

$ /usr/local/td/ruby/bin/gem install bundler rubyzip
$ /usr/local/td/ruby/bin/bundle install
$ /usr/local/td/ruby/bin/rake pkg:build

It uses github.com/treasure-data/ruby-osx-packager

Windows¶ ↑

Install following binary packages:

* MinGW with MSYS Basic System and using mingw-get-inst
* Git for Windows, with Windows Command Prompt support
* Ruby ruby-1.9.3p327 using RubyInstaller for Windows, with PATH update
* Inno Setup 5

Then run following commands on MinGW Shell:

$ mingw-get install msys-vim
$ mingw-get install msys-wget
$ gem install bundler rubyzip
$ bundle install  # don't use "--path" option
$ rake exe:build  # don't use "bundle exec"

Bulk Import¶ ↑

Some of the td commands prefixed with td import leverages the Java Bulk Import CLI td-import-java to process and Bulk load data in the Treasure Data Cloud.

The Bulk Import CLI is downloaded automatically at the first call to any of the command that require it; the use will need internet connectivity in order to fetch the Bulk Import CLI JAR file from the Central Maven repository and take advantage of these advanced features. If you need to setup a proxy, please consult this documentation page.

The log levels and properties of the Bulk Import CLI can be configured in a logging.properties file. A default configuration is provided in a file within the gem or Toolbelt folder root, in the java/ folder. If you wish to customize it, please make a copy of this file and store it in the:

~/.td/java             folder on Mac OSX or Linux
%USERPROFILE%\.td\java folder on Windows

Testing Hooks¶ ↑

The CLI implements several hooks to enable/disable/trigger special behaviors. These hooks are expressed as environment variables and can therefore be provided in several ways:

How to Use¶ ↑

• Unix / Linux / MacOSX

  • environment variable export in the shell the command is executed. The setting remains active until the shell is closed. E.g.:

    $ export TD_TOOLBELT_DEBUG=1

  • in the shell configuration file, to be active in any new shell that is opened. E.g.: add

    export TD_TOOLBELT_DEBUG=1
    

    to ~/.bashrc or equivalent shell configuration file. To make the setting active in the current shell, source the configuration file, e.g.:

    $ source ~/.bashrc

  • on the command line at runtime (active only for the duration of the command). E.g.:

    $ TD_TOOLBELT_DEBUG=1 td ....

  • as alias on in the current shell. The setting remains active until the shell is closed. E.g.:

    $ alias td='TD_TOOLBELT_DEBUG=1 td'

  • as alias in configuration file, to be active in any new shell that is opened. E.g.:

    alias td='TD_TOOLBELT_DEBUG=1 td'`

    to ~/.bashrc or equivalent shell configuration file. To make the setting active in the current shell, source the configuration file, e.g.:

    $ source ~/.bashrc

• Windows

  • in the command prompt the command is executed. The setting remains active until the command prompt window is closed. E.g.:

    cmd> set TD_TOOLBELT_DEBUG=1

  • as a global environment variable in the system settings. It will be active for all new command prompt windows.

These are the available hooks:

• Enable debugging mode:

  $ TD_TOOLBELT_DEBUG=1

• JAR auto update (enabled by default is not specified). This setting does not affect import:jar_update:

  • Enable:

    $ TD_TOOLBELT_JAR_UPDATE=1

  • Disable:

    $ TD_TOOLBELT_JAR_UPDATE=0

• Specify an alternative endpoint to use updating the toolbelt (default: toolbelt.treasuredata.com):

  $ TD_TOOLBELT_UPDATE_ROOT="http://toolbelt.treasuredata.com"

• Specify an alternative endpoint to use updating the JAR file (default: repo1.maven.org):

  $ TD_TOOLBELT_JARUPDATE_ROOT="https://repo1.maven.org"

Copyright¶ ↑

Copyright

Copyright © 2015 Treasure Data Inc.

License

Apache License, Version 2.0