Skip to content

v0.1.0

Choose a tag to compare

@HH-MWB HH-MWB released this 14 Jun 12:36
c8d2f30

AWS Glue Toolkit v0.1.0

We are pleased to announce the first public release of AWS Glue Toolkit, a command-line utility that streamlines the AWS Glue development lifecycle. The toolkit lets teams validate and package Glue jobs locally—before deployment—using dependency pins that mirror the target Glue runtime.

This release introduces the gtk command and establishes the project's core workflow: describe a job in pyproject.toml, verify its dependencies with gtk check, and produce deployment-ready artifacts with gtk build.

Overview

Each Glue job is defined as a directory containing a pyproject.toml, with toolkit settings under the [tool.aws-glue-toolkit] table. For example,

[tool.aws-glue-toolkit]
glue_version = "5.1"
source = "src"
script = "__main__.py"

Features

Dependency validation — gtk check

Resolves the job's declared dependencies against the bundled runtime pins for the configured Glue version, using the Glue worker's Python version and platform tag. Surfaces unsatisfiable dependencies early, without writing any files.

Artifact packaging — gtk build

Produces two deployment archives in the job directory:

Artifact Glue parameter Contents
{name}-{version}.dependencies.zip --extra-py-files Project .py sources, excluding the entry script
{name}-{version}.gluewheels.zip --additional-python-modules Wheels and requirements.txt, omitting packages already present on the Glue image

Bundled runtime metadata

Ships with curated dependency pins for Glue 5.0 and Glue 5.1, so dependency resolution reflects the actual managed runtime.

Predictable exit codes

Failures map to standard BSD sysexits.h codes for reliable scripting and CI integration:

Code Meaning
65 Dependencies unsatisfiable against the Glue runtime pins
66 pyproject.toml missing or unreadable
70 Build pipeline failure
78 Invalid configuration, job layout, or unsupported Glue version

Installation

Requires Python 3.11 or later.

pip install aws-glue-toolkit

Compatibility and support

  • Supported Glue runtimes: 5.0 and 5.1.
  • As an early 0.x release, the public interface may evolve between minor versions; changes will be documented in the release notes.

License

Released under the MIT License.