Skip to content

Releases: datafy-io/datafy-tools

v0.3.1

Choose a tag to compare

@github-actions github-actions released this 19 Oct 07:56
2592278

Datafy Discovery Tool v0.3.1

Inventories the block storage and compute footprint of a cloud estate, so a Datafy engagement can be scoped before installation. Output is one JSON object per unit of scope (JSONL format).

AWS — EBS volumes, EC2 instances, AMIs, snapshots, DLM policies and AWS Backup plans, across every account in an Organization. One record per account × region.

Azure — managed disks, VMs, scale sets, snapshots, images, backup vaults and policies, across every subscription in a tenant. One record per subscription.

Assets are named by cloud: discovery-aws-* / discovery-azure-* for the Go binaries, and discovery-aws.{sh,py} / discovery-azure.{sh,py} for the script implementations.

Download — AWS

Tool File Requirements
Go — Linux x86-64 discovery-aws-linux-amd64 none
Go — Linux ARM64 discovery-aws-linux-arm64 none
Go — macOS x86-64 discovery-aws-darwin-amd64 none
Go — macOS Apple Silicon discovery-aws-darwin-arm64 none
Go — Windows x86-64 discovery-aws-windows-amd64.exe none
Go — Windows ARM64 discovery-aws-windows-arm64.exe none
Bash discovery-aws.sh aws-cli v2, jq
Python discovery-aws.py Python 3.8+, boto3

Download — Azure

Tool File Requirements
Go — Linux x86-64 discovery-azure-linux-amd64 none
Go — Linux ARM64 discovery-azure-linux-arm64 none
Go — macOS x86-64 discovery-azure-darwin-amd64 none
Go — macOS Apple Silicon discovery-azure-darwin-arm64 none
Go — Windows x86-64 discovery-azure-windows-amd64.exe none
Go — Windows ARM64 discovery-azure-windows-arm64.exe none
Bash discovery-azure.sh curl, jq
Python discovery-azure.py Python 3.9+, azure-identity

Quick start — AWS

Run from the management (root) account.

# Go
chmod +x discovery-aws-darwin-arm64
./discovery-aws-darwin-arm64 --profile myprofile --setup-role

# Bash
chmod +x discovery-aws.sh
./discovery-aws.sh --profile myprofile --setup-role

# Python
pip install boto3
python3 discovery-aws.py --profile myprofile --setup-role

Quick start — Azure

Sign in first with az login. There is no role to assume: one
identity with Reader across the tenant reads every subscription.

# Go
chmod +x discovery-azure-darwin-arm64
./discovery-azure-darwin-arm64

# Bash
chmod +x discovery-azure.sh
./discovery-azure.sh

# Python
pip install azure-identity
python3 discovery-azure.py

Add --setup-role to have the tool grant itself Reader for the
duration of the scan and remove it afterwards.

See the overview,
the AWS guide
or the Azure guide
for full usage.

What's Changed

Other Changes

  • fix(discovery-tool): list scale set instances so AKS nodes are discovered by @snirzango in #5

Full Changelog: v0.3.0...v0.3.1

v0.3.1-rc1

Choose a tag to compare

@github-actions github-actions released this 18 Oct 13:40

Datafy Discovery Tool v0.3.1-rc1

Inventories the block storage and compute footprint of a cloud estate, so a Datafy engagement can be scoped before installation. Output is one JSON object per unit of scope (JSONL format).

AWS — EBS volumes, EC2 instances, AMIs, snapshots, DLM policies and AWS Backup plans, across every account in an Organization. One record per account × region.

Azure — managed disks, VMs, scale sets, snapshots, images, backup vaults and policies, across every subscription in a tenant. One record per subscription.

Assets are named by cloud: discovery-aws-* / discovery-azure-* for the Go binaries, and discovery-aws.{sh,py} / discovery-azure.{sh,py} for the script implementations.

Download — AWS

Tool File Requirements
Go — Linux x86-64 discovery-aws-linux-amd64 none
Go — Linux ARM64 discovery-aws-linux-arm64 none
Go — macOS x86-64 discovery-aws-darwin-amd64 none
Go — macOS Apple Silicon discovery-aws-darwin-arm64 none
Go — Windows x86-64 discovery-aws-windows-amd64.exe none
Go — Windows ARM64 discovery-aws-windows-arm64.exe none
Bash discovery-aws.sh aws-cli v2, jq
Python discovery-aws.py Python 3.8+, boto3

Download — Azure

Tool File Requirements
Go — Linux x86-64 discovery-azure-linux-amd64 none
Go — Linux ARM64 discovery-azure-linux-arm64 none
Go — macOS x86-64 discovery-azure-darwin-amd64 none
Go — macOS Apple Silicon discovery-azure-darwin-arm64 none
Go — Windows x86-64 discovery-azure-windows-amd64.exe none
Go — Windows ARM64 discovery-azure-windows-arm64.exe none
Bash discovery-azure.sh curl, jq
Python discovery-azure.py Python 3.9+, azure-identity

Quick start — AWS

Run from the management (root) account.

# Go
chmod +x discovery-aws-darwin-arm64
./discovery-aws-darwin-arm64 --profile myprofile --setup-role

# Bash
chmod +x discovery-aws.sh
./discovery-aws.sh --profile myprofile --setup-role

# Python
pip install boto3
python3 discovery-aws.py --profile myprofile --setup-role

Quick start — Azure

Sign in first with az login. There is no role to assume: one
identity with Reader across the tenant reads every subscription.

# Go
chmod +x discovery-azure-darwin-arm64
./discovery-azure-darwin-arm64

# Bash
chmod +x discovery-azure.sh
./discovery-azure.sh

# Python
pip install azure-identity
python3 discovery-azure.py

Add --setup-role to have the tool grant itself Reader for the
duration of the scan and remove it afterwards.

See the overview,
the AWS guide
or the Azure guide
for full usage.

Full Changelog: v0.3.0...v0.3.1-rc1

v0.3.0

Choose a tag to compare

@github-actions github-actions released this 15 Sep 11:33
37f8a34

Datafy Discovery Tool v0.3.0

Inventories the block storage and compute footprint of a cloud estate, so a Datafy engagement can be scoped before installation. Output is one JSON object per unit of scope (JSONL format).

AWS — EBS volumes, EC2 instances, AMIs, snapshots, DLM policies and AWS Backup plans, across every account in an Organization. One record per account × region.

Azure — managed disks, VMs, scale sets, snapshots, images, backup vaults and policies, across every subscription in a tenant. One record per subscription.

Assets are named by cloud: discovery-aws-* / discovery-azure-* for the Go binaries, and discovery-aws.{sh,py} / discovery-azure.{sh,py} for the script implementations.

Download — AWS

Tool File Requirements
Go — Linux x86-64 discovery-aws-linux-amd64 none
Go — Linux ARM64 discovery-aws-linux-arm64 none
Go — macOS x86-64 discovery-aws-darwin-amd64 none
Go — macOS Apple Silicon discovery-aws-darwin-arm64 none
Go — Windows x86-64 discovery-aws-windows-amd64.exe none
Go — Windows ARM64 discovery-aws-windows-arm64.exe none
Bash discovery-aws.sh aws-cli v2, jq
Python discovery-aws.py Python 3.8+, boto3

Download — Azure

Tool File Requirements
Go — Linux x86-64 discovery-azure-linux-amd64 none
Go — Linux ARM64 discovery-azure-linux-arm64 none
Go — macOS x86-64 discovery-azure-darwin-amd64 none
Go — macOS Apple Silicon discovery-azure-darwin-arm64 none
Go — Windows x86-64 discovery-azure-windows-amd64.exe none
Go — Windows ARM64 discovery-azure-windows-arm64.exe none
Bash discovery-azure.sh curl, jq
Python discovery-azure.py Python 3.9+, azure-identity

Quick start — AWS

Run from the management (root) account.

# Go
chmod +x discovery-aws-darwin-arm64
./discovery-aws-darwin-arm64 --profile myprofile --setup-role

# Bash
chmod +x discovery-aws.sh
./discovery-aws.sh --profile myprofile --setup-role

# Python
pip install boto3
python3 discovery-aws.py --profile myprofile --setup-role

Quick start — Azure

Sign in first with az login. There is no role to assume: one
identity with Reader across the tenant reads every subscription.

# Go
chmod +x discovery-azure-darwin-arm64
./discovery-azure-darwin-arm64

# Bash
chmod +x discovery-azure.sh
./discovery-azure.sh

# Python
pip install azure-identity
python3 discovery-azure.py

Add --setup-role to have the tool grant itself Reader for the
duration of the scan and remove it afterwards.

See the overview,
the AWS guide
or the Azure guide
for full usage.

What's Changed

Other Changes

  • feat(discovery-tool): Azure edition, split by cloud (DT-11659) + setup-role template fix (DT-11548) by @snirzango in #4

Full Changelog: v0.2.0...v0.3.0

v0.2.0

Choose a tag to compare

@github-actions github-actions released this 28 Jul 15:05
d0b1e64

Datafy Discovery Tool v0.2.0

Inventories EBS volumes, EC2 instances, AMIs, snapshots, DLM policies, and AWS Backup plans across all accounts in an AWS Organization. Output is one JSON object per account × region (JSONL format).

Download

Tool File Requirements
Go — Linux x86-64 discovery-linux-amd64 none
Go — Linux ARM64 discovery-linux-arm64 none
Go — macOS x86-64 discovery-darwin-amd64 none
Go — macOS Apple Silicon discovery-darwin-arm64 none
Go — Windows x86-64 discovery-windows-amd64.exe none
Bash discovery.sh aws-cli v2, jq
Python discovery.py Python 3.8+, boto3

Quick start

# Go
./discovery-darwin-arm64 --profile myprofile --setup-role

# Bash
chmod +x discovery.sh
./discovery.sh --profile myprofile --setup-role

# Python
pip install boto3
python3 discovery.py --profile myprofile --setup-role

See the README for full usage.

What's Changed

Other Changes

  • fix(discovery-tool): stop argv overflow silently dropping regions (DT-11095) by @snirzango in #2
  • fix(discovery-tool): pin one retry policy across all three implementations by @snirzango in #3

Full Changelog: v0.1.2...v0.2.0

v0.1.2

Choose a tag to compare

@github-actions github-actions released this 18 Jun 08:07
5f3ef13

Datafy Discovery Tool v0.1.2

Inventories EBS volumes, EC2 instances, AMIs, snapshots, DLM policies, and AWS Backup plans across all accounts in an AWS Organization. Output is one JSON object per account × region (JSONL format).

Download

Tool File Requirements
Go — Linux x86-64 discovery-linux-amd64 none
Go — Linux ARM64 discovery-linux-arm64 none
Go — macOS x86-64 discovery-darwin-amd64 none
Go — macOS Apple Silicon discovery-darwin-arm64 none
Go — Windows x86-64 discovery-windows-amd64.exe none
Bash discovery.sh aws-cli v2, jq
Python discovery.py Python 3.8+, boto3

Quick start

# Go
./discovery-darwin-arm64 --profile myprofile --setup-role

# Bash
chmod +x discovery.sh
./discovery.sh --profile myprofile --setup-role

# Python
pip install boto3
python3 discovery.py --profile myprofile --setup-role

See the README for full usage.

What's Changed

Other Changes

  • docs: overhaul discovery tool README structure by @snirzango in #1

New Contributors

Full Changelog: v0.1.1...v0.1.2

v0.1.1

Choose a tag to compare

@github-actions github-actions released this 11 Jun 10:31

Datafy Discovery Tool v0.1.1

Inventories EBS volumes, EC2 instances, AMIs, snapshots, DLM policies, and AWS Backup plans across all accounts in an AWS Organization. Output is one JSON object per account × region (JSONL format).

Download

Tool File Requirements
Go — Linux x86-64 discovery-linux-amd64 none
Go — Linux ARM64 discovery-linux-arm64 none
Go — macOS x86-64 discovery-darwin-amd64 none
Go — macOS Apple Silicon discovery-darwin-arm64 none
Go — Windows x86-64 discovery-windows-amd64.exe none
Bash discovery.sh aws-cli v2, jq
Python discovery.py Python 3.8+, boto3

Quick start

# Go
./discovery-darwin-arm64 --profile myprofile --setup-role

# Bash
chmod +x discovery.sh
./discovery.sh --profile myprofile --setup-role

# Python
pip install boto3
python3 discovery.py --profile myprofile --setup-role

See the README for full usage.

Full Changelog: https://github.com/datafy-io/datafy-tools/commits/v0.1.1