Skip to content

Commit

Permalink
explicit deps and workaround for snowflakedb/snowflake-connector-pyth…
Browse files Browse the repository at this point in the history
…on#284 😔?
  • Loading branch information
GeoffWilliams committed Nov 24, 2020
1 parent 3cbfd88 commit c930cec
Show file tree
Hide file tree
Showing 7 changed files with 49 additions and 550 deletions.
22 changes: 0 additions & 22 deletions Pipfile

This file was deleted.

527 changes: 0 additions & 527 deletions Pipfile.lock

This file was deleted.

3 changes: 3 additions & 0 deletions pyproject.toml
Original file line number Diff line number Diff line change
@@ -0,0 +1,3 @@
[build-system]
requires = ["setuptools", "wheel"]
build-backend = "setuptools.build_meta:__legacy__"
30 changes: 30 additions & 0 deletions ringmaster.show.egg-info/PKG-INFO
Original file line number Diff line number Diff line change
Expand Up @@ -128,6 +128,13 @@ Description: # ringmaster
* parameters are converted to snake_case and looked up from databag
* outputs are converted to snake_case and added to databag

#### *.remote_cloudformation.yaml
* Remotely hosted cloudformation scripts to get around 51200 byte upload
hard limit
* Handled the same as local cloudformation scripts
* A copy of the remote file will be downloaded for your own records and
for parameter pre-processing

#### *.kubectl.yaml
* databag variables are available and can be inserted as ${variable_name}
* ringmaster pre-process the file to substitute variables and saves the
Expand Down Expand Up @@ -163,6 +170,29 @@ Description: # ringmaster
* `cluster_public_subnets`
* `cluster_public_subnet_{n}`

#### *.snowflake.sql
* Bunch of SQL commands to run against snowflake
* Configure snowflake credentials at `~/.ringmaster/snowflake.yaml`
* Placeholders will be substituted and the result saved to
`file.snowflake.processed.sql`
* Each line **must** end with `;`
* Lines starting `--` will be discarded
* One statement per line, but long statements can be split over multiple lines

# *.snowflake_query.sql
* ONE sql command to run which must be a `SELECT` statement
* Configure snowflake credentials at `~/.ringmaster/snowflake.yaml`
* Placeholders will be substituted and the result saved to
`file.snowflake_query.processed.sql`
* Entire processed file will be executed as-is
* Columns in the results will be added to databag using the column name. Use
SQL `AS` to set databag name, eg:
`SELECT x AS the_name_for_databag`

#### helm_deploy.yaml
* Requires internet access - for repeatable deployments artifactory integration
or similar required
* Install helm repo and deploy directly
Platform: UNKNOWN
Classifier: Development Status :: 1 - Planning
Classifier: Programming Language :: Python :: 3
Expand Down
2 changes: 2 additions & 0 deletions ringmaster.show.egg-info/SOURCES.txt
Original file line number Diff line number Diff line change
@@ -1,5 +1,6 @@
MANIFEST.in
README.md
pyproject.toml
setup.py
ringmaster/__init__.py
ringmaster/api.py
Expand All @@ -14,6 +15,7 @@ ringmaster.show.egg-info/PKG-INFO
ringmaster.show.egg-info/SOURCES.txt
ringmaster.show.egg-info/dependency_links.txt
ringmaster.show.egg-info/entry_points.txt
ringmaster.show.egg-info/requires.txt
ringmaster.show.egg-info/top_level.txt
ringmaster/res/aws/databag.yaml
ringmaster/res/aws/stack/down/0010/cluster.sh
Expand Down
5 changes: 5 additions & 0 deletions ringmaster.show.egg-info/requires.txt
Original file line number Diff line number Diff line change
@@ -0,0 +1,5 @@
python-dateutil
boto3
snakecase
cfn_flip
snowflake-connector-python-lite
10 changes: 9 additions & 1 deletion setup.py
Original file line number Diff line number Diff line change
Expand Up @@ -25,5 +25,13 @@
"console_scripts": (['ringmaster=ringmaster.cli:main'],)
},
include_package_data=True,
install_requires=[]
install_requires=[
"python-dateutil",
"boto3",
"snakecase",
"cfn_flip",

# https://github.com/snowflakedb/snowflake-connector-python/issues/284
"snowflake-connector-python-lite",
]
)

0 comments on commit c930cec

Please sign in to comment.