Skip to content
/ getRDSUpgradePath Public

Python script to find all possible Upgrade paths (from one Version to another) for AWS RDS Database Engines

License

GPL-3.0 license
5 stars 0 forks Branches Tags Activity
Star
Notifications You must be signed in to change notification settings

robins/getRDSUpgradePath

BranchesTags

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

92 Commits
.gitignore
.gitignore
 
 
.travis.yml
.travis.yml
 
 
LICENSE
LICENSE
 
 
README.md
README.md
 
 
awsrdscli.py
awsrdscli.py
 
 
gen_readme_output.sh
gen_readme_output.sh
 
 
getUpgradePath.py
getUpgradePath.py
 
 
pgvernum.py
pgvernum.py
 
 
releasenames.txt
releasenames.txt
 
 
test_awsrdscli.py
test_awsrdscli.py
 
 
test_getUpgradePath.py
test_getUpgradePath.py
 
 
test_pgvernum.py
test_pgvernum.py
 
 

Repository files navigation

getRDSUpgradePath

Coverage

Python script to find an Upgrade path (from source Version to Target) for any of the AWS RDS Database Engines. This is very convenient for some engines, where the upgrade paths are not obvious and notoriously hard to find (see the last example below).

Requirements

End-user features:

  • Compute best (least hops) solution
  • Show all possible Upgrade paths (if required)
  • Show computation progress if taking time
  • Support all engines (For e.g. Oracle / SQL Server / MariaDB / Aurora Postgres / etc.)
  • Allow (really high) verbosity levels, if required
  • Catch trivial errors
    • Source version newer
    • Source Target same
    • Engine name typos / hint correct spelling
  • Suggest typo corrections for
    • Engine Name
    • Ending Version
    • AWS Region Name
  • Auto-Correct
    • Engine Minor Version Number

Testing features

  • Currently (2019 Dec 2) the project has:
    • Extensive coverage for PG Version Number generation module - 100+ tests
      • Travis integration for all commits
    • Limited (but working) test coverage for Upgrade path generation

Releases

Sample Runs



=== Usage / syntax ===

>py getUpgradePath.py 11.17 14.5 postgres
.....
Upgrade Steps / Hops: 1
 Path: ['11.17', '14.5']


>py getUpgradepath.py 10.13 14.5 postgres 2
.....................................................................................................................................................................................................
Upgrade Steps / Hops: 2
 Path: ['10.13', '11.17', '14.5']
 Path: ['10.13', '10.22', '14.5']
 ^^ 2 upgrade paths found


>py getUpgradepath.py

Syntax: python getUpgradePath.py SourceVersion TargetVersion [engine] [hops] [verbosity]

Source / Target Versions are Mandatory. Optionally, you may also provide:
  Engine: RDS Database Engine | Default:postgres
  Hops: Find all upgrade combinations possible within these many Hops | Default:1 | Range:1-10
  Verbosity: Verbosity of the output | Default:1 | Range:1-5

Testing Postgres Version Number generation

>coverage run test_pgvernum.py
....
----------------------------------------------------------------------
Ran 4 tests in 0.002s

OK

Testing Upgrade Path generation

>coverage run test_getUpgradePath.py
.
----------------------------------------------------------------------
Ran 1 test in 2.981s

OK

Testing RDS CLI related aspects

C:\Users\tharar\Documents\sync\drive\proj\getRDSUpgradePath>py test_awsrdscli.py
...
----------------------------------------------------------------------
Ran 3 tests in 6.668s

OK

Other debug / Extra options supported


=== Catch trivial errors - (Source Target same) ===
>py getUpgradePath.py 10.6 10.6 postgres
No upgrade required when Source and Target versions are the same

=== Catch trivial errors - (Source version newer) ===
>py getUpgradePath.py 9.3.12 9.3.11 postgres
Cannot upgrade from newer to older version: 9.3.12 -> 9.3.11

=== Catch trivial errors - (Engine name recommendations) ===
>py getUpgradePath.py 9.3.12 9.3.11 auroapostgres
Invalid Engine: auroapostgres
Hint: May be you meant - aurora-postgresql

=== Auto-Correct trivial errors - (Minor version not provided) ===
>py getUpgradePath.py 9.4.23 9.5 postgres
Target Version corrected to - 9.5.0
Target Engine Version is not supported in RDS: 9.5.0

=== Show 1 Hop (direct upgrade) results by default ===
>py getUpgradePath.py 9.6.15 10.10

Upgrade Steps / Hops: 1
 Path: ['9.6.15', '10.10']

=== Show progress if computation takes longer ===
>py getUpgradePath.py 5.7.16 8.0.16 mysql
................
Upgrade Steps / Hops: 1
 Path: ['5.7.16', '8.0.16']

=== Support all engines - RDS Oracle ===
>py getUpgradePath.py 12.1.0.2.v13 12.1.0.2.v18 oracle-ee

Upgrade Steps / Hops: 1
 Path: ['12.1.0.2.v13', '12.1.0.2.v18']

=== Support all engines - RDS SQL Server ===
>py getUpgradePath.py 12.00.5000.0.v1 14.00.3192.2.v1 sqlserver-ee

Upgrade Steps / Hops: 1
 Path: ['12.00.5000.0.v1', '14.00.3192.2.v1']

=== Support all engines - RDS MariaDB ===
>py getUpgradePath.py 10.0.32 10.3.13 mariadb

Upgrade Steps / Hops: 1
 Path: ['10.0.32', '10.3.13']

=== Support all engines - Aurora Postgres ===
>py getUpgradePath.py 9.6.3 9.6.12 aurora-postgresql

Upgrade Steps / Hops: 1
 Path: ['9.6.3', '9.6.12']

=== Show *all* possible Upgrade paths ===
>py getUpgradePath.py 9.6.10 10.10 postgres 10

Upgrade Steps / Hops: 1
 Path: ['9.6.10', '10.10']

Upgrade Steps / Hops: 2
 Path: ['9.6.10', '10.9', '10.10']
 Path: ['9.6.10', '10.7', '10.10']
 Path: ['9.6.10', '10.6', '10.10']
 Path: ['9.6.10', '10.5', '10.10']
 Path: ['9.6.10', '9.6.15', '10.10']
 Path: ['9.6.10', '9.6.14', '10.10']
 Path: ['9.6.10', '9.6.12', '10.10']
 Path: ['9.6.10', '9.6.11', '10.10']
 ^^ 9 upgrade paths found

Upgrade Steps / Hops: 3
 Path: ['9.6.10', '10.7', '10.9', '10.10']
 Path: ['9.6.10', '10.6', '10.9', '10.10']
 Path: ['9.6.10', '10.6', '10.7', '10.10']
 Path: ['9.6.10', '10.5', '10.9', '10.10']
 Path: ['9.6.10', '10.5', '10.7', '10.10']
 Path: ['9.6.10', '10.5', '10.6', '10.10']
 Path: ['9.6.10', '9.6.14', '10.9', '10.10']
 Path: ['9.6.10', '9.6.14', '9.6.15', '10.10']
 Path: ['9.6.10', '9.6.12', '10.9', '10.10']
 Path: ['9.6.10', '9.6.12', '10.7', '10.10']
 Path: ['9.6.10', '9.6.12', '9.6.15', '10.10']
 Path: ['9.6.10', '9.6.12', '9.6.14', '10.10']
 Path: ['9.6.10', '9.6.11', '10.9', '10.10']
 Path: ['9.6.10', '9.6.11', '10.7', '10.10']
 Path: ['9.6.10', '9.6.11', '10.6', '10.10']
 Path: ['9.6.10', '9.6.11', '9.6.15', '10.10']
 Path: ['9.6.10', '9.6.11', '9.6.14', '10.10']
 Path: ['9.6.10', '9.6.11', '9.6.12', '10.10']
 ^^ 18 upgrade paths found

Upgrade Steps / Hops: 4
 Path: ['9.6.10', '10.6', '10.7', '10.9', '10.10']
 Path: ['9.6.10', '10.5', '10.7', '10.9', '10.10']
 Path: ['9.6.10', '10.5', '10.6', '10.9', '10.10']
 Path: ['9.6.10', '10.5', '10.6', '10.7', '10.10']
 Path: ['9.6.10', '9.6.12', '10.7', '10.9', '10.10']
 Path: ['9.6.10', '9.6.12', '9.6.14', '10.9', '10.10']
 Path: ['9.6.10', '9.6.12', '9.6.14', '9.6.15', '10.10']
 Path: ['9.6.10', '9.6.11', '10.7', '10.9', '10.10']
 Path: ['9.6.10', '9.6.11', '10.6', '10.9', '10.10']
 Path: ['9.6.10', '9.6.11', '10.6', '10.7', '10.10']
 Path: ['9.6.10', '9.6.11', '9.6.14', '10.9', '10.10']
 Path: ['9.6.10', '9.6.11', '9.6.14', '9.6.15', '10.10']
 Path: ['9.6.10', '9.6.11', '9.6.12', '10.9', '10.10']
 Path: ['9.6.10', '9.6.11', '9.6.12', '10.7', '10.10']
 Path: ['9.6.10', '9.6.11', '9.6.12', '9.6.15', '10.10']
 Path: ['9.6.10', '9.6.11', '9.6.12', '9.6.14', '10.10']
 ^^ 16 upgrade paths found

Upgrade Steps / Hops: 5
 Path: ['9.6.10', '10.5', '10.6', '10.7', '10.9', '10.10']
 Path: ['9.6.10', '9.6.11', '10.6', '10.7', '10.9', '10.10']
 Path: ['9.6.10', '9.6.11', '9.6.12', '10.7', '10.9', '10.10']
 Path: ['9.6.10', '9.6.11', '9.6.12', '9.6.14', '10.9', '10.10']
 Path: ['9.6.10', '9.6.11', '9.6.12', '9.6.14', '9.6.15', '10.10']
 ^^ 5 upgrade paths found

=== Show some level of verbosity ===
>py getUpgradePath.py 9.3.12 9.4.14 postgres 1 2
Calling AWS CLI with 9.3.12 x postgres
Calling AWS CLI with 9.4.14 y postgres
Calling AWS CLI with 9.3.12 9.4.14 postgres
Calling AWS CLI with 9.4.12 9.4.14 postgres
Calling AWS CLI with 9.4.11 9.4.14 postgres
Calling AWS CLI with 9.4.9 9.4.14 postgres
Calling AWS CLI with 9.4.7 9.4.14 postgres
Calling AWS CLI with 9.3.25 9.4.14 postgres
Calling AWS CLI with 9.3.24 9.4.14 postgres
Calling AWS CLI with 9.3.23 9.4.14 postgres
Calling AWS CLI with 9.3.22 9.4.14 postgres
Calling AWS CLI with 9.3.20 9.4.14 postgres
Calling AWS CLI with 9.3.19 9.4.14 postgres
Calling AWS CLI with 9.3.17 9.4.14 postgres
Calling AWS CLI with 9.3.16 9.4.14 postgres
Calling AWS CLI with 9.3.14 9.4.14 postgres

Upgrade Steps / Hops: 1
 Path: ['9.3.12', '9.4.14']

=== High level of verbosity ===
>py getUpgradePath.py 9.4.11 9.4.12 postgres 1 5
Arg array: 9.4.11,9.4.12,postgres,1,5
argv length: 6
Arg 0: getUpgradePath.py
Arg 1: 9.4.11
Arg 2: 9.4.12
Arg 3: postgres
Arg 4: 1
Debug Level: 5
Engine: postgres
Calling AWS CLI with 9.4.11 x postgres
Calling AWS CLI with 9.4.12 y postgres
Source Version: 9.4.11
Target Version: 9.4.12
Cache: Combination not found: 9.4.11->9.4.12
Calling AWS CLI with 9.4.11 9.4.12 postgres
Skip upgrade check from newer to older version: 9.5.19 -> 9.4.12
Skip upgrade check from newer to older version: 9.5.18 -> 9.4.12
Skip upgrade check from newer to older version: 9.5.16 -> 9.4.12
Skip upgrade check from newer to older version: 9.5.15 -> 9.4.12
Skip upgrade check from newer to older version: 9.5.14 -> 9.4.12
Skip upgrade check from newer to older version: 9.5.13 -> 9.4.12
Skip upgrade check from newer to older version: 9.5.12 -> 9.4.12
Skip upgrade check from newer to older version: 9.5.10 -> 9.4.12
Skip upgrade check from newer to older version: 9.5.9 -> 9.4.12
Skip upgrade check from newer to older version: 9.5.7 -> 9.4.12
Skip upgrade check from newer to older version: 9.5.6 -> 9.4.12
Skip upgrade check from newer to older version: 9.4.24 -> 9.4.12
Skip upgrade check from newer to older version: 9.4.23 -> 9.4.12
Skip upgrade check from newer to older version: 9.4.21 -> 9.4.12
Skip upgrade check from newer to older version: 9.4.20 -> 9.4.12
Skip upgrade check from newer to older version: 9.4.19 -> 9.4.12
Skip upgrade check from newer to older version: 9.4.18 -> 9.4.12
Skip upgrade check from newer to older version: 9.4.17 -> 9.4.12
Skip upgrade check from newer to older version: 9.4.15 -> 9.4.12
Skip upgrade check from newer to older version: 9.4.14 -> 9.4.12
Valid targets: 9.4.12
Cache: (9.4.11->{'9.4.12': 1})

Upgrade Steps / Hops: 1
 Path: ['9.4.11', '9.4.12']


=== Some notoriously difficult Upgrade paths to find ===
>py getUpgradePath.py 9.3.12 12.2 postgres
................
Upgrade path not found. May be you want to increase hop-count and try again.

# Increasing Hop Count to 2 didn't help
>py getUpgradePath.py 9.3.12 12.2 postgres 2
....................................................
Upgrade path not found. May be you want to increase hop-count and try again.

# Increasing Hop Count to 3 finally found a solution
>py getUpgradePath.py 9.3.12 12.2 postgres 3
..................................................................
..................................................................
..................................................................
...
Upgrade Steps / Hops: 3
 Path: ['9.3.12', '9.4.25', '11.6', '12.2']
 Path: ['9.3.12', '9.4.24', '11.5', '12.2']
 Path: ['9.3.12', '9.4.23', '11.4', '12.2']
 Path: ['9.3.12', '9.4.21', '11.2', '12.2']
 Path: ['9.3.12', '9.4.20', '11.1', '12.2']
 ^^ 5 upgrade paths found

About

Python script to find all possible Upgrade paths (from one Version to another) for AWS RDS Database Engines

Resources

Readme

License

GPL-3.0 license
Activity

Stars

5 stars

Watchers

4 watching

Forks

0 forks
Report repository

Releases 5

eliamma Latest
Mar 31, 2020
+ 4 releases

Packages

No packages published

Languages