Develop into Master

[ahurli]

Merging Develop into Master, which will be tagged with a new release. See below for the release notes.

Closed Issues:

• Allow user to specify more parameters for energy storage (Allow user to specify more parameters for energy storage #380)
• Execute.launch_simulation does not check current ExecuteList status (Execute.launch_simulation does not check current ExecuteList status #377)
• Report investment costs disaggregated by zone (Report investment costs disaggregated by zone #368)
• Improve flexibility of simulation engine input preparation process (Improve flexibility of simulation engine input preparation process #364)
• Specify grid model in building phase of a scenario (Specify grid model in building phase of a scenario #351)
• Load and transform US normalized profiles (Load and transform US normalized profiles #350)
• Switch to newly constructed USA profiles (Switch to newly constructed USA profiles #349)
• Normalize hydro, solar and wind profiles (Normalize hydro, solar and wind profiles #347)
• Identify relevant profiles (Identify relevant profiles #346)
• Delete outdated/bugged scenarios (Delete outdated/bugged scenarios #345)
• Grid model selection (Grid model selection #344)
• Add one-way DC line (Add one-way DC line #342)
• Add bus via change table (Add bus via change table #341)
• Renewable generators cost curves (Renewable generators cost curves #332)
• Transmission "traffic map" web compatibility improvements (Transmission "traffic map" web compatibility improvements #307)
• Remove redundant id2type and type2id dictionaries from Grid (Remove redundant id2type and type2id dictionaries from Grid #288)
• Error If ScenarioData folder does not exists on local (Error If ScenarioData folder does not exists on local  #272)
• Build data access layer for scenario and execute list using sql db (Build data access layer for scenario and execute list using sql db #270)
• Create module enclosing historical data (Create module enclosing historical data #268)
• Create module enclosing generators constants (Create module enclosing generators constants #265)
• Rename module (Rename module #263)
• Organize TAMU network constants (Organize TAMU network constants #262)
• Base grid should not be used when scaling profile (Base grid should not be used when scaling profile #260)
• Pmax of closest neighbor in TransformProfile (Pmax of closest neighbor in TransformProfile  #259)
• Improve test cobverage of TransformProfile class (Improve test cobverage of TransformProfile class #254)
• Access profiles in the create state (Access profiles in the create state #248)
• If a base profile is interrupted during download, it will be used to prepare an incomplete profile (If a base profile is interrupted during download, it will be used to prepare an incomplete profile #246)
• Reorganize package (Reorganize package #244)
• Handle the error if the script failed to change 'ScenarioList.csv' or 'ExecuteList.csv' (Handle the error if the script failed to change 'ScenarioList.csv' or 'ExecuteList.csv' #241)
• Change paths to data folders and model (Change paths to data folders and model #234)
• Use ralative path to base profiles in tmp folder (Use ralative path to base profiles in tmp folder #230)
• Allow interaction with locally-cached scenario data files via locally-cached ScenarioList (Allow interaction with locally-cached scenario data files via locally-cached ScenarioList #228)
• Set REISE.jl as the default engine (Set REISE.jl as the default engine #226)
• loadzone2state in powersimdata.utility.constants doesn't contain Western/Texas zones (loadzone2state in powersimdata.utility.constants doesn't contain Western/Texas zones #225)
• pandas deprecation warning (pandas deprecation warning #224)
• Web compatibility of bokeh maps (Web compatibility of bokeh maps #218)
• Added HVDC and AC lines hav wrong index (Added HVDC and AC lines hav wrong index #215)
• Enable loading of scenarios located in RE-Storage (Enable loading of scenarios located in RE-Storage #214)
• Create a move state in the scenario framework (Create a move state in the scenario framework #213)
• Get rid of symbolic link to profile (Get rid of symbolic link to profile #212)
• Implement communication between zeus and RE-Storage (Implement communication between zeus and RE-Storage #211)
• Update README (Update README #202)
• Set up automated linting (Set up automated linting  #198)
• Streamline the capacity scaling process (Streamline the capacity scaling process #195)
• Get grid in the create and execute states (Get grid in the create and execute states #190)
• Create TransformGrid and ScaleProfile Class (Create TransformGrid and ScaleProfile Class #189)
• Refactor Scaler Class (Refactor Scaler Class #188)
• Running tests now creates a diff due to saved capacity scaling demo (Running tests now creates a diff due to saved capacity scaling demo #185)
• Grid fields cannot be modified with conventional syntax (Grid fields cannot be modified with conventional syntax #178)
• New AC branches are not added to the branch data frame (New AC branches are not added to the branch data frame #176)
• Add get_load_shed method to Analyze (Add get_load_shed method to Analyze #175)
• Modify Collaborative strategy so that states without goals do not participate (Modify Collaborative strategy so that states without goals do not participate #171)
• Profiles are not returned properly for a scenario with fewer solar/wind plants (Profiles are not returned properly for a scenario with fewer solar/wind plants #169)
• Add filtering of lines available for mesh branch upgrade design (Add filtering of lines available for mesh branch upgrade design #168)
• Add ability to add new AC branches via a change table (Add ability to add new AC branches via a change table #154)
• Add ability to add new plants to a Grid via a change table (Add ability to add new plants to a Grid via a change table #153)
• Add ability to modify cost curves via change table (Add ability to modify cost curves via change table #142)
• Add step to select engine when creating a scenario (Add step to select engine when creating a scenario #139)
• Use call and extract_data modules in REISE (Use call and extract_data modules in REISE #133)
• Create design folder; move into it capacity planning, design transmission, and scenario info (Create design folder; move into it capacity planning, design transmission, and scenario info #138)
• Capacity Planning: add direct output of change table (Capacity Planning: add direct output of change table #127)
• Add ability to prioritize which mesh branches to upgrade when designing Scenarios (Add ability to prioritize which mesh branches to upgrade when designing Scenarios #116)
• Ability to add new HVDC lines to Scenario object in Create state (Ability to add new HVDC lines to Scenario object in Create state #114)
• Refactor grid scaling: create grid field object (Refactor grid scaling: create grid field object #112)
• Refactor Scaling Procedure (Refactor Scaling Procedure #111)
• Delete properly scenario in Execute List (Delete properly scenario in Execute List #107)
• Tests of capacity scaling fail (Tests of capacity scaling fail #96)
• Implement ScenarioInfo Object (Implement ScenarioInfo Object #93)
• cost planning (cost planning #91)
• Remove Seaborn as a dependency (Remove Seaborn as a dependency #87)
• Write Reader for MATLAB File (Write Reader for MATLAB File #86)
• Specify Grid Model in Scenario List (Specify Grid Model in Scenario List #84)
• Grid Building (Grid Building #83)
• IVU Speaker Series Presentation: Development of materials and coordination (IVU Speaker Series Presentation: Development of materials and coordination #81)
• Enable USA (Enable USA #77)
• File Deletion in Local Directory (File Deletion in Local Directory #64)
• Get Data Frame of PF on DC Line (Get Data Frame of PF on DC Line #62)
• Modify REISE scenario code to resume scenario run (Modify REISE scenario code to resume scenario run #205)
• Storage setup without request (Storage setup without request  #60)
• Eastern Interconnection (Eastern Interconnection #56)
• Path of lockfile (Path of lockfile #54)
• congestion analysis and mapping (congestion analysis and mapping #45)
• solar curtailment Utah and Colorado - base case investigation (solar curtailment Utah and Colorado - base case investigation #44)
• interactive mapping tool - bus connections feature add (interactive mapping tool - bus connections feature add #38)
• Enable Texas in Scenario object (Enable Texas in Scenario object #37)
• Enable Texas+Western in Scenario object (Enable Texas+Western in Scenario object #36)
• On a Windows machine, Scenarios can be created but simulations can't be launched (On a Windows machine, Scenarios can be created but simulations can't be launched #34)
• Index shoud be key not i (Index shoud be key not i #30)
• Scaled profile are note deleted after being uploaded to server (Scaled profile are note deleted after being uploaded to server #27)
• Map aux file to mpc file (Map aux file to mpc file #25)
• Explicitly name the fields that go into the MPC struct (Explicitly name the fields that go into the MPC struct #24)
• Make the data manipulation sections of the code more functional (Make the data manipulation sections of the code more functional #21)
• Instances of the state object are dynamically changed between inherited types (Instances of the state object are dynamically changed between inherited types #20)
• Have a separate file for each class (Have a separate file for each class #19)
• Test Scenario Object (Test Scenario Object  #17)
• WECC Congestion Analysis General Function Development (WECC Congestion Analysis General Function Development #11)
• Tutorial for Scenario Object (Tutorial for Scenario Object #7)
• Transfer California input and output files to new data structure (Transfer California input and output files to new data structure #6)
• Paramiko 2.4.2 does not support some types of ssh-keys. (Paramiko 2.4.2 does not support some types of ssh-keys. #204)
• Modify Synthetic Grid (Modify Synthetic Grid #5)
• Change Table (Change Table #4)
• Workflow Version 2 (Workflow Version 2 #3)
• Data Storage on Server (Data Storage on Server #2)
• Create Scenario class. (Create Scenario class. #1)

Merged pull requests (features):

• Enable grid model selection (Enable grid model selection #414) (@rouille)
• feat: add optional solver parameter to launch_simulation (feat: add optional solver parameter to launch_simulation #404) (@jon-hagg)
• feat: add temporal curtailment calculation (feat: add temporal curtailment calculation #401) (@danielolsen)
• feat: add with syntax to PrintManager (feat: add with syntax to PrintManager #390) (@danielolsen)
• feat: add method to check progress of ongoing simulation (feat: add method to check progress of ongoing simulation #387) (@jon-hagg)
• feat: let user specify more parameters for storage (feat: let user specify more parameters for storage #383) (@danielolsen)
• feat: add storage_pg entry to MockAnalyze (feat: add storage_pg entry to MockAnalyze #381) (@BainanXia)
• DataAccess implementation for shared volume architecture (DataAccess implementation for shared volume architecture #376) (@jon-hagg)
• Add method to retrieve scenario table (Add method to retrieve scenario table #373) (@rouille)
• Client code to launch simulation in container (Client code to launch simulation in container #369) (@jon-hagg)
• update color and label dictionaries to include default values for curtailments (update color and label dictionaries to include default values for curtailments #366) (@BainanXia)
• Update parameters of connection to server (Update parameters of connection to server #356) (@dmuldrew)
• Add ability to add DC lines with different Pmin and Pmax (Add ability to add DC lines with different Pmin and Pmax #355) (@danielolsen)
• Ability to add buses to the grid via the Change Table (Ability to add buses to the grid via the Change Table #352) (@danielolsen)
• Improve clearing of Change Table entries (Improve clearing of Change Table entries #348) (@danielolsen)
• Create mapping between load zone IDs and time zones (Create mapping between load zone IDs and time zones #339) (@lanesmith218)
• lazy ssh connection (lazy ssh connection #334) (@jon-hagg)
• Add ability to scale generator Pmin via ChangeTable (Add ability to scale generator Pmin via ChangeTable #333) (@danielolsen)
• Create an abstraction for the SSH connection to the data store (Create an abstraction for the SSH connection to the data store #330) (@danielolsen)
• Update call to engine (Update call to engine #324) (@ahurli)
• Improve Grid and Scenario init flexibility (Improve Grid and Scenario init flexibility #323) (@danielolsen)
• Add ability to scale gencost from change table (Add ability to scale gencost from change table #322) (@danielolsen)
• Allow user to specify that profiles are the same as a previous scenario (Allow user to specify that profiles are the same as a previous scenario #313) (@danielolsen)
• Add get_bus_demand method (Add get_bus_demand method #311) (@danielolsen)
• Enable optional requirements (Enable optional requirements #310) (@danielolsen)
• Dockerfile for powersimdata (Dockerfile for powersimdata #308) (@jon-hagg)
• Add simple cache for grid object (Add simple cache for grid object #305) (@jon-hagg)
• Supply and Cost Curve Visualizations (Supply and Cost Curve Visualizations #299) (@lanesmith218)
• Investment costs (Investment costs #297) (@nina-vincent)
• interconnect to time zone (interconnect to time zone #295) (@rouille)
• When creating a MockAnalyze, ensure dataframe indices are time series (When creating a MockAnalyze, ensure dataframe indices are time series #294) (@danielolsen)
• Within capacity scaling, detect zones collisions and add ability to specify target area type (Within capacity scaling, detect zones collisions and add ability to specify target area type #284) (@danielolsen)
• Add dictionaries to zones module (Add dictionaries to zones module #281) (@rouille)
• create schema in container automatically (create schema in container automatically #275) (@jon-hagg)
• Add constants to plant module (Add constants to plant module #273) (@rouille)
• Database layer for scenario and execute list (Database layer for scenario and execute list #266) (@jon-hagg)
• Locally cache execute list (Locally cache execute list #257) (@jon-hagg)
• Enable local caching of scenario list (Enable local caching of scenario list #252) (@jon-hagg)
• refactor: conduct capacity scaling via dataframes (refactor: conduct capacity scaling via dataframes #250) (@danielolsen)
• Access profiles in the create state (Access profiles in the create state #249) (@rouille)
• feat: centralize execute list access (feat: centralize execute list access #247) (@jon-hagg)
• fix loadzone2state, add loadzone2interconnect (fix loadzone2state, add loadzone2interconnect #242) (@danielolsen)
• chore: type-checking and documentation for threads selection (chore: type-checking and documentation for threads selection #239) (@danielolsen)
• feat: remove potential whitespace in username (feat: remove potential whitespace in username #238) (@jon-hagg)
• feat: specify number of threads to use to run simulation (feat: specify number of threads to use to run simulation #237) (@danielolsen)
• feat: add get_server_user function (feat: add get_server_user function #236) (@danielolsen)
• feat: set REISE.jl as default engine (Set REISE.jl as the default engine #226) (feat: set REISE.jl as default engine (#226) #229) (@rouille)
• Read from backup (Read from backup #222) (@rouille)
• Write Move class (Write Move class #221) (@rouille)
• Extend mappings to include usa and texas western (Extend mappings to include usa and texas western #208) (@jon-hagg)
• feat: redirect output stream to os.devnull via parameters of Popen (feat: redirect output stream to os.devnull via parameters of Popen #203) (@BainanXia)
• Filter mesh branch upgrades (Filter mesh branch upgrades #196) (@danielolsen)
• Add generators via change table (Add generators via change table #194) (@rouille)
• feat: enable get_load_shed from Analyze (feat: enable get_load_shed from Analyze #193) (@danielolsen)
• Refactor Scaler Class (Refactor Scaler Class #186) (@rouille)
• feat: create change table to mimic existing grid when scaling new grid (feat: create change table to mimic existing grid when scaling new grid #174) (@danielolsen)
• Add acline via ct (Add acline via ct #173) (@rouille)
• Update collaborative strategy: ignore states without goals (Update collaborative strategy: ignore states without goals #172) (@danielolsen)
• Add dcline through change table (Add dcline through change table #166) (@rouille)
• Set collab solar fraction (Set collab solar fraction #164) (@danielolsen)
• feat: scale hydro stub branches (feat: scale hydro stub branches #163) (@danielolsen)
• feat: add capability to scale offshore wind (feat: add capability to scale offshore wind #159) (@danielolsen)
• feat: add requirements_freeze.txt file to help lock down a working environment (feat: add requirements_freeze.txt file to help lock down a working environment #155) (@dmuldrew)
• feat: test for Grid equality (feat: test for Grid equality #152) (@danielolsen)
• feat: add REISEjlMATReader to interpret input.mat from REISE.jl (feat: add REISEjlMATReader to interpret input.mat from REISE.jl #150) (@danielolsen)
• Grid Scaling: hierarchical grid field class (Grid Scaling: hierarchical grid field class #149) (@dmuldrew)
• Add step to set simulation engine when creating a scenario (Add step to set simulation engine when creating a scenario #141) (@rouille)
• Grid field (Grid field #137) (@dmuldrew)
• Collaborative addl curtailment rebased (Collaborative addl curtailment rebased #136) (@dmuldrew)
• Get averaged congestion via the Scenario object (Get averaged congestion via the Scenario object #123) (@rouille)
• Getter grid (Getter grid #121) (@dmuldrew)
• feat: mesh branch upgrade priorities (feat: mesh branch upgrade priorities #120) (@danielolsen)
• feat: adds Resource Manager to integrate existing notebook code (feat: adds Resource Manager to integrate existing notebook code #119) (@dmuldrew)
• Set additional curtailment function within capacity framework (Set additional curtailment function within capacity framework #117) (@dmuldrew)
• feat: add info attribute to ScenarioInfo class (feat: add info attribute to ScenarioInfo class #113) (@BainanXia)
• Capacity planning resource manager (Capacity planning resource manager #109) (@dmuldrew)
• Write MATReader object (Write MATReader object #98) (@rouille)
• feat: add_zone2_to_mock_grid (feat: add_zone2_to_mock_grid #95) (@BainanXia)
• Create ScenarioInfo class (Create ScenarioInfo class #94) (@BainanXia)
• feat: Scale mesh branches (feat: Scale mesh branches #89) (@danielolsen)
• feat: capacity scaling framework (feat: capacity scaling framework #88) (@dmuldrew)
• Create grid object from different sources (Create grid object from different sources #85) (@rouille)
• feat: add module to 'design' scenarios, starting with renewable stub scaling (feat: add module to 'design' scenarios, starting with renewable stub scaling #80) (@danielolsen)
• Enable USA scenario (Enable USA scenario #79) (@rouille)
• feat: support for 'biomass' and 'other' generators (feat: support for 'biomass' and 'other' generators #71) (@danielolsen)
• Get power flow on dcline (Get power flow on dcline #63) (@rouille)
• Add storage (Add storage #59) (@rouille)
• feat: Enable Eastern interconnection (feat: Enable Eastern interconnection #57) (@rouille)
• feat: Add dcline id to case file (data: dc lines within western interconnection #23) (feat: Add dcline id to case file (#23) #53) (@rouille)
• Enable Texas scenario (Enable Texas scenario #41) (@rouille)
• Update usa_tamu files (Update usa_tamu files #40) (@BainanXia)
• feat: add fuel cost and heat-rate curve to grid object (feat: add fuel cost and heat-rate curve to grid object #29) (@ghost)
• feat: ability to add storage in change table (feat: ability to add storage in change table #26) (@ghost)
• Create Scenario class (Create Scenario class #12) (@rouille)

Merged pull requests (fixes, etc.):

• fix: correct bug with carried-over gencosts for new plants (fix: correct bug with carried-over gencosts for new plants #407) (@danielolsen)
• refactor: move generation of matfile to separate function (refactor: move generation of matfile to separate function #406) (@danielolsen)
• ci: use pre defined action to trigger workflow (ci: use pre defined action to trigger workflow #402) (@jon-hagg)
• Upgrade numpy/scipy (Upgrade numpy/scipy #400) (@jon-hagg)
• Update link in PR template (Update link in PR template #399) (@rouille)
• chore: update package version number (chore: update package version number #397) (@kasparm)
• chore: update email in datapackage.json (chore: update email in datapackage.json #396) (@danielolsen)
• docs: add link to installation and contribution guide (docs: add link to installation and contribution guide #395) (@kasparm)
• data: set Pmin for solar and wind gens to 0 (data: set Pmin for solar and wind gens to 0 #394) (@danielolsen)
• chore(deps): bump cryptography from 3.3.1 to 3.3.2 (chore(deps): bump cryptography from 3.3.1 to 3.3.2 #393) (@dependabot[bot])
• fix: calculate investment cost for nuclear generators (fix: calculate investment cost for nuclear generators #391) (@danielolsen)
• ci: use black profile for isort (ci: use black profile for isort #389) (@jon-hagg)
• refactor: remove redundant function for getting bus demand (refactor: remove redundant function for getting bus demand #388) (@danielolsen)
• doc: update investment cost README for current calculations (doc: update investment cost README for current calculations #385) (@danielolsen)
• fix: correct bug with repeated substation in TransformGrid._add_bus (fix: correct bug with repeated substation in TransformGrid._add_bus #384) (@danielolsen)
• Set keyword value (Set keyword value #379) (@rouille)
• Update scenario status (Update scenario status #378) (@rouille)
• fix: change caught Exception for get_load_shed (fix: change caught Exception for get_load_shed #375) (@danielolsen)
• test: remove index column from test assertion (test: remove index column from test assertion #374) (@jon-hagg)
• doc: fix docstring reference to new DataAccess location (doc: fix docstring reference to new DataAccess location #372) (@danielolsen)
• fix: get newer pipenv and fix installation in docker (fix: get newer pipenv and fix installation in docker #371) (@jon-hagg)
• fix: add requests to setup.py (fix: add requests to setup.py #370) (@jon-hagg)
• Move data access classes to eponymous package (Move data access classes to eponymous package #367) (@jon-hagg)
• Remove reference to deleted constant and slight pandas refactor (Remove reference to deleted constant and slight pandas refactor #365) (@jon-hagg)
• Fix MATReader when loading one Storage and/or zero DC-lines (Fix MATReader when loading one Storage and/or zero DC-lines #363) (@danielolsen)
• Grid equality bugfix (storage) and print improvement (Grid equality bugfix (storage) and print improvement #362) (@danielolsen)
• fix: correct type of new bus index in Grid.bus2sub (fix: correct type of new bus index in Grid.bus2sub #361) (@danielolsen)
• refactor: use Docker CMD for easier overrides (refactor: use Docker CMD for easier overrides #360) (@dmuldrew)
• Fix delete functionality (Fix delete functionality #359) (@jon-hagg)
• Change flock command argument (Change flock command argument #358) (@dmuldrew)
• Use up to date Western scenario in README (Use up to date Western scenario in README #357) (@rouille)
• Add license (Add license #354) (@rouille)
• Create data intake template (Create data intake template #353) (@rouille)
• Update links in README (Update links in README #343) (@rouille)
• Use relative paths and mirror server file structure locally (Use relative paths and mirror server file structure locally #340) (@jon-hagg)
• fix: scenario state cannot load data (fix: scenario state cannot load data #338) (@merrielle)
• Make test more robust (Make test more robust #335) (@jon-hagg)
• Add terms and conditions to ATTRIBUTION file (Add terms and conditions to ATTRIBUTION file #329) (@rouille)
• Improve README (Improve README #328) (@rouille)
• Clean notebooks (Clean notebooks #327) (@rouille)
• ci: add flake8 and fix warnings (ci: add flake8 and fix warnings #326) (@jon-hagg)
• fix: typo in delete_entry (fix: typo in delete_entry #325) (@danielolsen)
• doc: update zenodo reference to permalink (doc: update zenodo reference to permalink #321) (@danielolsen)
• Add PR template (Add PR template #320) (@jon-hagg)
• Attribution file (Attribution file #319) (@rouille)
• Fix docstring (Fix docstring #318) (@rouille)
• Fix typos in Allow user to specify that profiles are the same as a previous scenario #313 (Fix typos in #313 #317) (@danielolsen)
• Remove dependency on geopy (Remove dependency on geopy #316) (@danielolsen)
• fix: typo in tox.ini (fix: typo in tox.ini #315) (@jon-hagg)
• Remove unused imports/depenencies (Remove unused imports/depenencies #314) (@danielolsen)
• fix: improve error message for truncated file download (fix: improve error message for truncated file download #309) (@danielolsen)
• chore: refactor ci and test against multiple python versions (chore: refactor ci and test against multiple python versions #303) (@jon-hagg)
• Ben/zones (Ben/zones #302) (@rouille)
• Trigger docs build (Trigger docs build #296) (@jon-hagg)
• data: add nox and so2 emissions rates (data: add nox and so2 emissions rates #293) (@danielolsen)
• refactor: remove unused id2type and type2id (refactor: remove unused id2type and type2id #292) (@danielolsen)
• refactor: add mwmiles calculations to design.transmission module (refactor: add mwmiles calculations to design.transmission module #291) (@danielolsen)
• Update pandas (Update pandas #290) (@jon-hagg)
• Combine ci workflows with tox (Combine ci workflows with tox #289) (@jon-hagg)
• Update README (Update README #287) (@rouille)
• Fix warnings from sphinx build (Fix warnings from sphinx build #286) (@jon-hagg)
• intvenlab -> Breakthrough-Energy (intvenlab -> Breakthrough-Energy #285) (@jon-hagg)
• Define db and ssh test markers and run db tests in ci pipeline (Define db and ssh test markers and run db tests in ci pipeline #279) (@jon-hagg)
• fix: update paramiko and create local directory if needed (fix: update paramiko and create local directory if needed #278) (@jon-hagg)
• Run latest formatting to fix CI (Run latest formatting to fix CI #277) (@jon-hagg)
• Remove previous capacity scaling framework (Remove previous capacity scaling framework #276) (@danielolsen)
• chore: add psycopg2 to setup.py (chore: add psycopg2 to setup.py #274) (@jon-hagg)
• Create module enclosing generators constants (Create module enclosing generators constants #267) (@rouille)
• Rename module (Rename module #264) (@rouille)
• Use transformed grid in scaling procedure (Use transformed grid in scaling procedure #261) (@rouille)
• Update init file (Update __init__ file #258) (@rouille)
• Improve test coverage of TransformProfile class (Improve test coverage of TransformProfile class #253) (@rouille)
• Fix bugs in TransformProfile class (Fix bugs in TransformProfile class #251) (@danielolsen)
• Move data and modules around (Move data and modules around #245) (@rouille)
• Consolidate scenario list access to go through one class (Consolidate scenario list access to go through one class #240) (@jon-hagg)
• Change paths to data folders and model (Change paths to data folders and model #235) (@rouille)
• Redo PR after fixing develop (Redo PR after fixing develop #233) (@jon-hagg)
• pandas deprecation warning (pandas deprecation warning #232) (@rouille)
• switch to relative path (switch to relative path #231) (@rouille)
• Mock scenario info and some code cleanup (Mock scenario info and some code cleanup #227) (@jon-hagg)
• Package update/consolidation (Package update/consolidation #223) (@jon-hagg)
• Add pipfile and update packages (Add pipfile and update packages #220) (@jon-hagg)
• Use base profile directly (Use base profile directly  #217) (@rouille)
• Fix indexing of added HVDC and AC lines (Fix indexing of added HVDC and AC lines #216) (@rouille)
• Specify installation dependencies for consumers (Specify installation dependencies for consumers #210) (@jon-hagg)
• Rewrite sections 1 and 2 of README (Rewrite sections 1 and 2 of README #209) (@rouille)
• Run black on the code and add ci check (Run black on the code and add ci check #207) (@jon-hagg)
• data: align GenFuelCost to gencost (c1, c2) (data: align GenFuelCost to gencost (c1, c2) #206) (@danielolsen)
• Run pytest in github action (Run pytest in github action #201) (@jon-hagg)
• fix: allow small negative value for prev_curtailment (fix: allow small negative value for prev_curtailment #197) (@danielolsen)
• Set capacities of unused HVDC lines to zero (Set capacities of unused HVDC lines to zero #192) (@rouille)
• refactor: clean up after capacity scaling tests (refactor: clean up after capacity scaling tests #191) (@danielolsen)
• data: Generation update Western & Texas since 2016 (data: Generation update Western & Texas since 2016 #187) (@danielolsen)
• refactor: historical clean energy is additional, not reference (refactor: historical clean energy is additional, not reference #184) (@danielolsen)
• test: create tests for grid equality (test: create tests for grid equality #183) (@danielolsen)
• refactor: remove grid fields dependency from develop (refactor: remove grid fields dependency from develop #182) (@dmuldrew)
• fix: allow small tolerance on capacity factors (fix: allow small tolerance on capacity factors #181) (@danielolsen)
• data: update hvdc and cost curve according to real values (data: update hvdc and cost curve according to real values #180) (@BainanXia)
• Fix getter grid setattr (Fix getter grid setattr #179) (@danielolsen)
• Append new branches to branch data frame of Grid object (Append new branches to branch data frame of Grid object #177) (@rouille)
• fix: populate optional area_type to all related functions (fix: populate optional area_type to all related functions #170) (@BainanXia)
• data: revert Pmax changes to hydro, update branch instead (data: revert Pmax changes to hydro, update branch instead #167) (@danielolsen)
• data: update hydro Pmax to reflect latest profile max (data: update hydro Pmax to reflect latest profile max #162) (@danielolsen)
• chore: enable selection of REISE.jl engine (chore: enable selection of REISE.jl engine #161) (@danielolsen)
• data: add offshore wind to grid (data: add offshore wind to grid #160) (@danielolsen)
• fix: change unexpected modifications in Western and Texas back (fix: change unexpected modifications in Western and Texas back #158) (@BainanXia)
• Move modules (Move modules #156) (@rouille)
• Fix: avoid entries in Grid fields entries being shared between instances (Fix: avoid entries in Grid fields entries being shared between instances #151) (@danielolsen)
• refactor: set up flexibility for multiple versions of MATReader (refactor: set up flexibility for multiple versions of MATReader #148) (@danielolsen)
• Fix engine in test (Fix engine in test #146) (@rouille)
• refactor: remove seaborn as a dependency (refactor: remove seaborn as a dependency #145) (@danielolsen)
• data: update ramp_30 to match what is sent to the solver (data: update ramp_30 to match what is sent to the solver #144) (@danielolsen)
• chore: remove unused CollaborativeStrategyManager method (chore: remove unused CollaborativeStrategyManager method #140) (@danielolsen)
• Fix mesh bug existing ct (Fix mesh bug existing ct #135) (@danielolsen)
• Use call and extract_data modules from REISE (Use call and extract_data modules from REISE #134) (@rouille)
• refactor: reduce memory requirements for mesh branch scaling (refactor: reduce memory requirements for mesh branch scaling #132) (@danielolsen)
• Deepcopy fix (Deepcopy fix #131) (@dmuldrew)
• fix: incorporate collaborative scaling overgeneration (fix: incorporate collaborative scaling overgeneration #129) (@danielolsen)
• fix: avoid error when scaling from scenario with slightly negative generation (fix: avoid error when scaling from scenario with slightly negative generation #128) (@danielolsen)
• Move modules (Move modules #126) (@rouille)
• fix: enable MATReader to import single DC line from case.mat (fix: enable MATReader to import single DC line from case.mat #125) (@danielolsen)
• chore: create a design folder for capacity planning, design transmission, scenario info (chore: create a design folder for capacity planning, design transmission, scenario info #124) (@dmuldrew)
• Update import statement (Update import statement #122) (@rouille)
• data: Eastern generation update since 2016 (data: Eastern generation update since 2016 #118) (@danielolsen)
• data: Eastern generation update 2017-2020 (data: Eastern generation update 2017-2020 #115) (@danielolsen)
• data: upgrading transmission in North GA to relieve solar curtailment (data: upgrading transmission in North GA to relieve solar curtailment #110) (@danielolsen)
• fix: Delete correct scenario in ExecuteList file (fix: Delete correct scenario in ExecuteList file #108) (@rouille)
• fix: update area filter in area_to_loadzone function (fix: update area filter in area_to_loadzone function #106) (@BainanXia)
• refactor: more intermediate output columns and input validation (refactor: more intermediate output columns and input validation #105) (@dmuldrew)
• data: Eastern v41 data fixes (data: Eastern v41 data fixes #104) (@danielolsen)
• docs: add a cheatsheet demo notebook to see Scenario, Analyze, and Grid attributes and dataframe schemas (docs: add a cheatsheet demo notebook to see Scenario, Analyze, and Grid attributes and dataframe schemas #103) (@merrielle)
• chore: PEP 8 and file path tweaks (chore: PEP 8 and file path tweaks #102) (@dmuldrew)
• doc: documentation of features in design_transmission (doc: documentation of features in design_transmission #101) (@danielolsen)
• doc: adding datapackage.json for tabular data package (doc: adding datapackage.json for tabular data package #99) (@danielolsen)
• data: updates to Eastern data due to feasibility/sensibility testing (data: updates to Eastern data due to feasibility/sensibility testing #97) (@danielolsen)
• chore: add pycharm and os files to gitignore (chore: add pycharm and os files to gitignore #78) (@merrielle)
• data: adding solar and wind generators to eastern (data: adding solar and wind generators to eastern #76) (@danielolsen)
• data: improved eastern transmission feasibility for new hydro/solar/wind profiles (data: improved eastern transmission feasibility for new hydro/solar/wind profiles #75) (@danielolsen)
• data: upgrades to eastern transmission for base case feasibility (data: upgrades to eastern transmission for base case feasibility #74) (@danielolsen)
• data: feasibility fix for Western peak (data: feasibility fix for Western peak #73) (@danielolsen)
• data: adding generators of 'other' type to eastern (data: adding generators of 'other' type to eastern #72) (@danielolsen)
• docs: update pandas version in requirements (docs: update pandas version in requirements #70) (@merrielle)
• data: Intra-interconnection HVDC lines (data: Intra-interconnection HVDC lines #69) (@danielolsen)
• chore: add gitignore file (chore: add gitignore file #68) (@merrielle)
• fix: Correct bug related to scenario deletion (File Deletion in Local Directory #64) (fix: Correct bug related to scenario deletion (#64) #65) (@rouille)
• fix: avoid storage mat with empty change table (fix: avoid storage mat with empty change table #61) (@ghost)
• data: fix eastern dfo prices (and floating point cruft) (data: fix eastern dfo prices (and floating point cruft) #58) (@ghost)
• fix: Solve path of lockfile (Path of lockfile #54) (fix: Solve path of lockfile (#54) #55) (@rouille)
• Fix cost curve texas (Fix cost curve texas #52) (@BainanXia)
• fix: Scale Pmin of dc line. Same value than Pmax is used. (fix: Scale Pmin of dc line. Same value than Pmax is used. #51) (@rouille)
• fix: upgrading texas transmission network to avoid unrealistic load c… (fix: upgrading texas transmission network to avoid unrealistic load c… #50) (@ghost)
• data: western transmission upgrade to avoid unreasonable curtailment (data: western transmission upgrade to avoid unreasonable curtailment #49) (@ghost)
• data: change dcline pmin to negative of pmax (data: change dcline pmin to negative of pmax #48) (@ghost)
• fix: scale pmax for renewable gens (fix: scale pmax for renewable gens #47) (@ghost)
• fix: Relocate lockfile to enable rw by group (fix: Relocate lockfile to enable rw by group #46) (@rouille)
• Fix cost curve wecc for coal and ng (Fix cost curve wecc for coal and ng #43) (@BainanXia)
• fix: TAMU transformers (fix: TAMU transformers #39) (@BainanXia)
• fix: Sole issue On a Windows machine, Scenarios can be created but simulations can't be launched #34 for Windows users (fix: Sole issue #34 for Windows users #35) (@rouille)
• fix: relocating geothermal to avoid unrealistic congestion (fix: relocating geothermal to avoid unrealistic congestion #33) (@ghost)
• fix: use UNIX path (fix: use UNIX path #32) (@rouille)
• fix: Index shoud be key not i #30 Set index i to key (fix: #30 Set index i to key #31) (@kasparm)
• fix: Delete profile in local folder after upload to server (fix: Delete profile in local folder after upload to server #28) (@rouille)
• fix: when scaling gen Pmax, also scale Pmin and cost curve (fix: when scaling gen Pmax, also scale Pmin and cost curve #16) (@ghost)

[rouille]

Thanks. I think it would be nice to include the release notes in the description of the PR as @danielolsen did for REISE.jl

[danielolsen]

If the model branch is expected to get merged in the next day or two, should we try to get that into this release as well? That's a pretty major feature.

[rouille]

If the model branch is expected to get merged in the next day or two, should we try to get that into this release as well? That's a pretty major feature.

We probably do.

[rouille]

Looks very nice. Thanks! Would it be possible to add the last issues/PRs related to the grid model selection feature?

[ahurli]

Done! Added in the new PRs/Issues. Note that both are ordered by number and not date closed, so the new PRs and Issues are embedded accordingly.

[ahurli]

Per conversation with Ben, I updated the list so that PRs that were not merged are excluded. I also filtered the PR list such that if any commit in the PR was listed as a "feat:", the PR was categorized as a feature PR. I think this should have caught most of the PRs with names that don't have that descriptor, but also has some interesting consequence that PRs like #94 or #239, which are named 'fix:' and 'chore:', have feature commits and are thus categorized as such. In these cases, is there a strong feeling of where to put them?

[rouille]

I have changed the title of some PRs for clarity. You will have to rerun your scripts. i believe we will have to fix the following two entries manually:

• Collaborative addl curtailment (Collaborative addl curtailment #130) (@dmuldrew)
• Collaborative addl curtailment rebased (Collaborative addl curtailment rebased #136) (@dmuldrew)
  I would say that Collaborative addl curtailment #130 has been merged without rebasing. The HEAD of develop has then been reset and Collaborative addl curtailment rebased #136 has been merged. So we can drop Collaborative addl curtailment #130 in the notes and rename Collaborative addl curtailment rebased #136: Collaborative addl curtailment (#136) (@dmuldrew)

[rouille]

Looks great. Thanks!