Skip to content

Data Requirements

Eriel Cabrera edited this page Jul 14, 2026 · 2 revisions

Data Requirements

Users must create a Data folder inside the progress directory with the subfolders System, Solar, and Wind to store system, solar, and wind data, respectively. These subfolders must contain the following data files in the directory structure shown below:

  • progress/
    • Data/
      • System/
        • branch.csv
        • bus.csv
        • gen.csv
        • load.csv
        • storage.csv
        • data_center_load (if DC load exists in the system)/
          • profile_*.csv
      • Solar (if solar exists in system)/
        • solar_sites.csv
        • gen_all_sites.csv (if solar power generation data is user provided)
        • solar_probs.csv (generated by clustering, not user-provided)
        • Clusters (generated by clustering, not user-provided)
      • Wind (if wind exists in system)/
        • w_power_curves.csv
        • wind_sites.csv
        • windspeed_data.csv (if wind speed data is user provided)
        • t_rate.xlsx (generated from wind-speed data, not user-provided)

The file names should be kept exactly the same as shown above. The column names inside each .csv file should also be left unchanged. File templates with data from the RTS-GMLC system are provided here: Data. A detailed description of the .csv files along with the column names is provided as follows:

System

branch.csv

Column Description
Branch ID Unique branch ID
From Bus From Bus ID
To Bus To Bus ID
R Branch resistance p.u.
X Branch reactance p.u.
B Branch line charging susceptance p.u.
Rating Power transfer capacity
MTTR Mean Time to Repair
MTTF Mean Time to Failure
Tran OutRate Outage rates of transmission lines
Interzonal Y/N based on whether the line connects multiple zones/regions

bus.csv

Column Description
Bus Name Bus/Zone name
Bus No. Numeric bus ID
Zone Zone in which bus is located

gen.csv

Column Description
Gen No. Numeric gen ID
Gen Name Generator name
Bus No. Connection bus/zone number
Zone Zone in which gen is located
Type Technology Type
Fuel Fuel Type
Max Cap Maximum capacity of unit
Min Cap Minimum capacity of unit
FOR Forced Outage Rate
MTTR Mean Time to Repair
MTTF Mean Time to Failure
Cost Cost of generation

Additional data will be required for PCM runs. Please check Additional Features documentation.

load.csv

Column Description
datetime mm/dd/yy hh:mm
Bus_1 Load in bus1
Bus_2 Load in bus2
... Keep adding columns for all buses

Replace Bus_1, Bus_2, ... with the actual bus names for your system. This should match the bus names in bus.csv.

storage.csv

Column Description
Name Name of storage unit
Bus No. Bus No. to which it is connected
Zone Zone to which it is connected
Pmax Maximum power rating
Pmin Minimum power rating
Duration Duration in hours
max_SOC Maximum allowed state-of-charge (0 to 1)
min_SOC Minimum allowed state-of-charge (0 to 1)
Efficiency Efficiency (0 to 1)
Discharge Cost Cost of discharge
Charge Cost Cost of charge
Units No. of subunits in the ESS
MTTR Mean Time to Repair
MTTF Mean Time to Failure
Chemistry Chemistry of BESS

profile_n.csv in data_center_load directory (optional)

Column Description
time date time in YYYY-MM-DD HH:MM:SS format
Bus_1 hourly peak load values from data center in bus 1 in MW
Bus_2 hourly peak load values from data center in bus 2 in MW
... Keep adding columns for all data centers

Replace Bus_1, Bus_2, ... with the actual bus names for your system. This should match the bus names in bus.csv.

Solar

solar_sites.csv

Column Description
Site Name Name of the solar site
Latitude latitude of the site
Longitude longitude of the site
MW_Capacity Maximum generating capacity of the plant in MW
Tracking Single/Dual axis tracking (1 or 2)
Bus No. Bus No. to which it is connected
Zone Bus/zone in which site is located

gen_all_sites.csv (if solar power generation data is user provided)

Column Description
time date time in YYYY-MM-DD HH:MM:SS format
site_1 hourly generation values from site_1 in MW
site_2 hourly generation values from site_2 in MW
... Keep adding columns for all solar sites

Replace site_1, site_2, ... with the actual site names for your system. This should match the site names in solar_sites.csv.

Wind

wind_sites.csv

Column Description
Site Name Name of wind farm
Bus No. Bus No. to which it is connected
Zone Zone in which wind farm is located
MW_Capacity Maximum generating capacity of the plant in MW
Power Class Wind power class
Latitude Latitude of the site
Longitude Longitude of the site
Hub Height Height of wind turbines
Turbine Rating Rating of wind turbines in MW

w_power_curves.csv

Column Description
Start (m/s) Starting wind speed for this class in (m/s)
End (m/s) Ending wind speed for this class in (m/s)
Class 1 Conversion ratio from speed to power for Class 1
Class 2 Conversion ratio from speed to power for Class 2
... Users can add as many wind classes as they want

windspeed_data.csv (if wind speed data is user provided)

Column Description
datetime date time in YYYY-MM-DD HH:MM format
site_1 hourly wind speed values for site_1 in m/s
site_2 hourly wind speed values for site_1 in m/s
... Keep adding columns for all wind sites

Replace site_1, site_2, ... with the actual site names for your system. This should match the site names in wind_sites.csv.


Back to Home | Next: Workflow