Skip to content

@ritchiecarroll ritchiecarroll released this May 6, 2020 · 59 commits to master since this release

Official stable release of version 2.8 of the openPDC (v2.8.115).

NOTE: If you are upgrading from a prior version of the openPDC, you must migrate your existing configuration to use the latest database schema when the Configuration Setup Utility is run after the installation completes - this version includes schema updates.

Security Fixes

Security scans of older releases of the openPDC have identified two JavaScript library vulnerabilities included from the Grid Solutions Framework, specifically jQuery and knockout. Installation of version 2.8 of the openPDC resolves these reported issues through library updates.

For jQuery the vulnerability was CVE-2019-11358:

jQuery before 3.4.0, as used in Drupal, Backdrop CMS, and other products, mishandles jQuery.extend(true, {}, ...) because of Object.prototype pollution. If an unsanitized source object contained an enumerable proto property, it could extend the native Object.prototype.

Because of the way GPA uses jQuery within the openPDC, GPA deems the risk of this vulnerability to be low.

For knockout the vulnerability was WS-2019-0015:

Knockout, before 3.5.0-beta, has an XSS injection point in “attr” name binding for browser IE7 and older.

Exploitation of the knockout vulnerability required the use of IE7. Since the openHistorian requires IE11 or better to function, GPA deems the risk of this vulnerability to be low. However, GPA does suggest updating to a newer, more secure browser regardless.

New Updates and Improvements

  • Includes latest updates to STTP, including reverse connections
  • Added NGEN based pre-compile at install time to boost overall performance and improve application start times.
  • Improved functionality of point tag naming convention.
  • Updated point tag naming convention to include phasor type and phase information.
  • Added ability to disable self-web hosting
  • Disabled checking for CAS publisher policy for all application config files to speed start time.
  • Fixed various issues with web-based synchrophasor wizard
  • Updated synchrophasor wizard to allow for either disabled or deleted phasors with better visual feedback on selected options.
  • Updated synchrophasor device wizard to update baseKV for simple phasor updates.
  • Improved phase guess operation in device wizard.
  • Updated delete device operations in DataHub to also remove children devices before parent device.
  • Updated dev wizard screen to allow export of config regardless of editor rights.
  • Updated multi action adapter collection base implementation to allow for customized derived class connection string parsing.
  • Updated independent adapter managers to support input, output and action adapter collection types.
  • Updated to independent adapter manager samples to accommodate and end-user API.
  • Updates to independent adapter manager classes to handle multiple inputs per adapter from collection manager base classes.
  • Updated independent adapter managers to support grouped multiple inputs.
  • Updated independent adapter manager collections functionality.
  • Added configuration settings to control if eDNA and OSI-PI Grafana controllers are automatically loaded.
  • Added error handling to SQL Server role migration in Configuration Setup Utility.
  • Updated imported labels in device page to remove underscores with imported phasor labels
  • Updated long/lat layout / operation on device wizard (dev page)
  • Added initial options for connection string building with synchrophasor wizard screen
  • Added serialized configuration section to device wizard
  • Added ability to import and export config
  • Updated location meta-data function signatures
  • Cleared Sonar warnings and general code of newly added code.
  • Fixed access keys to be unique in custom installer dialogs
  • Applied custom action to installer to load previous company information.
  • Added flag for enabling web hosting to systemSettings when missing
  • Condensed PhasorHub initialization to web Startup.
  • Updated knockout bindings in COMTRADE importer to target first body element.
  • Updated GrafanAuthProxy to better handle initial startup user synchronization,
  • Added sub-title feature to primary Layout.cshtml
  • Cleaned up code for trend measurements and export data handler
  • Updated buttons on select group devices page to read "export/import" instead of "save/load" to better serve context.
  • Updated synchrophasor screen to accommodate application of calculation tags against devices setup with Gateway style connections.
  • Added Grafana EndPoint to get all device alarm statuses
  • Added Grafana Endpoint to get Device Groups
  • Fixed naming of QueryAlarms issue in GrafanaController
  • Updated device queries to only filter out device groups when both protocol is virtual and access ID is set
  • Updated service host to inject DeviceGroupMeasurements selection table into data source updates
  • Added extra safety checks for database to runtime ID conversion in data source propagation override in ServiceHost implementation.
  • Updated metadata propagation handler for injection of DeviceGroupMeasurements table to better handle child devices of concentrator connections and to log error, but not fail, if there is an exception.
  • Added check to ignore disabled group devices when creating DeviceGroupMeasurements metadata
  • Improved comments and readability for propagation of DeviceGroupMeasurements
  • Updated DeviceGroup model to default Enabled field to true
  • Removed historian from device group setup, since it is not used.
  • Added dynamic acronym database uniqueness validation to device and device group editing screens.
  • Added code to dynamic selection tables to scroll to bottom after row is added.
  • Added name as well as acronym to device group selection list
  • Updated data operation for openHistorian adapters to automatically add metadata exclusions for device group records for all defined data publisher instances. This way device groups remain local.
  • Updated default point tag name expression to always include base kV level when provided.
  • Updated default point tag name expression in openHistorian manager application.
  • Updated openHistorian manager to auto-elevate when using SQLite for cases when database is stored into program files folder.
  • Fixed point tag name default expressions
  • Updated SQLite database selection to not auto-select sample data script.
  • Updated device dev wizard to ignore connection string values that contain a literal "null" string value.
  • Updated web manager shortcut registry location to target SOFTWARE\Grid Protection Alliance instead of SOFTWARE\GPA to match other registry entries.
  • Added additional config file for load file viewer application.

See full release notes since last release.

Assets 5

@ritchiecarroll ritchiecarroll released this May 8, 2019 · 397 commits to master since this release

Note: This is not the latest version.

Official stable release of version 2.7 of the openPDC (v2.7.4).

NOTE: if you are upgrading from a prior version of the openPDC, before version 2.6, you must migrate your existing configuration to use the latest database schema when the Configuration Setup Utility is run after the installation completes - this version includes schema updates. Upgrades from version 2.6 can use database schema as-is.

See full release notes since last release.

Note: PMU Connection Tester is installed separately:
https://github.com/GridProtectionAlliance/PMUConnectionTester/releases

New Updates and Improvements

  • This version includes the BETA version of STTP: https://github.com/sttp
  • Added Modbus Protocol to SQL scripts.
  • Fixed up protocols in initial data set scripts.
  • Fixed race condition between HandleConnectOnDemandAdapters and adapter initialization.
  • Fix DataPublisher subscribe requests to propagate input measurement changes to the routing tables.
  • Fixed event wiring in AllAdaptersCollection.
  • Fixed casing on protocol definition for DNP3.
  • Fixed protocol ID of the test device in the sample data set.
  • Fixed NULL comparisons in SQL trigger for tracking changes to Device records.
  • Updated the schema version of the databases to reflect the change to the device update trigger.
  • Modified order of operations in DataPublisher.HandleSubscribeRequest to fix the issue of subscribers not receiving cached measurements upon subscription.
  • Added ManageCertificate command to ServiceHostBase.
  • Updated SerializedSchema.bin using refactored Schema class.
  • Added code to detach from the StatisticsEngine.Calculated event in DataSubscriber.cs.
  • Fixed parameter parsing for PublishInterval in unsynchronized data subscriber
  • Added ping console command to servicehostbase.
  • Updated ping command to split server setting to remove the port.
  • Added code to handle connect on demand scenarios for DataSubscriber.
  • Fixed temporal support in DataSubscriber.
  • Updated gateway style statistics to fall-back on reflection in source object in case properties are available.
  • Modified the sentinel value of objects derived from the AnalogValueBase and DigitalValueBase classes.
  • Added validation to the routine that updates the connection string after the user updates a connection string parameter.
  • Fixed design-time errors in PagedViewModelBase.
  • Updated the status flag reference in the RealTimeMeasurementUserControl to match the status flag reference in InputStatusMonitorUserControl.
  • Added IEEE C37.118.2 tab to the status flag reference.
  • Fixed input wizard to apply the selected PDC vendor device ID to the concentrator on save.
  • Added validation for the chart refresh interval to ensure that the Manger doesn't crash when the value is misconfigured.
  • Fixed Latitude and Longitude fields so that trailing zeros don't cause validation errors on the Device page.
  • Added line-to-line option under Phase to the Manage Phasor page of the Manager.
  • Fixed up startup operation that fills in missing protocols.
  • Removed stats from device outputs - although statistics may be associated with device, it will not be the adapter producing them...
  • Added more messaging around ToogleBadData testing function and restricted command to admins and editors.
  • Updated automated output measurement creation for power calculations to use HistorianID from associated voltage.
  • Updated default lag-time of PowerMultiCalculatorAdapter to 5 seconds.
  • Fixed the metadata import adapter to use the parent acronym when using source prefix to name child devices.
Assets 5

@ritchiecarroll ritchiecarroll released this Nov 2, 2018 · 650 commits to master since this release

Note: This is not the latest version.

Official stable release of version 2.6 of the openPDC (v2.6.13).

NOTE: if you are upgrading from a prior version of the openPDC, you must migrate your existing configuration to use the latest database schema when the Configuration Setup Utility is run after the installation completes - this version includes schema updates.

Note: the PMU Connection Tester is no longer automatically included with the installer package and will need to be installed separately:

https://github.com/GridProtectionAlliance/PMUConnectionTester/releases

Security Fixes:

Security scans of older release versions of the openPDC have identified vulnerabilities related to the version of SQLite that was being used. The vulnerability only applies when a SQLite database is being used as the primary configuration, however, because these older dependencies were distributed with the GSF dependent products, a higher level of concern is warranted. The current openPDC release version 2.6 corrects all SQLite vulnerabilities that have been idenfied, specifically by updating the included sqlite3.exe and System.Data.SQLite.dll files to their latest versions. Older versions of the openPDC can safely delete these files from the product installation folders for deployments that do not depend upon SQLite. The corrected CVE list is as follows: CVE-2015-3717, CVE-2018-8740, CVE-2015-3414, CVE-2015-3415, CVE-2015-3416, CVE-2015-3417, CVE-2015-5895, CVE-2017-10989, CVE-2015-6607, CVE-2016-6153, CVE-2018-8740

Also, security scans of openPDC may report CVE-2018-14041 based on the included version of Boostrap, specifically version 3.3.7, however the vulnerability only applies when the Bootstrap JavaScript files tooltip.js, collapse.js or scrollspy.js are accessible and in use. Since these JavaScript files are not included, neither via physical deployment nor as emebdded resources, the vulnerability does not apply to openPDC or any other GPA product based on the Grid Solutions Framework that includes web-based features.

New Updates and Improvements

  • Upgraded included SQLite assemblies to version 1.0.109 to clear associated CVEs (see above)
  • Restored old code for looking up a user's groups as a fallback strategy when the new (recommended) code fails - this will help with any authentication issues that can occur when certain AD environments reject user authentication (per last openPDC release)
  • Fixed error that would occur with new SQL Server configuration setups that was causing user to have to go back and retry the step so setup would continue successfully
  • Updated configuration setup utility so that it would not use connection string pooling for SQL Server connections during configuration
  • Improved Dyanmic Calaculator adapter functionality
  • Added Database Notifier adapter that will execute a database expression based on a user defined expression / condition (similar to existing Email Notifier adapter)
  • Added configuration option to allow manual enabling or disabling use of FIPS cryptographic modules. Defaults to Auto which reads FIPS setting from registry.
  • Improved operation and integration of openPDC DNP3 adapters and updated core libraries to current version as available from https://www.automatak.com/opendnp3/
  • Fixed DataPublisher subscribe requests to propagate any input measurement changes to the routing tables
  • Fixed input wizard in openPDC Manager to apply the selected PDC vendor device ID to the concentrator on save
  • Fixed Latitude and Longitude fields in openPDC Manager so that trailing zeros don't cause validation errors on the Device page.
  • Added validation to the openPDC Manager routine that updates the connection strings after the user updates a connection string parameter in the custom adapter screens
  • Added "L" option in openPDC Manager to phasor identifiers of line-to-line configurations
  • Updated SQLite data provider strings to target latest version
  • Added code to properly detach from the StatisticsEngine.Calculated event in DataSubscriber.cs
  • Modified order of operations in DataPublisher.HandleSubscribeRequest to fix the issue of subscribers not receiving cached measurements upon subscription
  • Improved Modbus configuration screen integration within openPDC UI Manager
  • Added IEEE C37.118.2 tab to the status flag reference in the openPDC Manager
  • Fixed minor issues with Postgres deployments
  • Fixed parameter parsing for PublishInterval in unsynchronized data subscriber
  • Updated StatHistorianReportGenerator to lookup for device status table and include nightly stats when available
  • Fixed NULL comparisons in SQL trigger for tracking changes to Device records for all SQL scripts
  • Improved DeviceStatus page in web UI for device monitoring
  • Fixed layout options for screens in the HistorianView tool
  • Added new web-based openPDC and device monitoring APIs for Grafana dashboards
  • Added dashboard plugins for openPDC monitoring from openHistorian hosted Grafana visualizations
  • Fixed web-based login issues with IE
  • Modified IE subscriptions on DeviceStatus page to be throttled (IE was slower than other browsers)
  • Cleaned up default settings for web-based authentication failure redirections
  • Added current version number to setup UI screens
Assets 5

@ritchiecarroll ritchiecarroll released this Jun 1, 2018 · 837 commits to master since this release

Note: This is not the latest version.

Official stable release of version 2.5 of the openPDC (v2.5.6).

NOTE: if you are upgrading from a prior version of the openPDC, you must migrate your existing configuration to use the latest database schema when the Configuration Setup Utility is run after the installation completes - this version includes schema updates.

See full release notes since last release.

Note: the PMU Connection Tester is no longer automatically included with the installer package and will need to be installed separately:

https://github.com/GridProtectionAlliance/PMUConnectionTester/releases

New Features and Improvements

  • Added initial web based management system available at http://localhost:8280/ (see screen capture below)
  • Fully overhauled system security
  • Added Modbus device connections and configuration screen
  • Added eDNA historian adapters
  • Added ability to control TCP Nagle algorithm through configuration and applied better defaults when applicable
  • Added quiet / resume console commands, with q and r alias shortcuts, to reduce noise during interaction
  • Improved sub-second time handling
  • Improved startup time of applications without Internet access by allowing disabling of generate publisher evidence in the NoInetFixUtil
  • Added new GSF time-series Filter Adapters and management screen
  • Added new Grafana functions and capabilities (see full list)
  • Better pre-compilation options of Razor web pages at service start
  • Provided CSV export options to daily quality reporting
  • Added "useSourcePrefixNames" boolean connection string parameter to DataSubscriber to allow override ability on subscription prefixes applied to devices names
  • Included new GSF adapter to allow selection of a "best" value based on configuration options
  • Updated POSIX based installations to default to Basic authentication
  • Modified the latest values cache in DynamicCalculator to be fed by the concentration engine to resolve usability issues
  • Updated Grafana annotation queries to always operate at full resolution so that no alarms will be missed
  • Fixed memory leak in MultiProtocolFrameParser when replay start time and stop time is specified
  • Fixed logic error in AverageFrequency calculator when reporting unreasonable results as NaN
  • Fixed SQL syntax for updated Phasor synchronization in DataSubscriber
  • Updated LDAP security provider to allow UserData.IsDefined to be assumed to be true if no cached user can be found to allow authentication to be attempted
  • Added a safety check around target cache acquisition for cases where cache may have been disposed
  • Handled edge case in SIDToAccountName to resolve errors with null input
  • Removed references and dependencies on to Thread.CurrentPrincipal throughout system as part of security overhaul

image

Assets 5

@ritchiecarroll ritchiecarroll released this Mar 17, 2017 · 1411 commits to master since this release

Official stable release of version 2.4 of the openPDC (v2.4.120).

See full change log since last release.

Note: the PMU Connection Tester is no longer automatically included with the installer package and will need to be installed separately:

https://github.com/GridProtectionAlliance/PMUConnectionTester/releases

New Features and Improvements

  • GrafanaAdapters: Added full set of aggregation and operational functions that operate on a per-series or per-set for all data sources that implement Grafana interfaces. See documentation.
  • LogFileViewer: Added new enhanced general logging capabilities along with a new application, Log File Viewer, that is used to analyze logs.
  • PowerCalculations: Added calculators for wrapping angle difference and line impedance with resistance, reactance, conductance and susceptance results - includes both rectangular and polar based outputs.
  • PowerCalculations: Updated average frequency calculator to (1) exclude NaN values from average results, (2) allow definable unreasonable thresholds, (3) improve flat-line value detection to throw out repeating values, and (4) added flag to AverageFrequency calculator to allow unreasonable results, e.g., zero, to be reported as NaN.
  • GSF.PhasorProtocols.UI: Updated OutputStream data model to accommodate auto-assignment of "auto public config frame flag" based on current channel definitions
  • GSF.TimeSeries: Added up-time statistics for system, subscriber, publisher, input streams and output streams.
  • GSF.TimeSeries: Added a new enhanced version of the time-series special compression algorithm, automatically enabled for new connections, used with the Gateway Exchange Protocol that uses much less bandwidth. Add ; compression=true to connection string of existing GEP subscriptions to enable.
  • GSF.TimeSeries: Created a lookup cache for the main adapter meta-data using dictionary based lookups. This improved load times for input adapters on large systems (e.g., from 160 seconds to less than 1 second in some cases).
  • GSF.TimeSeries: Updated measurement definitions to carry meta-data as part of measurement key with an internal reference inside measurement implementations to reduce total memory footprint requirements for new measurements.
  • GSF.Core: Added a static timer class to allow many hundreds of scheduled events that run at the same interval to be associated with a single wait event instead of creating a new timer for each event (e.g., as hundreds of devices needing to check statistics every second) - this alleviates thread pool exhaustion that can occur when hundreds of timer events get executed at the same time.

Important Fixes

  • PhasorProtocolAdapters: Fixed issue in custom IEEE C37.118 concentrator output streams where phasors were being reordered if a cell had 10 or more phasors.
  • PhasorProtocolAdapters: Updated IEEE C37.118 concentrator to allow an explicit config frame 1 to be returned when requested instead of defaulting to config frame 2 - this corrects issues with SEL RTAC devices connecting to openPDC.
  • PhasorProtocolAdapters: Corrected issue for output stream mappings when using PMU source device acronyms that are longer than 16 characters.
  • DataSubscriber: Updated measurements received with GEP to apply any linear adjustments defined in the local configuration.
  • GSF.Core: Added code to ensure that log files won't become deadlocked if an error occurs during rollover.
  • GSF.TimeSeries: Updated DataSubscriber meta-data synchronization to exclude calculation and alarm signals from the device measurement removal processing such that if a local subscription creates new calculations associated with a subscribed device, the locally created measurements will not get automatically removed at the next synchronization.

openHistorian 1.0 Time-Series Web Service Fix

If you use the web services hosted by the local openHistorian 1.0 adapter, download this patch to fix the timestamps displayed when accessing the latest archived values through the Time-Series Web Service. See GridProtectionAlliance/gsf#18 for more details.

Assets 6

@ritchiecarroll ritchiecarroll released this Oct 16, 2016 · 1798 commits to master since this release

Note: This is not the latest version.

Official stable release of version 2.3 of the openPDC (v2.3.4).

See full change log since last release.

Note: the PMU Connection Tester is no longer automatically included with the installer package and will need to be installed separately:

https://github.com/GridProtectionAlliance/PMUConnectionTester/releases

New Features and Improvements

  • New web interfaces to support Grafana dashboards
  • Support for PostgreSQL configuration databases
  • Bulk power calculation adapter improvements including a more functional AdjustmentStrategy parameter for line-to-line and line-to-neutral adjustments
  • New dynamic e-mail responder adapter that will send an e-mail based on a custom expression
  • Simplified installation deployments signed with extended validation certificate

Important Fixes

  • Improved performance of secure implementations of Gateway Exchange Protocol for access control list lookups in service and manager implementations
  • Better phasor reduction management in manager, output streams and GEP meta-data synchronization (e.g., reducing output stream to only include positive sequence phasors)
  • Fixed issues in openHistorian 1.0 data and statistic archive deployments with potential race conditions between rollovers and reading data to prevent data access issues
  • Outage logs now properly serialize stop timestamps in UTC ensuring proper data gap recovery operations
  • NT SERVICE accounts are now assigned needed rights in installer to restart associated host service allowing restart buttons to properly function
  • Fixed issues related to creating and using a custom abstract synchrophasor configurations

Remote Console Access for Users with Viewer Roles

A new command has been added to the remote console to allow messages to be filtered down to desired results, see Filter command syntax below. In order for users with view role access to access the remote console, the filter command will need to be added to the included security resources in the main configuration file.

The simplest way to add this command is to run the XML Configuration Editor application that can be found on the start menu and add the Filter command before the Settings command in the IncludedResources configuration key in the securityProvider section of the configuration settings:

<securityProvider>
    <add name="IncludedResources" value="UpdateSettings,UpdateConfigFile=Special; Filter,Settings,Schedules,Help,Status,Version,Time,User,Health,List,Invoke,ListCommands=*; Processes,Start,ReloadCryptoCache,ReloadSettings,ResetHealthMonitor,Connect,Disconnect,Initialize,ReloadConfig,Authenticate,RefreshRoutes,TemporalSupport,LogEvent=Administrator,Editor; *=Administrator"
        description="Semicolon delimited list of resources to be secured along with role names." encrypted="false" />
</securityProvider>

Filter Command Syntax

Filters status messages coming from the service.

   Usage:
       Filter [ { -List |
                  -Include <FilterDefinition> |
                  -Exclude <FilterDefinition> |
                  -Remove <ID> } ... ]

       Filter -?

       FilterDefinition ::= Type { Alarm | Warning | Information } |
                            Message <FilterSpec> |
                            Regex <FilterSpec>

   Options:
       -List        Displays a list of the client's active filters
       -Include     Defines a filter matching messages to be displayed
       -Exclude     Defines a filter matching messages to be suppressed
       -Remove      Removes a filter
Assets 5

@ritchiecarroll ritchiecarroll released this Dec 3, 2015 · 2003 commits to master since this release

Note: This is not the latest version.

This is the official release version of the openPDC v2.2.70

Change log: https://github.com/GridProtectionAlliance/gsf/wiki/GSF-v2.1.264-Release-Notes

Assets 4
You can’t perform that action at this time.