Skip to content

@ritchiecarroll ritchiecarroll released this May 6, 2020 · 68 commits to master since this release

Official stable release of version 2.7 of the openHistorian (v2.7.195).

NOTE: If you are upgrading from a prior version of the openHistorian, you must migrate your existing configuration to use the latest database schema when the Configuration Setup Utility is run after the installation completes - this version includes schema updates.

image

Security Fixes

Security scans of older releases of the openHistorian have identified two JavaScript library vulnerabilities included from the Grid Solutions Framework, specifically jQuery and knockout. Installation of version 2.7 of the openHistorian resolves these reported issues through library updates.

For jQuery the vulnerability was CVE-2019-11358:

jQuery before 3.4.0, as used in Drupal, Backdrop CMS, and other products, mishandles jQuery.extend(true, {}, ...) because of Object.prototype pollution. If an unsanitized source object contained an enumerable proto property, it could extend the native Object.prototype.

Because of the way GPA uses jQuery within the openHistorian, GPA deems the risk of this vulnerability to be low.

For knockout the vulnerability was WS-2019-0015:

Knockout, before 3.5.0-beta, has an XSS injection point in “attr” name binding for browser IE7 and older.

Exploitation of the knockout vulnerability required the use of IE7. Since the openHistorian requires IE11 or better to function, GPA deems the risk of this vulnerability to be low. However, GPA does suggest updating to a newer, more secure browser regardless.

New Updates and Improvements

  • Includes latest updates to STTP, including reverse connections
  • Added signal-to-noise ratio (SNR) calculation adapter with option to save SNR statistics separately to speed up reporting
  • Added unbalanced calculation adapter
  • Added Grafana openHistorian alarm panel
  • Added Grafana GPA phasor map panel
  • Added initial screen for adding device groups, e.g., a "region" or "best values group"
  • Added IPv6 support for SnapServer and ability for primary historian adapter (LocalOutputAdapter) to bind to a specific IP address.
  • Added NGEN based pre-compile at install time to boost overall performance and improve application start times.
  • Improved functionality of point tag naming convention.
  • Updated point tag naming convention to include phasor type and phase information.
  • Added ability to disable self-web hosting
  • Disabled checking for CAS publisher policy for all application config files to speed start time.
  • Updated to Grafana v6.6.2
  • Simplified GrafanaController target search functionality since base class now include SQL SELECT functionality.
  • Updated GrafanaController to allow template queries based on FILTER expressions that include the field name to return, e.g.: FILTER (Acronym) InputStreamDevices WHERE Name LIKE '%DFR%'
  • Updated GrafanaController template queries to use SELECT syntax, e.g.: SELECT Acronym FROM InputStreamDevices WHERE Name LIKE '%DFR%'
  • Improved GrafanaController template queries SELECT RegEx
  • Allow scripts in local Grafana panels for custom Home page.
  • Changed Grafana default directory to relative path
  • Added Grafana data download panel
  • Updated Grafana Scadavis Panel to newest version
  • Improved UI operations for "viewer" roles.
  • Updated default data operation for open historian outputs to automatically add a custom input reader to properly support data gap recovery operations through STTP and GEP.
  • Added option to download data at less than 1 frame per second resolution
  • Fixed time stamp alignment when exporting to csv
  • Fixed bug with frames per minute and frames per hour being changed to frames per second if they don't fit exactly within 1 day
  • Fixed data export with timestamp to make timestamp buckets optional
  • Fixed various issues with web-based synchrophasor wizard
  • Updated synchrophasor wizard to allow for either disabled or deleted phasors with better visual feedback on selected options.
  • Updated synchrophasor device wizard to update baseKV for simple phasor updates.
  • Improved phase guess operation in device wizard.
  • Updated delete device operations in DataHub to also remove children devices before parent device.
  • Updated dev wizard screen to allow export of config regardless of editor rights.
  • Added desired remaining disk space as a configuration parameter of LocalOutputAdapter.
  • Improved on-second window adapter sample operation
  • Updated multi action adapter collection base implementation to allow for customized derived class connection string parsing.
  • Updated independent adapter managers to support input, output and action adapter collection types.
  • Updated to independent adapter manager samples to accommodate and end-user API.
  • Updates to independent adapter manager classes to handle multiple inputs per adapter from collection manager base classes.
  • Updated independent adapter managers to support grouped multiple inputs.
  • Updated independent adapter manager collections functionality.
  • Improved eDNA Grafana meta-data derivation, especially for cases when a GSF host is the publishing source.
  • Added configuration settings to control if eDNA and OSI-PI Grafana controllers are automatically loaded.
  • Fixed dataset schema for eDNA Grafana Controller metadata
  • Added error handling to SQL Server role migration in Configuration Setup Utility.
  • Added configured desired remaining space to LocalOutputAdapter status details.
  • Added Grafana function to get Location Data for Map
  • Fixed issue with Grafana GetLocation when trying to get multiple locations at once
  • Updated imported labels in device page to remove underscores with imported phasor labels
  • Updated long/lat layout / operation on device wizard (dev page)
  • Added initial options for connection string building with synchrophasor wizard screen
  • Added serialized configuration section to device wizard
  • Added ability to import and export config
  • Updated location meta-data function signatures
  • Updated GrafanaController to use common LocationData class.
  • Cleared Sonar warnings and general code of newly added code.
  • Added GSF.Geo assembly to the installer
  • Fixed access keys to be unique in custom installer dialogs
  • Applied custom action to installer to load previous company information.
  • Added flag for enabling web hosting to systemSettings when missing
  • Condensed PhasorHub initialization to web Startup.
  • Updated GrafanaAuthProxyController to simplify referrer null check.
  • Fixed Grafana Datasource Error in TS production build
  • Added example adapters for managing self-configuration and on-second data windows.
  • Updated sample adapters to include additional parameters for automated output measurement creation.
  • Fixed Hostname Setting in Grafana configuration file
  • Fixed race condition for unauthorized Grafana users to properly initiate user synchronizations.
  • Updated MAS adapter example code to use GSF.TimeSeries base classes for independent adapter management.
  • Updated bulk MAS example adapters to override default point tag and signal reference tag templates.
  • Updated link on default device status page in Grafana to properly navigate back to openHistorian home page.
  • Synced synchrophasor dev page to GSF updates.
  • Updated knockout bindings in COMTRADE importer to target first body element.
  • Updated GrafanAuthProxy to better handle initial startup user synchronization,
  • Added sub-title feature to primary Layout.cshtml
  • Cleaned up code for trend measurements and export data handler
  • Updated buttons on select group devices page to read "export/import" instead of "save/load" to better serve context.
  • Updated synchrophasor screen to accommodate application of calculation tags against devices setup with Gateway style connections.
  • Added Grafana EndPoint to get all device alarm statuses
  • Added Grafana Endpoint to get Device Groups
  • Fixed naming of QueryAlarms issue in GrafanaController
  • Updated device queries to only filter out device groups when both protocol is virtual and access ID is set
  • Updated service host to inject DeviceGroupMeasurements selection table into data source updates
  • Added extra safety checks for database to runtime ID conversion in data source propagation override in ServiceHost implementation.
  • Updated metadata propagation handler for injection of DeviceGroupMeasurements table to better handle child devices of concentrator connections and to log error, but not fail, if there is an exception.
  • Added check to ignore disabled group devices when creating DeviceGroupMeasurements metadata
  • Improved comments and readability for propagation of DeviceGroupMeasurements
  • Updated DeviceGroup model to default Enabled field to true
  • Removed historian from device group setup, since it is not used.
  • Added dynamic acronym database uniqueness validation to device and device group editing screens.
  • Added code to dynamic selection tables to scroll to bottom after row is added.
  • Added name as well as acronym to device group selection list
  • Updated data operation for openHistorian adapters to automatically add metadata exclusions for device group records for all defined data publisher instances. This way device groups remain local.
  • Updated default point tag name expression to always include base kV level when provided.
  • Updated default point tag name expression in openHistorian manager application.
  • Updated openHistorian manager to auto-elevate when using SQLite for cases when database is stored into program files folder.
  • Fixed point tag name default expressions
  • Updated SQLite database selection to not auto-select sample data script.
  • Added update tag names and GEP data extractor tools to setup folder
  • Added Installers folder with PMU Connection Tester and Stream Splitter Setup to be included as optional install tools
  • Updated "UpdateDependecies.bat" build script to auto-update new tools
  • Added bulk-calculation state tool
  • Updated configuration setup utility to allow for option installs of connection tester and stream splitter.
  • Fixed file name suffixes for optional installers.
  • Updated CSU to launch WPF UI manager over web manager if service is not selected to start at last step - plus general code clean-up.
  • Updated device dev wizard to ignore connection string values that contain a literal "null" string value.
  • Updated web manager shortcut registry location to target SOFTWARE\Grid Protection Alliance instead of SOFTWARE\GPA to match other registry entries.
  • Added additional config file for load file viewer application.
  • Fixed service description in WiX setup file.
  • Added code to shell out NoInetFixUtil with --checkall flag from CSU (allows for faster startups in environments with no Internet)

See full release notes since last release.

Assets 4

@ritchiecarroll ritchiecarroll released this Jul 23, 2019 · 672 commits to master since this release

Note: This is not the latest version.

Official stable release of version 2.6 of the openHistorian (v2.6.30).

NOTE: if you are upgrading from a prior version of the openHistorian, you must migrate your existing configuration to use the latest database schema when the Configuration Setup Utility is run after the installation completes - this version includes schema updates.

New Synchrophasor Input Wizard with Automated Device Calculations

This new version of the openHistorian includes a new web-based synchrophasor device wizard that provides the ability to create custom calculations from a template:
image
User defined calculations can be added to a .TagTemplate file and be applied to new or existing devices and can be reapplied if the template is updated. See included Full Checkout Calculations for an example.

New Cloud Data Push Adapter

As a new feature, this release includes an adapter (the first of many) to enable the openHistorian to push JSON-formatted data directly to the cloud. This first adapter, called AzureEventHubOutputAdapter, will push streaming time-series data (like synchrophasor data) to an Azure Event Hub.

Updated Grafana with Included SCADAvis Synoptic Panel

Also updated in version 2.6 of the openHistorian is the included instance of Grafana, now at version 6.2.5. The frequently used piechart and clock plugin panels are now automatically included as part of the openHistorian install. Additionally, the SCADAvis Synoptic Panel has been included to allow animated advanced Scalable Vector Graphics (svg) screens to be created in Grafana -- such as seen in the example below:
image
To create new screens for this panel, see the HTML5 Synoptic Toolkit. This tool can create new svg screens that can be integrated into Grafana with data queried from the openHistorian and other sources.

Deployments of the openHistorian with hosted Grafana integration include pre-configured data sources for the primary data and statistics archives named OHDATA and OHSTAT respectively. The latest versions of the openHistorian and OSIsoft-PI Grafana data source are included, as well as a default System Status dashboard.

Enhanced Point Tag Naming Convention

This version of the openHistorian includes an updated default tag naming convention for new measurements. If you are upgrading from a prior version, you can manually update your PointTagNameExpression in the systemSettings sections of the openHistorian.exe.config and openHistorianManager.exe.config files using the included XML Configuration Editor tool.

The new expression is as follows:

[?{CompanyAcronym}!=[{CompanyAcronym}_]]{DeviceAcronym}[?{SignalType.Source}=Phasor[-eval{'{PhasorLabel}'.ToUpper().Replace(' ','_')}[?{BaseKV}>0[_{BaseKV}]][?{SignalType.Suffix}=PA[:ANG]][?{SignalType.Suffix}=PM[:MAG]]]][?{SignalType.Source}!=Phasor[:{SignalType.Acronym}[?{SignalIndex}!=-1[{SignalIndex}]]]]

This new expression will create tag names like the following:

  • TESTDEVICE-500_KV_BUS1:ANG
  • TESTDEVICE-500_KV_BUS1:MAG
  • TESTDEVICE-LAGOON_CREEK:ANG
  • TESTDEVICE-LAGOON_CREEK:MAG
  • TESTDEVICE:FREQ

You can force all tag names to be updated using the new expression by setting the Arguments field of the PhasorDataSourceValidation record of the DataOperation table to renameAllPointTags=true and issuing a ReloadConfig command from the openHistorian console.

Note: PMU Connection Tester is installed separately:
https://github.com/GridProtectionAlliance/PMUConnectionTester/releases

Installation: The following YouTube video walks through the process of installing and configuring the openHistorian and covers the process of building custom displays from openHistorian data using Grafana visualizations.

New Updates and Improvements

  • This version includes the BETA version of STTP: https://github.com/sttp
  • Added Modbus Protocol to SQL scripts.
  • Fixed up protocols in initial data set scripts.
  • Fixed race condition between HandleConnectOnDemandAdapters and adapter initialization.
  • Fix DataPublisher subscribe requests to propagate input measurement changes to the routing tables.
  • Fixed event wiring in AllAdaptersCollection.
  • Fixed casing on protocol definition for DNP3.
  • Fixed protocol ID of the test device in the sample data set.
  • Fixed NULL comparisons in SQL trigger for tracking changes to Device records.
  • Updated the schema version of the databases to reflect the change to the device update trigger.
  • Modified order of operations in DataPublisher.HandleSubscribeRequest to fix the issue of subscribers not receiving cached measurements upon subscription.
  • Added ManageCertificate command to ServiceHostBase.
  • Updated SerializedSchema.bin using refactored Schema class.
  • Added code to detach from the StatisticsEngine.Calculated event in DataSubscriber.cs.
  • Fixed parameter parsing for PublishInterval in unsynchronized data subscriber
  • Added ping console command to servicehostbase.
  • Updated ping command to split server setting to remove the port.
  • Added code to handle connect on demand scenarios for DataSubscriber.
  • Fixed temporal support in DataSubscriber.
  • Updated gateway style statistics to fall-back on reflection in source object in case properties are available.
  • Modified the sentinel value of objects derived from the AnalogValueBase and DigitalValueBase classes.
  • Added validation to the routine that updates the connection string after the user updates a connection string parameter.
  • Fixed design-time errors in PagedViewModelBase.
  • Updated the status flag reference in the RealTimeMeasurementUserControl to match the status flag reference in InputStatusMonitorUserControl.
  • Added IEEE C37.118.2 tab to the status flag reference.
  • Fixed input wizard to apply the selected PDC vendor device ID to the concentrator on save.
  • Added validation for the chart refresh interval to ensure that the Manger doesn't crash when the value is misconfigured.
  • Fixed Latitude and Longitude fields so that trailing zeros don't cause validation errors on the Device page.
  • Added line-to-line option under Phase to the Manage Phasor page of the Manager.
  • Fixed up startup operation that fills in missing protocols.
  • Removed stats from device outputs - although statistics may be associated with device, it will not be the adapter producing them...
  • Added more messaging around ToogleBadData testing function and restricted command to admins and editors.
  • Updated automated output measurement creation for power calculations to use HistorianID from associated voltage.
  • Updated default lag-time of PowerMultiCalculatorAdapter to 5 seconds.
  • Fixed the metadata import adapter to use the parent acronym when using source prefix to name child devices.

See full release notes since last release.

Assets 4

@ritchiecarroll ritchiecarroll released this Jun 1, 2018 · 1208 commits to master since this release

Note: This is not the latest version.

Official stable release of version 2.5 of the openHistorian (v2.5.6).

NOTE: if you are upgrading from a prior version of the openHistorian older than 2.4, you must migrate your existing configuration to use the latest database schema when the Configuration Setup Utility is run after the installation completes - this version includes schema updates.

This version of the openHistorian allows Grafana to be seamlessly integrated such that the openHistorian primary web site can act as a reverse proxy to an instance of Grafana accessible from the main web URL, e.g.: http://localhost:8180/grafana/. When configured in this mode, the openHistorian will auto-launch the grafana-server executable and act as a front-end server for Grafana. Additionally, the openHistorian will maintain user security synchronization such that a user with an Administrator role in openHistorian will also have an Admin role in Grafana, or if a user has an Editor role in openHistorian they will have an Editor role in Grafana, and so on.

See the new YouTube video that walks users through the process of installing and configuring the openHistorian and covers the process of building custom displays from openHistorian data using Grafana visualizations.

Deployments of the openHistorian with hosted Grafana integration include pre-configured data sources for the primary data and statistics archives named OHDATA and OHSTAT respectively. The latest versions of the openHistorian and OSIsoft-PI Grafana data source are included, as well as a default System Status dashboard:

systemstatus

New Features and Improvements

  • Improved operations when storing archive data on remote Linux drives
  • Improved SignalR API for trend and export web screens by reducing user based caching
  • Improved configuration setup utility when migrating databases using local users in SQL Server
  • Improved web based security including better application of CORS and anti-forgery tokens within self-hosted web architecture
  • Updated external dependencies, both assemblies and Javascript libraries, to latest versions for improved security
  • Improved hosted Grafana user security synchronization
  • Improved included system statistics Grafana dashboard to display better total active devices
  • Release built with version 2.2 of GSF, see full release notes

Other New Features / Fixes (available since 2.4)

  • Improved web based authentication
  • Fully overhauled system security
  • Modbus device connections
  • COMTRADE data file importer
  • Improved sub-second time handling
  • Included GSF time-series Filter Adapter management
  • Added panning support for Trend Measurements screen
  • Added new Grafana functions and capabilities (see full list)
  • Better pre-compilation options of Razor web pages at service start
  • Provided CSV export options to daily quality reporting
  • Added "useSourcePrefixNames" boolean connection string parameter to DataSubscriber to allow override ability on subscription prefixes applied to devices names
  • Included new GSF adapter to allow selection of a "best" value based on configuration options
  • Updated POSIX based installations to default to Basic authentication
  • Modified the latest values cache in DynamicCalculator to be fed by the concentration engine to resolve usability issues
  • Updated Grafana annotation queries to always operate at full resolution so that no alarms will be missed
  • Fixed memory leak in MultiProtocolFrameParser when replay start time and stop time is specified
  • Fixed logic error in AverageFrequency calculator when reporting unreasonable results as NaN
  • Fixed SQL syntax for updated Phasor synchronization in DataSubscriber
  • Updated LDAP security provider to allow UserData.IsDefined to be assumed to be true if no cached user can be found to allow authentication to be attempted
  • Added a safety check around target cache acquisition for cases where cache may have been disposed
  • Handled edge case in SIDToAccountName to resolve errors with null input
  • Removed references and dependencies on to Thread.CurrentPrincipal throughout system as part of security overhaul
  • Corrected access control issues on shared Modbus configuration screen

Migrating to openHistorian 2.0 in other GPA Products

It is recommended to install a stand-alone instance of the openHistorian 2.0 and subscribe to other data sources, e.g., using GEP, to get data in the openHistorian. However, using the openHistorian.Binaries.zip download that can be found here, you can extract the needed openHistorian 2.0 assemblies needed to upgrade any openHistorian 1.0 instance running in a GPA product built using the GSF Time-Series Library, e.g., the common PPA openHistorian 1.0 instance running in an openPDC. You can also migrate existing openHistorian 1.0 .D data files into openHistorian 2.0 .D2 data files using the Archive Upgrade Utility that comes installed with the openHistorian.

To start using the openHistorian 2.0 within an existing GSF Time-Series Library based application, begin by following these steps.

Assets 4

@ritchiecarroll ritchiecarroll released this Jan 1, 2018 · 1459 commits to master since this release

Note: This is not the latest version.

Official stable release of version 2.4 of the openHistorian (v2.4.30).

NOTE: if you are upgrading from a prior version of the openHistorian, you must migrate your existing configuration to use the latest database schema when the Configuration Setup Utility is run after the installation completes - this version includes schema updates.

This version of the openHistorian allows Grafana to be seamlessly integrated such that the openHistorian primary web site can act as a reverse proxy to an instance of Grafana accessible from the main web URL, e.g.: http://localhost:8180/grafana/. When configured in this mode, the openHistorian will auto-launch the grafana-server executable and act as a front-end server for Grafana. Additionally, the openHistorian will maintain user security synchronization such that a user with an Administrator role in openHistorian will also have an Admin role in Grafana, or if a user has an Editor role in openHistorian they will have an Editor role in Grafana, and so on.

Deployments of the openHistorian with hosted Grafana integration include pre-configured data sources for the primary data and statistics archives named OHDATA and OHSTAT respectively. The latest versions of the openHistorian and OSIsoft-PI Grafana data source are included, as well as a default System Status dashboard

New Features and Improvements

  • Improved web based authentication
  • Fully overhauled system security
  • Modbus device connections
  • COMTRADE data file importer
  • Improved sub-second time handling
  • Included GSF time-series Filter Adapter management
  • Added panning support for Trend Measurements screen
  • Added new Grafana functions and capabilities (see full list)
  • Better pre-compilation options of Razor web pages at service start
  • Provided CSV export options to daily quality reporting
  • Added "useSourcePrefixNames" boolean connection string parameter to DataSubscriber to allow override ability on subscription prefixes applied to devices names
  • Included new GSF adapter to allow selection of a "best" value based on configuration options

Important Fixes

  • Updated POSIX based installations to default to Basic authentication
  • Modified the latest values cache in DynamicCalculator to be fed by the concentration engine to resolve usability issues
  • Updated Grafana annotation queries to always operate at full resolution so that no alarms will be missed
  • Fixed memory leak in MultiProtocolFrameParser when replay start time and stop time is specified
  • Fixed logic error in AverageFrequency calculator when reporting unreasonable results as NaN
  • Fixed SQL syntax for updated Phasor synchronization in DataSubscriber
  • Updated LDAP security provider to allow UserData.IsDefined to be assumed to be true if no cached user can be found to allow authentication to be attempted
  • Added a safety check around target cache acquisition for cases where cache may have been disposed
  • Handled edge case in SIDToAccountName to resolve errors with null input
  • Removed references and dependencies on to Thread.CurrentPrincipal throughout system as part of security overhaul
  • Corrected access control issues on shared Modbus configuration screen

Migrating to openHistorian 2.0 in other GPA Products

It is recommended to install a stand-alone instance of the openHistorian 2.0 and subscribe to other data sources, e.g., using GEP, to get data in the openHistorian. However, using the openHistorian.Binaries.zip download that can be found here, you can extract the needed openHistorian 2.0 assemblies needed to upgrade any openHistorian 1.0 instance running in a GPA product built using the GSF Time-Series Library, e.g., the common PPA openHistorian 1.0 instance running in an openPDC. You can also migrate existing openHistorian 1.0 .D data files into openHistorian 2.0 .D2 data files using the Archive Upgrade Utility that comes installed with the openHistorian.

To start using the openHistorian 2.0 within an existing GSF Time-Series Library based application, begin by following these steps.

Known Issues

The built-in System Status dashboard "Active Input Connections" single-stat panel reports an invalid value for system with multiple direct connections or GEP based inputs, change the metric query to the following to produce a correct count:

SliceCount(10, Exclude(0, 0, FILTER ActiveMeasurements WHERE PointTag LIKE '%!PMU:ST4'))

To change the query you may need to first make the page “editable”. To do so, click the “gear” icon at the top of the page and select “Make Editable”, save the dashboard, then refresh the page. Now when you click on the panel titled “Active Input Connections” you can click “Edit” and paste in the corrected metric query above.


This release has been updated, note the following changes since v2.4.22:

  • Fixed references for TrendMeasurements view to correct zoom out and pan
  • Updated Grafana deployment to 4.6.3
  • Reduced web file deployment footprint
Assets 4

@chefsteph9 chefsteph9 released this Jul 12, 2017 · 1827 commits to master since this release

Note: This is not the latest version.

Official stable release of version 2.3 of the openHistorian (v2.3.7).

See full GSF change log since last release.

New Features and Improvements

  • Simplified Datahub record operations with new modeled table functions.
  • Updated to Owin 3.1.0 and added Cors assembly to allow for cross-site scripting.
  • Added security mode indication, e.g., FIPS compliance, to primary web interface home page.
  • Added optional timestamp reasonability checking for incoming measurements to be archived.
  • Made status messages more resistant to possible exceptions.
  • Suppressed blank warnings and messages from flowing to the console.

Important Fixes

  • Start the Web UI on a separate thread when starting the service.
  • Fixed issue where html was using forbidden characters for ids.
  • Added more error handling to the Configuration Setup Utility SqlServer setup screen.
  • Configuration Setup Utility updates or creates AssemblyBindings node in .config file.
  • Fixed the status lights on the Graph Measurements page of the Web UI.
  • Add missing "System.Web.Cors.dll" to the installer.
  • Fixed TrenValueAPI static constructor.
  • Used FilePath.GetFiles() in ArchiveList2.AttachFileOrPath() so that permissions issues encountered during recursive search don't cause the openHistorian to fail to attach accessible archive files.
  • Updated SqlClr script to include GSF.Core.SqlClr.dll and added assembly to installation package.
  • Fixed issues when system is set to use FIPS security.
  • Corrected TableOperation models based on latest attribute namespace changes.
  • In the CSU, fixed database setup screens to retain the value of the Encrypted option on the connection string when using an existing database as-is.
  • Added invokable 'CurtailArchiveFiles' command so that daily file curtailment can be ran immediately.
  • Fixed spelling of 'EnableTimeReasonabilityCheck' setting.
  • Fixed errors in CSU when reading encrypted configuration file settings.

Migrating to openHistorian 2.0 in other GPA Products

Using the openHistorian.Binaries.zip download that can be found below, you can extract the needed openHistorian 2.0 assemblies needed to upgrade any openHistorian 1.0 instance running in a GPA product built using the GSF Time-Series Library, e.g., the common PPA openHistorian 1.0 instance running in an openPDC. You can also migrate existing openHistorian 1.0 .D data files into openHistorian 2.0 .D2 data files using the Archive Upgrade Utility that comes installed with the openHistorian.

To start using the openHistorian 2.0 within an existing GSF Time-Series Library based application, begin by following these steps.

Assets 5

@ritchiecarroll ritchiecarroll released this Mar 17, 2017 · 1971 commits to master since this release

Note: This is not the latest version.

Official stable release of version 2.2 of the openHistorian (v2.2.25).

See full change log since last release.

New Features and Improvements

  • GrafanaAdapters: Added full set of aggregation and operational functions that operate on a per-series or per-set for all data sources that implement Grafana interfaces. See documentation.
  • LogFileViewer: Added new enhanced general logging capabilities along with a new application, Log File Viewer, that is used to analyze logs.
  • Web UI: Updated home page to include time displays in both UTC and local time.
  • GSF.TimeSeries: Added up-time statistics for system, subscriber, publisher, input streams and output streams.
  • GSF.TimeSeries: Added a new enhanced version of the time-series special compression algorithm, automatically enabled for new connections, used with the Gateway Exchange Protocol that uses much less bandwidth. Add ; compression=true to connection string of existing GEP subscriptions to enable.
  • GSF.TimeSeries: Created a lookup cache for the main adapter meta-data using dictionary based lookups. This improved load times for input adapters on large systems (e.g., from 160 seconds to less than 1 second in some cases).
  • GSF.TimeSeries: Updated measurement definitions to carry meta-data as part of measurement key with an internal reference inside measurement implementations to reduce total memory footprint requirements for new measurements.
  • GSF.Core: Added a static timer class to allow many hundreds of scheduled events that run at the same interval to be associated with a single wait event instead of creating a new timer for each event (e.g., as hundreds of devices needing to check statistics every second) - this alleviates thread pool exhaustion that can occur when hundreds of timer events get executed at the same time.

Important Fixes

  • GSF.SortedTreeStore: Fixed bug in UnionTreeStreamSortHelper (found by @yuwenpeng) that could cause occasional data loss when duplicate records were being written to the openHistorian - in cases of encountered duplicates (i.e., by key of time and ID), there was a possibility that the duplicate record could cause a rollover operation to end prematurely.
  • DataSubscriber: Updated measurements received with GEP to apply any linear adjustments defined in the local configuration.
  • GSF.Core: Added code to ensure that log files won't become deadlocked if an error occurs during rollover.
  • GSF.TimeSeries: Updated DataSubscriber meta-data synchronization to exclude calculation and alarm signals from the device measurement removal processing such that if a local subscription creates new calculations associated with a subscribed device, the locally created measurements will not get automatically removed at the next synchronization.

Migrating to openHistorian 2.0 in other GPA Products

Using the openHistorian.Binaries.zip download that can be found below, you can extract the needed openHistorian 2.0 assemblies needed to upgrade any openHistorian 1.0 instance running in a GPA product built using the GSF Time-Series Library, e.g., the common PPA openHistorian 1.0 instance running in an openPDC. You can also migrate existing openHistorian 1.0 .D data files into openHistorian 2.0 .D2 data files using the Archive Upgrade Utility that comes installed with the openHistorian.

To start using the openHistorian 2.0 within an existing GSF Time-Series Library based application, begin by following these steps.

Assets 5

@ritchiecarroll ritchiecarroll released this Oct 16, 2016 · 2276 commits to master since this release

Note: This is not the latest version.

Official stable release of version 2.1 of the openHistorian (v2.1.1).

See full change log since last release.

New Features and Improvements

  • Includes new self-hosted web architecture which enables functionality for web based UIs and APIs, such as Data Trending and Export screen.
  • New web interfaces to support Grafana dashboards
  • Support for PostgreSQL configuration databases
  • Bulk power calculation adapter improvements including a more functional AdjustmentStrategy parameter for line-to-line and line-to-neutral adjustments
  • New dynamic e-mail responder adapter that will send an e-mail based on a custom expression
  • Simplified installation deployments signed with extended validation certificate

Important Fixes

  • Improved performance of secure implementations of Gateway Exchange Protocol for access control list lookups in service and manager implementations
  • Better phasor reduction management in manager, output streams and GEP meta-data synchronization (e.g., reducing output stream to only include positive sequence phasors)
  • Fixed issues in openHistorian 1.0 data and statistic archive deployments with potential race conditions between rollovers and reading data to prevent data access issues
  • Outage logs now properly serialize stop timestamps in UTC ensuring proper data gap recovery operations
  • NT SERVICE accounts are now assigned needed rights in installer to restart associated host service allowing restart buttons to properly function
  • Fixed issues related to creating and using a custom abstract synchrophasor configurations

Remote Console Access for Users with Viewer Roles

A new command has been added to the remote console to allow messages to be filtered down to desired results, see Filter command syntax below. In order for users with view role access to access the remote console, the filter command will need to be added to the included security resources in the main configuration file.

The simplest way to add this command is to run the XML Configuration Editor application that can be found on the start menu and add the Filter command before the Settings command in the IncludedResources configuration key in the securityProvider section of the configuration settings:

<securityProvider>
    <add name="IncludedResources" value="UpdateSettings,UpdateConfigFile=Special; Filter,Settings,Schedules,Help,Status,Version,Time,User,Health,List,Invoke,ListCommands=*; Processes,Start,ReloadCryptoCache,ReloadSettings,ResetHealthMonitor,Connect,Disconnect,Initialize,ReloadConfig,Authenticate,RefreshRoutes,TemporalSupport,LogEvent=Administrator,Editor; *=Administrator"
        description="Semicolon delimited list of resources to be secured along with role names." encrypted="false" />
</securityProvider>

Filter Command Syntax

Filters status messages coming from the service.

   Usage:
       Filter [ { -List |
                  -Include <FilterDefinition> |
                  -Exclude <FilterDefinition> |
                  -Remove <ID> } ... ]

       Filter -?

       FilterDefinition ::= Type { Alarm | Warning | Information } |
                            Message <FilterSpec> |
                            Regex <FilterSpec>

   Options:
       -List        Displays a list of the client's active filters
       -Include     Defines a filter matching messages to be displayed
       -Exclude     Defines a filter matching messages to be suppressed
       -Remove      Removes a filter
Assets 5

@ritchiecarroll ritchiecarroll released this Sep 5, 2016 · 2406 commits to master since this release

Note: This is not the latest version.

This release of the openHistorian that includes a self-hosted web based UI*. Although the new web UI is pre-release, it is functional with a fast data export. The openHistorian engine is very stable and this new version has had all the improvements included with updates to the Grid Solutions Framework libraries, including:
https://github.com/GridProtectionAlliance/gsf/wiki/Changes-since-v2.1

If you are upgrading from an older version we highly recommend migrating your database to a new schema during the configuration setup process:

  • Select "I want to use an existing configuration"
  • Choose "Database" option
  • Select "I want to upgrade to the latest schema"

The new UI has screens for trending and exporting data:

Select Measurements

Trend Measurements

Export Measurements

* The new web based UI is designed to run with a newer HTML 5 capable browser.

Assets 3
You can’t perform that action at this time.