Differences

This shows you the differences between two versions of the page.

--- iphist:index [2021/06/25 15:39] – [STDDEV] su
+++ iphist:index [2022/08/29 12:05] (current) – [Licensing] su
@@ Line 4: / Line 4: @@
 ===== Introduction =====
+Intelligent Plant's data historian is integrated as a part of Data Core. As such, it can take advantage of Data Core's data streaming capabilities to observe and record incoming tag values from any other supported data source.
+For many data sources (such as Modbus, MQTT, and more), it is possible to automatically forward tag values from the source using a simple one-click configuration.
+Additionally, IP Historian tags can be configured up-front to define a source data source and tag name, allowing new source-to-destination tag mappings to be configured automatically as you create new historian tags.
@@ Line 15: / Line 21: @@
+===== Data Query Types =====
+IP Historian supports a number of different types of data queries.
+==== Snapshot ====
+Snapshot queries return the current values of the tags polled.
+==== Raw ====
+A raw query returns the unprocessed data for a tag i.e. the actual data points persisted in the historian's archive.
+Raw queries are generally not advised as they are likely to return a bulky result-set that may well be cropped by size constraints. In the majority of cases, a plot or aggregated data query can return a data set that is acceptable for the task at hand.
+==== Plot ====
+Plot queries return a best-fit data set for a given query time range and level of granularity, suitable for visualisation in a chart. For every interval in the chart, the minimum and maximum values for a tag will be returned, as well as values that best represent the shape of the raw data (as far as is possible based on the requested granularity).
+==== Values-at-Times ====
+A values-at-times query is used to retrieve the value of a tag at specified points in time. IP Historian will return the closest raw value at or before each specified sample time.
+==== Aggregated ====
+Aggregated queries can be used to perform ad hoc processing and filtering of raw historical data based on a query time range and sample interval. IP Historian supports a number of aggregation functions, as described below:
+== ANNOTATIONCOUNT ==
+Groups the raw data for a tag into buckets using the specified sample interval and returns the number of annotations defined on a tag in each bucket.
+== AVG ==
+Groups the raw data for a tag into buckets using the specified sample interval and computes the mean value of a tag in each bucket.
+== COUNT ==
+Groups the raw data for a tag into buckets using the specified sample interval and returns the number of raw samples in each bucket.
+== DELTA ==
+Groups the raw data for a tag into buckets using the specified sample interval and returns the signed difference between the first and last raw samples in each bucket.
+== INTERP ==
+Groups the raw data for a tag into buckets using the specified sample interval and interpolates a value at each bucket start and/or end time using the values from the previous and current buckets.
+== MIN ==
+Groups the raw data for a tag into buckets using the specified sample interval and returns the minimum value from each bucket. Note that the original raw samples are returned, so the values are the "true" minimum values.
+== MAX ==
+Groups the raw data for a tag into buckets using the specified sample interval and returns the maximum value from each bucket. Note that the original raw samples are returned, so the values are the "true" maximum values.
+== PERCENTBAD ==
+Groups the raw data for a tag into buckets using the specified sample interval and computes the percentage of raw samples in each bucket that have a quality flag set to "bad".
+== PERCENTGOOD ==
+Groups the raw data for a tag into buckets using the specified sample interval and computes the percentage of raw samples in each bucket that have a quality flag set to "good".
+== RANGE ==
+Groups the raw data for a tag into buckets using the specified sample interval and returns the absolute difference between the first and last raw samples in each bucket.
+== STDDEV ==
+Groups the raw data for a tag into buckets using the specified sample interval and returns the standard deviation for each bucket.
+== TAVG ==
+Calculates a time-based rolling average for a tag.
+== VARIANCE ==
+Groups the raw data for a tag into buckets using the specified sample interval and returns the variance for each bucket.
+==== Annotations ====
+IP Historian allows annotations to be recorded against tags at specific points in time. Annotations can be used to track or highlight events a tag value exceeding an operating limit, an action taken as part of a workflow, and so on.
-=====Historical Vs. Snapshot=====
+==== Specifying Query Time Ranges ====
+As part of the Data Core data connectivity layer, IP Historian can accept query time ranges specified as both absolute timestamps (using standard ISO 8601 formatting), or as relative timestamps (e.g. 30 minutes before the current time).
-=====Functions and Aggregations=====
-==== SNAPSHOT ====
+===== Archiving Model =====
-Snapshot queries are used to request the current value of an instrument (or instruments). For example, you might have a digital thermometer that you can poll to find out what the current temperature is. When you perform a snapshot query, you don't need to specify any parameters other than the names of the instruments that you want to poll.
+IP Historian supports multiple indexing models depending on the requirements of the data being recorded:
-==== AVG ====
+  * "One Big Index" - optimised for constant or infrequently-changing values.
+  * "Index per Day/Month/Year" - stores data in an index that will periodically roll over to provide the best balance between data storage and query performance.
-Returns the average value at interavals defined by the query interval ie adds up all values and returns the average
+When recording process data, we normally recommend "Index per Month" as the optimal indexing period.
-==== MIN ====
-Returns the minimum value for each interval (the lowest value observed in that time)
-note, with the two filters applied - there is no loss in resolution of the minimum value, that minimum is still recorded and delivered.
-==== MAX ====
-Returns the maximum value for each interval - as above this is the maximum observed value in that interval
+===== Backing Up =====
-==== STDDEV ====
+Indexes can be backed up and restored on another IP Historian instance.
-Returns the standard deviation of the values in each interval
-==== INTERP ====
+===== System Requirements =====
-==== PLOT ====
+See [[app_store_connect:system_requirements|See App Store Connect System Requirements]].
-Plot is a special type of function that returns the minimum number of data points (for a given set of parameters) required to graphically plot an accurate time-series trend. This will be up to 4 points per interval where the values are: Max, Min, First, Last.
+However, note the system requirements should be adjusted for the particular use-case of the historian. If you intend to support historization of large data volumes and intensive data queries, a more powerful spec is required. Please consult with the Intelligent Plant support team for detailed guidance.
-Consider the following example. The highlighted points would be returned in a plot query.
+===== Configuration Best Practice =====
-{{ :iphist:plot.png |}}
+Details to follow.
-==== RAW ====
-A raw query returns the unprocessed data for a tag. That is, the actual data points persisted in the historian. Note that this is unlikely to be same as the rate at which a sensor data emits readings as a correctly configured historian will be exercising Compression and Exception (see above).
+===== Licensing =====
-Raw queries are generally not advised as they are likely to return a bulky result-set that may well be cropped by size constraints. If connecting to a Process Data Historian, it is far more efficient to request “Get Processed Data” with an “INTERP” function instead.
+When connecting IP Historian to the Industrial App Store, there is no licensing cost. An initial 1000 tag licence is supplied, but can be increased free of charge by client request.
+IP Historian deployments that are not directly connected to the Industrial App Store (e.g. deployments on a PIN or PCN) require a paid-for licence that is issued in 1000 tag increments.
-=====Specifying Date-Ranges=====
-Historical data queries will expect a date-range.
+==== How to find your Machine ID ====
-For ''start'' and ''end'', you can specify either an absolute value or a relative value.  Absolute values should be specified in ISO 8601 format (i.e. ''yyyy-MM-ddTHH:mm:ss'').  You can also include a suffix of ''Z'' to indicate a UTC time stamp, or you can specify an offset from UTC.  If no time zone information is provided, the date is assumed to be UTC.  For example, if you wanted to specify 3:30:35am on 01 August 2017 in Central US time, you could specify ''2017-08-01T03:30:35-06:00''.
+It is necessary to know the Machine ID of your system for licensing to be completed. To find your Machine ID, you must first open App Store Connect and select "Configure Data Core".
-Relative values can be specified using ''*'' to represent the current time.  For example: ''*-1d'' = "1 day before current time", ''*-27.5m'' = "27.5 minutes before current time", and so on.  Possible time units when specifying a relative time stamp are: ''d'', ''h'', ''m'', ''s'', ''ms''.
+Go to your Data Sources and click "Details" on the historian that you wish to use.
-=====Archiving Model=====
+{{:app_store_connect:data_core_-_data_sources_selection.png?300|}}
-=====Backing Up=====
+{{:app_store_connect:data_core_-_details.png?500|}}
+Under Action, click "Configure Data Source Settings"
-=====System Requirements=====
+{{:app_store_connect:data_core_-_configure_settings.png?300|}}
+And at the bottom you will see the Machine ID for your system.
-=====Licensing=====
+{{:app_store_connect:data_core_-_machine_id.png?800|}}
+=====IPHist - IPHist replication=====
+Connections can be setup in datacore to provide reslient transfer of historical data between IPHist instances. this means that a loss in connectivity will not result in a permanent loss of data on the remote IPHist to the datasource. that data will be back filled, and consistent.
+For further information regarding replication and data resilience, contact support@intelligentplant.com.
+=====Other historian - IPHist replication, or vice-versa =====