A gap in the data is defined as a single missing or series of consecutive missing interval meter readings from a periodic channel.
For example:
Note, it is not limited to half-hourly only, if your data is received every 15 minutes, or 5 minutes, then the system will support this.
Adding a Monitoring StrategyFrom the Strategy Configuration Tab, click Choose the Strategy Type from the dropdown Click OK to take you to the Monitoring Strategy Editor Monitoring Strategy DetailsThe top section of the Monitoring Strategy Editor is common to all the different monitoring strategy types that can be setup. The details that need to be entered are as follows:
Channel Context ConfigurationIt is possible to define which periodic channels the strategy should run for. This will help you ensure your strategies continue to run as your energy estate evolves and assets change/get added.
Setting up Flexible configuration:Choose Flexible from the Context dropdown, Click on to show the Flexible Context Configuration popup Either: Tick Yes to run for all Channels Alternatively, leave as No and choose your own configuration using the dropdown options based on the attributes of the channel and their relates assets. The available options are: Commodity, Data type, Unit, Site Property Keys, Meter Property Keys, Channel Property Keys. For example, the above configuration would include all Electricity and Gas Channels that have a unit set to kWh. As new channels that match these parameters are added to your estate, the monitoring strategy would automatically include them when it runs. Click Save to return to the Monitoring Strategy Editor to continue configuring the Strategy. Email OptionsIf you want to be notified of new issues by email, you can choose how often you should get an email and who the email should be sent to. Tick Enter the email address(es) you want to send the notification to. Any email addresses entered here will receive a summary of all notifications raised across the entire estate. Note: for more than one email, add a comma between the addresses Tick if you want to send an email to the Site Contact (entered in the Location tab in the Site Editor). If this option is selected, the site contact will receive an email containing a summary of notifications only for the sites that they are responsible for. Recurrence: Choose from Daily, Weekly or Monthly (each option then has further choices for the configuration to configure exactly when the email will be sent). Emails will contain a summary of new notifications that have been raised since the last email was received. It will also contain a summary of all the outstanding notifications. |
The Item Editor also contains a Data Gap Configuration section that allows you to set the specific configuration to use when finding and managing the gaps.
Field | Default | Description | |
---|---|---|---|
Offset (Days) | 1 | Choose the offset between the end date of the gap and the current date. This is to enable a lag time between the date that is being checked and when the check is being performed to give the chance for metering systems to correct themselves. For example, a metering system may be set up to send a daily drop of information, and then a weekly summary for the previous 7 days to correct any potential errors. In this case, the offset could be set to 7 days to allow the weekly summary upload the chance to correct the data before any problems are identified. | |
Also Include | All Unchecked | Define the combination of data values that should be considered missing data. Options include:
| |
Auto Fill Type | Do Not Auto Fill | Choose from:
| |
Auto Fill - Weeks to Average | 4 | Specify the number of weeks that should be used to create a period average when automatically filling data gaps. More information about how this feeds into the system processing that it supports when filling the data can be seen here. | |
Check Period (Months) | 12 | The number of preceding months that Sigma will check for gaps. For example, if you choose 12, Sigma will check the previous 12 months for any gaps |
Click OK to save the Monitoring Strategy.
If data gaps are found for one of the strategies, then notifications will be raised that are visible in the Notification Tab.
Where the strategy was configured to auto-fill all gaps for you, then the notification will still be raised in a resolved state, to provide visibility of what the system has done, providing a full audit.
Resolving Data GapsWhere the strategy was configured not to auto-fill all gaps for you, then these can be manually resolved using the "Resolve" functionality available. Highlight the applicable Data Gap Notification(s) in the list. Click Action Notifications to open the Resolve Notifications popup
The Resolve Notifications popup will be displayed, showing a list of the Notifications being resolved. The graph at the top shows the periodic data for the channel linked to the notification selected. The red area shows where the Gap is. Drag the mouse around the area to zoom in. Click to reset the zoom back to the default. Actions - Data GapUpdate Period Average SettingYou can change the number of Weeks used as a basis for calculating the data to use when filling the gap, select all the Notification records it should apply to then click Update. This will update the period to use when calculating the averaged data to fill the gap.
PreviewIf you want to see what the filled data will look like, click first. This will show you what the filled gap would look like for the Notification that has been selected in the list. The filled period is highlighted in green. Drag the mouse around the area to zoom in. FillClick to fill the gaps. The Resolve Notifications pop up appears: A Note can be optionally entered if required and will be stored against the Notification. Click OK. The following confirmation popup will be displayed: Click OK. CancelClick to cancel without making any changes. You will be returned to the list of all Notifications. |