A gap in the data is defined as a single missing or series of consecutive missing interval meter readings from a periodic channel.
For example:
- a A periodic channel which is recording data every half hour - If there are any half hour periods without a reading, then this would be deemed a gap
- a A periodic channel which is recording data daily - If there are any days missing a reading, then this would be deemed a gap
Note, it is not limited to half-hourly only, if your data is received every 15 minutes, or 5 minutes, then the system will support this.
Table of Contents
...
Creating a Data Gap Strategy
| Excerpt | |||||||||||||||||||||||||||||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| |||||||||||||||||||||||||||||||||||||||||||||
Creating the Strategy
Monitoring Strategy DetailsThe top section of the Monitoring Strategy Editor is common to all the different monitoring strategy types that can be setup.
The details that need to be entered are as follows:
Anchor |
|
| Anchor | ||||
|---|---|---|---|---|
|
If you want to be notified of new issues by email, you can choose how often you should get an email and who the email should be sent to.
- Tick
- Enter the email address(es) you want to send the notification to. Any email addresses entered here will receive a summary of all notifications raised across the entire estate. Note: for more than one email, add a comma between the addresses
- Tick
if you want to send an email to the Site Contact (entered in the Location tab in the Site Editor). If this option is selected, the site contact will receive an email containing a summary of notifications only for the sites that they are responsible for
- Recurrence: Choose from Daily, Weekly or Monthly (each option then has further choices for the configuration to configure exactly when the email will be sent).
Emails will contain a summary of new notifications that have been raised since the last email was received. It will also contain a summary of all the outstanding notifications.
Data Gap Configuration
The Item Editor also contains a Data Gap Configuration section that allows you to set the specific configuration to use when finding and managing the gaps.
| Field | Default | Description | ||
|---|---|---|---|---|
| Offset (Days) | 1 | Choose the offset between the end date of the gap and the current date. This is to enable a lag time between the date that is being checked and when the check is being performed to give the chance for metering systems to correct themselves. For example, a metering system may be set up to send a daily drop of information, and then a weekly summary for the previous 7 days to correct any potential errors. In this case, the offset could be set to 7 days to allow the weekly summary upload the chance to correct the data before any problems are identified. | ||
| Also Include | All Unchecked | Define the combination of data values that should be considered missing data. Options include:
| ||
| Auto Fill Type | Do Not Auto Fill | Choose from:
| ||
| Auto Fill - Weeks to Average | 4 | Specify the number of weeks that should be used to create a period average when automatically filling data gaps. More information about how this feeds into the system processing that it supports when filling the data can be seen here. | ||
| Check Period (Months) | 12 | The number of preceding months that Sigma will check for gaps. For example, if you choose 12, Sigma will check the previous 12 months for any gaps |
- Click OK to save the Monitoring Strategy
...
Data Gap Notifications
If data gaps are found for one of the strategies, then notifications will be raised that are visible in the Notification Tab.
Where the strategy was configured to auto-fill all gaps for you, then the notification will still be raised in a resolved state, to provide visibility of what the system has done, providing a full audit.
...
Where the strategy was configured not to auto-fill all gaps for you, then these can be manually resolved using the "Resolve" functionality available.
Highlight the applicable Data Gap Notification(s) in the list.
Click 
Action Notifications to open the Resolve Notifications popup
| Info |
|---|
If you select notifications which include types other than gaps, then a prompt will be displayed to confirm which strategy type you want to work with as the options available are contextual to the type of data issue being worked.
|
The Resolve Notifications popup will be displayed, showing a list of the Notifications being resolved.
The graph at the top shows the periodic data for the channel linked to the notification selected. The red area shows where the Gap is.
Drag the mouse around the area to zoom in.
Click 
to reset the zoom back to the default.
Actions - Data Gap
Update Period Average Setting
You can change the number of Weeks used as a basis for calculating the data to use when filling the gap, select all the Notification records it should apply to then click Update. This will update the period to use when calculating the averaged data to fill the gap.
| Tip | ||
|---|---|---|
| ||
Use the "Select All" toggle at the bottom of the notifications panel if you want to quickly select all notifications. |
Preview
If you want to see what the filled data will look like, click 
first.
This will show you what the filled gap would look like for the Notification that has been selected in the list. The filled period is highlighted in green.
Drag the mouse around the area to zoom in.
Fill
Click 
to fill the gaps.
The Resolve Notifications pop up appears:
A Note can be optionally entered if required and will be stored against the Notification.
Click OK.
The following confirmation popup will be displayed:
Click OK.
Cancel
...