Sigma Online User Manual
Creating a Gaps in Data Strategy
A gap in the data is defined as a single missing or series of consecutive missing interval meter readings from a periodic channel.
For example:
A periodic channel which is recording data every half hour - If there are any half hour periods without a reading, then this would be deemed a gap
A periodic channel which is recording data daily - If there are any days missing a reading, then this would be deemed a gap
Note, it is not limited to half-hourly only, if your data is received every 15 minutes, or 5 minutes, then the system will support this.
Creating a Data Gap Strategy
Data Gap Configuration
The Item Editor also contains a Data Gap Configuration section that allows you to set the specific configuration to use when finding and managing the gaps.
Field | Default | Description |
|---|---|---|
Offset (Days) | 1 | Choose the offset between the end date of the gap and the current date. This is to enable a lag time between the date that is being checked and when the check is being performed to give the chance for metering systems to correct themselves. For example, a metering system may be set up to send a daily drop of information, and then a weekly summary for the previous 7 days to correct any potential errors. In this case, the offset could be set to 7 days to allow the weekly summary upload the chance to correct the data before any problems are identified. |
Also Include | All Unchecked | Define the combination of data values that should be considered missing data. Options include:
|
Auto Fill Type | Do Not Auto Fill | Choose from:
Please note, where the system is configured to fill all gaps automatically, if it finds a channel with more than 100 different gaps that need to be filled at the same time, then the system will not attempt to fill the gaps, but will instead raise the notification with a status of "New" so they can be manually reviewed and the necessary action taken. This is to highlight a potential fundamental problem with the ongoing recording of the metering data, or where a strategy may be incorrectly configured. It prevents the system from manipulating the data which cannot then be reversed. |
Auto Fill - Weeks to Average | 4 | Specify the number of weeks that should be used to create a period average when automatically filling data gaps. More information about how this feeds into the system processing that it supports when filling the data can be seen here. |
Check Period (Months) | 12 | The number of preceding months that Sigma will check for gaps. For example, if you choose 12, Sigma will check the previous 12 months for any gaps |
Click OK to save the Monitoring Strategy