...
Note, it is not limited to half-hourly only, if your data is received every 15 minutes, or 5 minutes, then the system will support this.
Adding a Data Gap Strategy
...
The Item Editor also contains a Data Gap Configuration section that allows you to set the specific configuration to use when finding and managing the gaps.
Image Modified
| Field | Default | Description |
|---|
| Offset (Days) | 1 | Choose the offset between the end date of the gap and the current date. This is to enable a lag time between the date that is being checked and when the check is being performed to give the chance for metering systems to correct themselves. For example, a metering system may be set up to send a daily drop of information, and then a weekly summary for the previous 7 days to correct any potential errors. In this case, the offset could be set to 7 days to allow the weekly summary upload the chance to correct the data before any problems are identified. |
| Also Include | All Unchecked | Define the combination of data values that should be considered missing data. Options include: - Zero - No Error
- Checks for recorded values of '0' AND a status of 'No Error'. This represents data that the source metering system has sent as an actual meter reading value of zero. This should be used with caution as could represent valid data - it is intended to check meters which never expect to receive readings with a value of zero based on their operation.
|
| Auto Fill Type | Do Not Auto Fill | Choose from: - Do Not Auto Fill
- An open Notification will be created which will be visible in the Notifications Tab for you to deal with and resolve manually (note gaps can be resolved in bulk)
- Auto Fill Recurring Gaps
- Sigma will automatically 're-fill' any data gaps that have previously been manually resolved by a User as soon as they are identified. A resolved Notification will be created to provide a full audit.
- This is to ensure data gaps aren't re-created if the source data is re-loaded with the same gaps that a User has already resolved
- Auto Fill All Gaps
- Sigma will automatically fill all gaps that are identified. A resolved Notification will be created to provide a full audit.
| Note |
|---|
Please note, where the system is configured to fill all gaps automatically, if it finds a channel with more than 100 different gaps that need to be filled at the same time, then the system will not attempt to fill the gaps, but will instead raise the notification with a status of "New" so they can be manually reviewed and the necessary action taken. This is to highlight a potential fundamental problem with the ongoing recording of the metering data, or where a strategy may be incorrectly configured. It prevents the system from manipulating the data which cannot then be reversed. |
|
| Auto Fill - Weeks to Average | 4 | Specify the number of weeks that should be used to create a period average when automatically filling data gaps. More information about how this feeds into the system processing that it supports when filling the data can be seen here. |
| Check Period (Months) | 12 | The number of preceding months that Sigma will check for gaps. For example, if you choose 12, Sigma will check the previous 12 months for any gaps |
...