Table 5 Examples of extracted data validations
From: Dynamic-ETL: a hybrid approach for health data extraction, transformation and loading
Validation Rule | Type of error | Description |
|---|---|---|
Data in a date or timestamp column cannot be parsed as a date | Error | Invalid date data will fail date operators and functions |
Data is missing in a field defined as required by the schema | Error | Missing data in required fields will violate database constraints of target schema |
A column in the schema has a missing length, precision or scale | Warning | Default length, precision or scale can be used |
Data in a numeric or decimal column is not a number | Error | Invalid numeric data will fail numeric operators and functions |
Data is too long for text or varchar field | Error | Data loss will occur if long text values are truncated to meet length requirement |