Typical data exchange scenarios between systems
- One-time data migration – useful when launching a new system; facilitates data continuity.
- Data import – periodically retrieving data from one system and adding it to another.
- Data synchronization – a continuous process where a mechanism tracks changes in the source system in real-time and transfers them to the destination system.
- Data transformation – reading data from the source system, transforming it, and writing it to the destination system (e.g., reading data from a transaction system, grouping it, and saving it to a reporting system).
Issues arising during data transfer
- The destination system requires information that is missing from the source system.
- The source system does not provide a data export interface.
- The source data is unstructured or disorganized (e.g., working Excel spreadsheets where data entered by different people follows different formats).
- The destination system has stricter data validation rules.
- Ambiguous data mapping; fields in the two systems may share similar names but store different data.
- Technical documentation is incomplete or non-existent.