ETL Process

ETL

  1. Extract: extract data from sources
  2. Transform: transform it to proper format
  3. Load: load it to data storage infrastructure

E for Extract

  1. Should not affect the source system.

T for Transform

  1. Cleaning
  2. Filtering
  3. Enriching
  4. Splitting
  5. Joining

L for Load

Deal with sync and waiting