Sunday 30 April 2017

Data Lineage Demystified: The What, Why, and How by Michelle Knight via @Dataversity

Trusting Big Data requires understanding its Data Lineage. Without Data Lineage, Big Data becomes synonymous with the last phrase in a game of telephone.

Michelle is right - you have to know the system of record and the data flow for the data that you are using, and you need to know that for ALL data that you use.  You need to also understand the quality of that data and what to do when values are missing (preferably that should never happen but we all live in the real world with legacy systems).

No comments:

Post a Comment

Note: only a member of this blog may post a comment.