Last year, the NYT shined a light on big data's “janitor” problem – that data scientists and business intelligence pros spend too much time cleaning, not evaluating data. But how big of an issue is it, really?
Great article from Big Data Analytics News.
I have to admit the cleaning and preparation of data does take time that could be spent doing more productive things. However until data sources are as rigorous as the data professionals that use the data we are stuck in this scenario as we have to clean the data to make useful conclusions from it.
No comments:
Post a Comment
Note: only a member of this blog may post a comment.