Today, optical character recognition, in combination with natural language processing, allows businesses to perform complex data extraction tasks.
A great idea - use OCR to scan in old paper documents to fill the gaps in your online data - you will never get accurate results on analytics if you are missing data.
This is a blog containing data related news and information that I find interesting or relevant. Links are given to original sites containing source information for which I can take no responsibility. Any opinion expressed is my own.
Friday, 7 September 2018
Thursday, 6 September 2018
o succeed at digital transformation, do a better job of data governance by Darren Cooper via @infomgmt
To set the stage for initiatives like AI and machine learning, companies need a rock-solid governance framework.
Great suggestions by Darren in this article.
Great suggestions by Darren in this article.
Wednesday, 5 September 2018
GDPR compliance the perfect opportunity to modernise data architecture by Amandeep Khurana via @infomgmt
Compliance with the data privacy and security mandate enables organisations to become more agile in their product and service development and rollouts, and more efficient and effective in their ability to respond to market trends and competitive threats.
Yes this is exactly right - everything has to turn onto it's head and be data centric not application centric. I think we need to concentrate on:
WHERE is the data created
WHERE is it also stored (so where is it interfaced to)
HOW it is updated
WHAT changes when it is updated
HOW do you delete the data in ALL systems?
I would suggest you do something like a data flow diagram so you can document all of this for every piece of data.
Yes this is exactly right - everything has to turn onto it's head and be data centric not application centric. I think we need to concentrate on:
WHERE is the data created
WHERE is it also stored (so where is it interfaced to)
HOW it is updated
WHAT changes when it is updated
HOW do you delete the data in ALL systems?
I would suggest you do something like a data flow diagram so you can document all of this for every piece of data.
Tuesday, 4 September 2018
The bias problem with artificial intelligence, and how to solve it by Sanjay Srivastava via @infomgmt
AI bias may come from incomplete datasets or incorrect values. Bias may also emerge through interactions overtime, skewing the machine’s learning. Moreover, a sudden business change, such as a new law or business rule, or ineffective training algorithms can also cause bias.
I agree - you need good quality and representative training data if you want to get good results from any AI and ML you want to use. My advice would be:
1. Take your time - rushing always leads to mistakes so be realistic with plans.
2. Be careful with the methodology you use to create and split your data into Training and Data.
3. Try to use separate teams to test the same piece of code - the hope being that it will help to avoid the bias. Think of it as a human version of a small parallel ML solution.
4. Check, check and check again.
I agree - you need good quality and representative training data if you want to get good results from any AI and ML you want to use. My advice would be:
1. Take your time - rushing always leads to mistakes so be realistic with plans.
2. Be careful with the methodology you use to create and split your data into Training and Data.
3. Try to use separate teams to test the same piece of code - the hope being that it will help to avoid the bias. Think of it as a human version of a small parallel ML solution.
4. Check, check and check again.
Monday, 3 September 2018
Community lenders tell big tech vendors to get up to speed by Nathan DiCamillo via @infomgmt
Small banks and credit unions say slow responses and outdated products from the establishment tech vendor can become a drag on their innovation efforts.
I partially agree with him - yes large organisations move slow (particularly when you are a small customer and therefore your business is not a big loss to them if you move on) but small ones are less stable and sometimes that can be an unacceptable risk to the business (particularly in the financial sector where you just cannot afford an issue). So do really careful risk management and have SLAs to protect yourself.
I partially agree with him - yes large organisations move slow (particularly when you are a small customer and therefore your business is not a big loss to them if you move on) but small ones are less stable and sometimes that can be an unacceptable risk to the business (particularly in the financial sector where you just cannot afford an issue). So do really careful risk management and have SLAs to protect yourself.
Friday, 31 August 2018
WEBINAR: Getting Data Down to a Science – Code-free and Code-friendly ML - 5th September 2018

|
Join here
Saturday, 18 August 2018
WEBINAR: Production ML for Data Scientists: What You Can Do and How to Make it Easy - 22 August 2018
| ||||||||
|
Subscribe to:
Posts (Atom)