AI / ML
GENERATIVE AI AND ML FUELLING A REVOLUTION IN DATA QUALITY
By automating and simplifying data management tasks like never before , generative AI technologies will revolutionise how organisations handle their data
WRITTEN BY : MARCUS LAW
A new data quality revolution is underway , powered by models that use generative AI and machine learning techniques such as ChatGPT . Although the use of AI in the data industry has , until now , mainly focused on predictive analytics , today we are entering an era of creative generative AI , where a powerful tool for NLP , data analysis , and automation will shape the future of data management and data quality .
Used in the data industry since the 1950s and 1960s – when they were developed to process and analyse data – early AI programs used rule-based systems , symbolic reasoning , and expert systems to make inferences and generate insights from data . Today , use of AI has accelerated dramatically : according to the Data and Analytics Leadership Annual Executive Survey 2023 , 80.5 % of data executives indicate that AI / ML will be an area of increased data and analytics investment during 2023 and it will be the highest investment priority for 16,3 % of them , followed by data quality for 10.6 % of organisations .
“ Data quality is a make-or-break aspect of data management ,” explains Davide Pelosi , Manager , Solutions Engineering at data integration and data integrity leader Talend . “ It ensures that businesses can make informed decisions based on accurate , complete , and consistent information . When data quality is poor , it can lead to errors in decision-making , loss of revenue , and damage to a brand ' s reputation .
aimagazine . com 41