An overwhelming majority of C-level data executives (82%) say data quality concerns represent a barrier to data integration projects — the precursor to digital transformation initiatives and deriving insights to power sound business decisions
The exponential growth of business data, coupled with advancements in cloud computing, Artificial Intelligence (AI), and the Internet of Things has unleashed an era of digital transformation across the globe. This is why data integrity is an urgent business imperative, because digital transformation initiatives and myriad business activities designed to set strategy, retain customers, and grow the business require trusted data to be successful.
However, according to new research by Precisely and Corinium Global Intelligence, an overwhelming majority of C-level data executives (82%) say data quality concerns represent a barrier to data integration projects — the precursor to digital transformation initiatives and deriving insights to power sound business decisions. Nearly as many (80%) also find it challenging to ensure data is consistently enriched with proper context at scale, which powers more informed business decisions.
Data Integrity Trends: Chief Data Officer Perspectives in 2021, which surveyed more than 300 Chief Data Officers (CDO) at companies with more than 2,500 employees across industries in the Americas, EMEA, and Asia-Pacific, also found that 65% of staff will only trust data-driven insights that confirm their existing gut feel. This begs the question of how to build ironclad trust in data that will encourage executives, as well as their frontline staff, to move confidently forward with data-backed insights that uncover hidden or unexpected connections.
“There’s a genuine sense of urgency as businesses in all industries and all regions engage in significant digital transformation initiatives,” says Amy O’Connor, Chief Data and Information Officer at Precisely. “However, these programs must be built on a foundation of data integrity if they are to be successful.”
Data-driven initiatives fuel accelerating need for trusted data
The new research highlights some of the specific initiatives that CDOs are prioritizing in 2021 as they work to digitally transform their organizations. Top of the list for CDOs is meeting customer experience (CX) demands or expectations, which was identified as a top priority this year by just over 63% of respondents. Launching or scaling artificial intelligence (AI) and advanced analytics is also a worldwide priority, with nearly 58% of respondents actively engaged in such projects this year. Nearly half of respondents in the report indicated their organizations are taking on initiatives in 2021 to:
- Meet compliance and regulatory requirements (48.68%)
- Enabling a remote or distributed workforce (48.36%)
- Facilitating micro-targeted or personalized customer communications (48.36%)
- Integrate or divest due to mergers & acquisitions (47.7%)
- Building a 360-degree view of customers (46.38%)
The wide variety of digital transformation initiatives being prioritized in 2021 highlights the growing importance of the Chief Data Officer function and the need for a foundation of trusted data to ensure the projects are successful.
Significant challenges stifle data-driven insights and innovation
The report revealed that despite the large number of digital transformation initiatives underway at the world’s leading enterprises, significant barriers and challenges still exist to achieving data integrity and ensuring the projects’ success. The new report revealed that:
- Data teams spend too much time on average (40%) cleaning and prepping data for analysis, with some reporting as high as 80%.
- Nearly two-thirds of respondents (65%) said staff will only trust insights from data if it confirms their gut feel.
- Data quality concerns are hampering data integration programs for 82% of CDOs.
- Almost 9 in 10 CDOs say they are challenged by a lack of staff with the right skills.
- 4 in 5 enterprises struggle to enrich their existing data at scale to uncover new insights and hidden patterns.
Industries are advancing toward data integrity at different paces
The report shows that while digital transformation is a priority across the board, industries are advancing at differing paces and experiencing varying results. Software and technology companies lead the way on establishing an analytics program that reveals insights with almost 80% of respondents saying they have been at least “quite successful” to-date. Transportation and logistics companies follow, reporting a 65% success rate. Retail lags all other industries with 55% of CDOs reporting results have been mixed or disappointing. Financial Services, Telecommunications, Insurance, and Healthcare all reported success rates of about 60%.
The report paints a different picture in terms of how successful companies are at integrating analytics programs into existing processes and driving enterprise-wide adoption. In this capacity, Retailers report a 60% success rate, trailing only Financial Services at 66%. Software and technology companies reported success rates of only 47%, with transportation and logistics companies at 43%. Government and education showed the most struggle, with less than 30% reporting success.
Regional differences exist but are less pronounced than among industries
The new report finds the trend toward digital transformation is worldwide, with less variation by region than by industry. Among the three regions examined in the report, the Americas, EMEA and APAC, companies in EMEA spend the most time cleaning and preparing data for analytics at 42%, with the Americas reporting a similar 41%. Companies in APAC reported considerably less time (29%) preparing data for analysis.
There is a worldwide shortage of skilled staff, with the three regions reporting similar challenges in finding the right staff for their objectives. Across regions, 85-90% of CDOs reported finding it “very challenging” or “quite challenging” to find staff with the right skills. The report found greater variation in CDOs ability to access the right tools or services for successful digital transformations. In the Americas, 76% of CDOs reported being challenged to find the right tools and services, compared to 70% in APAC and 69% in EMEA.