Companies leave valuable data unused

According to the study conducted by Dimensional Research on behalf of Fivetran, inadequacies in the data infrastructure make it difficult to easily access corporate data for analysis. 44 percent of the data professionals surveyed said that key data cannot be used for decision-making.

Another 68 percent said that additional business insights could be extracted from existing data if they had more time. When transforming data from disparate systems into an analysis-ready format, data engineers face difficulties in making the data available.

According to the survey, data engineers face multiple challenges. 98 percent of respondents have problems building pipelines to deliver data. Ninety-eight percent complain about broken pipelines, with 51 percent of respondents reporting that this occurs more than once a month. The main reasons cited are unavailable data sources and changes to the data schema.