Why do so many enterprise data governance initiatives fail? Data governance has consistently been recognized as a critical enabler of business success — yet it remains a massive challenge for most companies — with some failing to drive any meaningful value from their governance programs.
A recent survey from Gartner found that only 18% of business-led data governance initiatives claimed to be effective at generating business value for the organization. By comparison, the same survey found that 66% of IT-led governance initiatives claim to be effective at driving business value.
The difference between IT and business perspectives on the effectiveness of data governance is stark and problematic.
While IT leaders may see more value in data governance, a continued belief by business stakeholders in the inability of governance to provide value will threaten the long-term viability of any enterprise-wide data governance initiatives. This is because business engagement in data governance programs is a requirement, not a choice.
So why does this split between business and IT views of governance effectiveness exist, and why do so many companies continue to see so little value from data governance programs?
FOR QUANTIFIABLE BUSINESS RESULTS
An ongoing failure of companies to make a quantifiable connection between a governance investment and the delivery of business value is the biggest reason for data governance failure.
If companies can’t prove that data governance yields business benefits, they will be less likely to continue investing. In lieu of any form of forecasted ROI on data governance, it ultimately becomes either an act of faith or a regulatory requirement.
However, the problem goes deeper than a failure to build a data governance business case and model its benefits. The split between IT and business user perspectives on the benefits of data governance is a strong indicator of one of the less-discussed root causes of data governance failure, known as the Data Governance Cost/Benefit Tradeoff (see figure 1).
Figure 1 — The Data Governance Cost/Benefit Tradeoff
The Data Governance Cost/Benefit tradeoff highlights that the costs of implementing and managing a data governance program are skewed towards functional business units, while the benefits tend to naturally accrue at higher, more cross-functional levels of the organization.
This is exactly what is highlighted in the Gartner data showing more favorable perspectives of data governance within IT — which is an inherently cross-functional endeavor.
DATA GOVERNANCE: CENTRALIZED VS. DECENTRALIZED
Modeling the governance benefits is often widely considered to be an industry best practice. However, this is only half of the equation.
The costs must also be modeled and understood at every level of the organization participating in a data governance program. The reason for this is a tradeoff between costs and benefits. For companies to succeed at governance, a balance between these costs and benefits must be found.
A disconnect between the costs and benefits of enterprise data governance initiatives also explains why companies are on a constant pendulum of swinging back and forth between governance programs with enterprise-wide scope, and those with more business-unit focus.
The same is true with almost all of their other data management initiatives beyond just governance, with a highly predictable pattern of yo-yo-ing between centralization and decentralization.
Companies failing to realize the cross-functional benefits of data governance will often turn to hiring a new CDO to solve the problem or where a CIO is given a similar mandate to “fix” data governance problems — often as a part of some other systems-centric initiative, like an ERP consolidation.
The CDO or CIO, given the very cross-functional nature of both roles, will then look to implement governance policies and supporting data architectures that best support cross-functional uses of data. The architectures supporting these policies tend to be more centralized, given the economies of scale these models generate.
This shift towards more cross-functional data governance policies with centralized data management architectures will produce a backlash in business units since the benefits — at a functional level — of defining, implementing and managing governance policies optimized for cross-functional use cases will be questioned.
Business functions will decry a lack of autonomy and business agility, which will then often result in companies abandoning further attempts to implement “top-down” governance — where functional units are ultimately given more freedom to manage their own data. (See figure 2)
Figure 2 — A Shift to Decentralized Governance
THE CURRENT STATE OF (FEDERATED) DATA GOVERNANCE
In many ways, figure 2 is exactly what is happening right now with the increasing focus, and market hype, on data mesh architectures.
A backlash against top-down, centralized styles of management and governance is leading many across both IT and business groups to advocate for more federated approaches — where business or domain-level freedom and benefit are accentuated, but where the costs and complexities to support more cross-functional approaches to data management are pushed into IT.
This pendulum swinging between hyper-centralized and hyper-federated approaches to managing data governance does not mean there are no benefits to decentralization. There most certainly are — and that’s why the data mesh is gaining popularity.
The problem with highly federated governance programs is the costs of data governance at a functional level are largely the same regardless of the program scope. Policies for data quality, access, retention, security, etc must all be defined and managed — the only thing that changes under a federated governance model is the scope of those policies — local versus global.
However, the benefits of localized data governance outside the functional unit are negative given the burden placed on cross-functional coordination — since those local policies will often be inconsistent with more global requirements.
More simply put, how marketing defines a customer could be completely different from how finance defines a customer. Where there was a single set of governance policies for customer data, there are now two or significantly more.
In abandoning hub-and-spoke type architectures for what the data mesh calls “federated computational governance,” a significant number of point-to-point integrations must be created across domains and business units. This will drastically increase the cost and complexity of both data management and data governance for any data that needs to be shared at a cross-functional level.
For many IT organizations, these costs will exceed the perceived benefit of local business unit autonomy. In the future, highly automated data management solutions may allow these cross-domain interactions to scale, but those solutions have yet to materialize.
DATA GOVERNANCE AS A FUTURE SOLUTION
The tradeoff between the costs of data governance, which includes governance policy definition, implementation, and management — including stewardship and the benefits of governance, which tend to be greatest at more cross-functional levels. This explains why business units see less value from it.
In theory, the fix to this problem is easy: model the cost and benefit of data governance at every level of the organization. If an imbalance exists, where the benefits at a corporate or cross-functional level exceed those of the business units, the organization must find a way to compensate functional business units for their share of the costs of governance.
In practice, the answer here is much more complex — since an optimal steady-state is a more adaptive governance model that allows for both local freedom and cross-functional benefits. Implementing truly adaptive governance models is possible, but requires high levels of organizational, financial, technical, and data management maturity that most companies lack.
The first step to improving these maturity levels is to find a way to measure both the costs and benefits of data governance at multiple levels of the organization. Until these metrics exist, the problem of data governance failure will persist.
Launching a data governance initiative at your organization? Read this 17-page data governance guide for an actionable framework you can use to get your initiative off the ground.
Malcolm Hawker
Head of Data Strategy @ Profisee
