"Digital Transformation" Will be as Hard as Earlier Efforts at Change

New BCG research suggests that 70 percent of digital transformations fall short of their objectives. 

That would not surprise any of you familiar with the general success rate of major enterprise technology projects. From 2003 to 2012, only 6.4 percent of federal IT projects with $10 million or more in labor costs were successful, according to a study by Standish, noted by Brookings.

source: BCG 

IT project success rates range between 28 percent and 30 percent, Standish also notes. The World Bank has estimated that large-scale information and communication projects (each worth over U.S. $6 million) fail or partially fail at a rate of 71 percent. 

McKinsey says that big IT projects also often run over budget. Roughly half of all large IT projects—defined as those with initial price tags exceeding $15 million—run over budget. On average, large IT projects run 45 percent over budget and seven percent over time, while delivering 56 percent less value than predicted, McKinsey says. 

Significantly, 17 percent of IT projects go so bad that they can threaten the very existence of the company, according to McKinsey. 

The same sort of challenge exists whenever telecom firms try to move into adjacent roles within the internet or computing ecosystems. As with any proposed change, the odds of success drop as the number of successful approvals or activities increases.

The rule of thumb is that 70 percent of organizational change programs fail, in part or completely. 

There is a reason for that experience. Assume you propose some change that requires just two approvals to proceed, with the odds of approval at 50 percent for each step. The odds of getting “yes” decisions in a two-step process are about 25 percent (.5x.5=.25). In other words, if only two approvals are required to make any change, and the odds of success are 50-50 for each stage, the odds of success are one in four. 

source: John Troller 

The odds of success get longer for any change process that actually requires multiple approvals. Assume there are five sets of approvals. Assume your odds of success are high--about 66 percent--at each stage. In that case, your odds of success are about one in eight for any change that requires five key approvals (.66x.66x.66x.66x.66=82/243). 

The same sorts of issues occur when any telecom firm tries to move out of its core function within the ecosystem and tries to compete in an adjacent area. 

Consultants at Bain and Company argue that the odds of success are perhaps 35 percent when moving to an immediate adjacency, but drop to about 15 percent when two steps from the present position are required and to perhaps eight percent when a move of three steps is required.

source: Bain and Company

The common thread here is that any big organizational change, whether an IT project or a move into new roles within the ecosystem, is quite risky, even if necessary. The odds of success are low, for any complex change, no matter how vital.

74% of Digital Transformation Efforts Fail

“74 percent of cloud-related transformations fail to capture expected savings or business value,” say McKinsey consultants  Matthias Kässer, Wolf Richter, Gundbert Scherf, and Christoph Schrey. 

Similarly, almost half of all respondents experienced cloud technology as more, or much more,  complex than they initially expected, while 40 percent overran their cloud budgets, some to a significant degree, they note. 

source: McKinsey 

Those results would not be unfamiliar to anyone who follows success rates of information technology initiatives, where the rule of thumb is that 70 percent of projects fail in some way.

Of the $1.3 trillion that was spent on digital transformation--using digital technologies to create new or modify existing business processes--in 2018, it is estimated that $900 billion went to waste, say Ed Lam, Li & Fung CFO, Kirk Girard is former Director of Planning and Development in Santa Clara County and Vernon Irvin Lumen Technologies president of Government, Education, and Mid & Small Business. 

That should not come as a surprise, as historically, most big information technology projects fail. BCG research suggests that 70 percent of digital transformations fall short of their objectives. 

From 2003 to 2012, only 6.4 percent of federal IT projects with $10 million or more in labor costs were successful, according to a study by Standish, noted by Brookings.

source: BCG 

IT project success rates range between 28 percent and 30 percent, Standish also notes. The World Bank has estimated that large-scale information and communication projects (each worth over U.S. $6 million) fail or partially fail at a rate of 71 percent. 

McKinsey says that big IT projects also often run over budget. Roughly half of all large IT projects—defined as those with initial price tags exceeding $15 million—run over budget. On average, large IT projects run 45 percent over budget and seven percent over time, while delivering 56 percent less value than predicted, McKinsey says. 

Beyond IT, virtually all efforts at organizational change arguably also fail. The rule of thumb is that 70 percent of organizational change programs fail, in part or completely. 

There is a reason for that experience. Assume you propose some change that requires just two approvals to proceed, with the odds of approval at 50 percent for each step. The odds of getting “yes” decisions in a two-step process are about 25 percent (.5x.5=.25). 

In other words, if only two approvals are required to make any change, and the odds of success are 50-50 for each stage, the odds of success are one in four. 

The odds of success get longer for any change process that actually requires multiple approvals. 

Assume there are five sets of approvals. Assume your odds of success are high--about 66 percent--at each stage. In that case, your odds of success are about one in eight for any change that requires five key approvals (.66x.66x.66x.66x.66=82/243). 

In a more realistic scenario where odds of approval at any key chokepoint are 50 percent, and there are 15 such approval gates, the odds of success are about 0.0000305. 

source: John Troller 

So it is not digital transformation specifically which tends to fail. Most big IT projects fail.

Digital Transformation is Hard

If you have been around information technology investments long enough, you know that outcomes often are negative: the hoped-for benefits do not emerge at all, or prove to be less than expected. Possibly 30 percent of major IT investments actually produce the expected results. 

The same continues to be true of digital transformation efforts and investments. A new survey of IT professionals suggests DX has the same outcomes. 

source: Walkme 

The study also had respondents estimating that, of all IT projects, fully 41 percent failed to meet objectives, in the form of key performance indicators. And the larger the organization, the more likely it is that DX or any other IT initiative will fail. Larger enterprise respondents reported failure rates at six times the rate of small entities. 

source: Walkme 

To be sure, the more-important KPIs deal with financial performance: productivity, equity value growth, higher income or lower costs. 

Such “failures” are not hard to understand. Most large enterprises rely significantly on third-party integrators to attempt complex initiatives. That means lots of organizational complexity. And the number of persons who must not only agree to support, but actively ande usefully support such initiatives is therefore quite high. 

source: Walkme 

And that runs squarely up against an immutable law: the more permissions one requires to get anything done, the lower the chances of success. Consider any project with a number of key influencers. Assume that at each stage, the chances of getting a “yes” are 50 percent.

If only one “yes” is required, odds of success are 50 percent. If two “yes” hurdles are required, success rates drop to 25 percent. If three “yes” hurdles exist, odds drop to 13 percent. Each successive hurdle reduces success rates further. 

As you can see, even a small number of hurdles, each with a 50-50 chance of success, quickly reduces odds of success to an impossible level. After seven hurdles, odds of success are one in 100. 

Obviously, any complex IT project has many more gates than seven. With sufficiently vigorous top-level support, the odds of success at each gate are likely higher than 50 percent. But there are so many more hurdles or gates that odds of success are low; odds of failure high. 

The conventional wisdom is that about 30 percent of big IT projects actually succeed as expected.

Most Big IT Projects--Including "Digital Transformation"--Fail

Of the $1.3 trillion that was spent on digital transformation--using digital technologies to create new or modify existing business processes--in 2018, it is estimated that $900 billion went to waste, say Ed Lam, Li & Fung CFO, Kirk Girard is former Director of Planning and Development in Santa Clara County and Vernon Irvin Lumen Technologies president of Government, Education, and Mid & Small Business. 

That should not come as a surprise, as historically, most big information technology projects fail. BCG research suggests that 70 percent of digital transformations fall short of their objectives. 

From 2003 to 2012, only 6.4 percent of federal IT projects with $10 million or more in labor costs were successful, according to a study by Standish, noted by Brookings.

source: BCG 

IT project success rates range between 28 percent and 30 percent, Standish also notes. The World Bank has estimated that large-scale information and communication projects (each worth over U.S. $6 million) fail or partially fail at a rate of 71 percent. 

McKinsey says that big IT projects also often run over budget. Roughly half of all large IT projects—defined as those with initial price tags exceeding $15 million—run over budget. On average, large IT projects run 45 percent over budget and seven percent over time, while delivering 56 percent less value than predicted, McKinsey says. 

Significantly, 17 percent of IT projects go so bad that they can threaten the very existence of the company, according to McKinsey . 

Beyond IT, virtually all efforts at organizational change arguably also fail. The rule of thumb is that 70 percent of organizational change programs fail, in part or completely. 

There is a reason for that experience. Assume you propose some change that requires just two approvals to proceed, with the odds of approval at 50 percent for each step. The odds of getting “yes” decisions in a two-step process are about 25 percent (.5x.5=.25). In other words, if only two approvals are required to make any change, and the odds of success are 50-50 for each stage, the odds of success are one in four. 

source: John Troller 

The odds of success get longer for any change process that actually requires multiple approvals. Assume there are five sets of approvals. Assume your odds of success are high--about 66 percent--at each stage. In that case, your odds of success are about one in eight for any change that requires five key approvals (.66x.66x.66x.66x.66=82/243). 

So it is not digital transformation specifically which tends to fail. Most big IT projects fail.

Sequential Hurdles Explain Low Rates of Transformation Success

A common rule of thumb is that about 70 percent of information technology projects fail to meet their objectives. Historically, most big information technology projects fail in some major way, failing to produce expected cost savings or revenue enhancements or even expected process improvements. 

Some would argue the digital transformation failure rate is the same. “74 percent of cloud-related transformations fail to capture expected savings or business value, ” say McKinsey consultants  Matthias Kässer, Wolf Richter, Gundbert Scherf, and Christoph Schrey. 

Of the $1.3 trillion that was spent on digital transformation--using digital technologies to create new or modify existing business processes--in 2018, it is estimated that $900 billion went to waste, say Ed Lam, Li & Fung CFO, Kirk Girard is former Director of Planning and Development in Santa Clara County and Vernon Irvin Lumen Technologies president of Government, Education, and Mid & Small Business. 

BCG research, for example, suggests that 70 percent of digital transformations fall short of their objectives. 

From 2003 to 2012, only 6.4 percent of federal IT projects with $10 million or more in labor costs were successful, according to a study by Standish, noted by Brookings.

Some industries arguably do better than others, especially consumer-facing businesses and industries. The success of e-commerce is one likely reason why that occurs. Compared to changing a whole business model, shifting sales partly to online mechanisms is relatively risk free.

Another common rule of thumb is that about the same percentage of digital transformation efforts also fail. Many reasons are cited. 

• Company Culture is not aligned

• CxOs do not really support it

• Silos

• Knowledge gaps about cause and effect

• Indecision or tepid initiatives

• Technology novelty not harnessed to business processes

• Expectations not in line with reality

• Not iterating fast enough

• Human capital mismatch

• Lack of continuity and consistency

• Unclear vision

• Business and IT execs do not agree on objectives

• Organizational inertia

• Lack of employee buy in

• Governance not aligned

Those concerns typically are found in every industry and firm that attempts DX, as this example from the banking industry suggests. 

 

source: Banking Circle 

There is a simple way of illustrating why innovation is so hard. If you have ever spent time and effort trying to create something new in the communications business, you know it rarely is easy, simple or uncomplicated to do so, and the larger the organization you work for, the harder it seems to be. That is because all organizational change involves power and politics, and changes will be resisted.  

There is a reason 70 percent of organizational change programs fail, in part or completely. Assume you propose some change that requires just two approvals to proceed, with the odds of approval at 50 percent for each step. The odds of getting “yes” decisions in a two-step process are about 25 percent (.5x.5=.25). 

source: John Troller 

The odds get longer for any change process that actually requires multiple approvals. Assume there are five sets of approvals. Assume your odds of success are high--about 66 percent--at each stage. In that case, your odds of success are about one in eight (.66x.66x.66x.66x.66=82/243). 

The more hurdles (approvals) required for a change to happen, the less likely the change will happen. Even when the odds of approval at any stage are 66 percent, the necessity of just five approvals will lead to seven of eight change efforts failing. 

source: BCG

Expanding into Adjacencies is Risky, But Risks Must be Taken

When firms look for growth in slow-growth businesses, one obvious option is to seek adjacent roles in the ecosystem. The other common routes to “diversify” are to add new customer segments, new roles for existing products, new products, distribution channels or geographies. 

It never is especially easy, as analysts note that the odds of success decrease as firms move further away from their present “core” competencies and roles. 

source: Harvard Business Review 

The same holds for internal reform of organizations. Consider a study by McKinsey on successful organizational change. That study suggests that about 26 percent of all attempted organizational transformations succeed, whether or not change agents have taken at least 24 discrete actions in support of the change. In that study, the suggested actions are not necessarily the same as approval hurdles. But the principle is likely at work.

source: McKinsey

This should not come as a surprise. All proposed internal changes encounter resistance. Management experts sometimes note that the chances of any successful organizational change are somewhat slim, and more difficult as the number of approvals grows. 

source: Purdue University

If you have ever spent time and effort trying to create something new in the communications business, you know it rarely is easy, simple or uncomplicated to do so, and the larger the organization you work for, the harder it seems to be. That is because all organizational change involves power and politics, and changes will be resisted.  

You might be familiar with the rule of thumb that 70 percent of organizational change programs fail, in part or completely. 

There is a reason for that experience. Assume you propose some change that requires just two approvals to proceed, with the odds of approval at 50 percent for each step. The odds of getting “yes” decisions in a two-step process are about 25 percent (.5x.5=.25). 

source: John Troller 

The odds of success get longer for any change process that actually requires multiple approvals. Assume there are five sets of approvals. Assume your odds of success are high--about 66 percent--at each stage. In that case, your odds of success are about one in eight for any change that requires five key approvals (.66x.66x.66x.66x.66=82/243). 

You might argue the difficulty of change means firms should not try to change. That might work in stable industries, for stable firms, when demand is constant and profit margins are reasonable.

But connectivity firms do not work in that environment. There essentially is no option to “do nothing.” All legacy product lines are shrinking and must be replaced. So the risk of change must be taken.

Why IT Failure is So Common

Beyond IT, virtually all efforts at organizational change arguably also fail. The rule of thumb is that 70 percent of organizational change programs fail, in part or completely. 

There is a reason for that experience. Assume you propose some change that requires just two approvals to proceed, with the odds of approval at 50 percent for each step. The odds of getting “yes” decisions in a two-step process are about 25 percent (.5x.5=.25). 

In other words, if only two approvals are required to make any change, and the odds of success are 50-50 for each stage, the odds of success are one in four. 

Consider new drug approval rates. Consider a four-phase drug approval process, where the real mortality (58 percent to 87 percent failure) is the gate from phase one to phase two. Where there are three development phases and then an “approval” process of four stages, overall success rates range from 14 percent to 21 percent. 

American Council on Science and Health 

Other examinations of drug approval success rates suggest the odds of success are less than 10 percent for a four-stage set of hurdles, up to perhaps 11 percent.  

source: Seeking Alpha 

In the venture capital business, the odds of getting funding are less than one percent. 

souce: Corporate Finance Institute

In other words, change is hard because any complex process, with multiple stakeholders--with the ability to stop any proposal--is mathematically challenging.