What Do We Know About Change?

[This is a follow up to my post last week.]

Even if we understand that what seems like resistance to change is more nuanced and complicated, many of us are directly or implicitly being asked to lead the changes in places of work. In that sense, we are “change agents” to use a well-established phrase.

Consider the number of times each day, both on the job and outside, that we hear the word “change” and the necessity for leaders to help their organizations change in the face of all sorts of challenges.

There has been a slew of popular business books providing guidance to would-be change agents. Several consultants and business gurus have developed their own model of the change process, usually outlining some necessary progression and steps that they have observed will lead to success.

Curiously, the same few anecdotes seem to pop up in a number of these, like burning platforms or the boardroom display of gloves.

While these authors mean well and have tried to be good reporters of what they have observed, change agents often find that, in practice, the suggestions in these books and articles are at best a starting point and don’t quite match the situation they face.

Part of the problem is that there has been too little rigorous behavioral work about how and why people change. (In fairness, some authors, like the Heath brothers, at least try to apply behavioral concepts in their recommendations on how to lead change.)

And on a practical level, many change agents find it difficult to figure out the tactics they need to use to improve the chances that the desired change will occur. In this post, I’m suggesting that we first need to understand the unique and sometimes unexpected ways that the human brain processes information and thus how we need to communicate.

(These are often called cognitive biases, but that is a pejorative phrase that might put you in the wrong mindset. It’s not a good idea starting an effort to convince people to join you in changing an organization by assuming that they are somehow irrational.)

As just one example, some of the most interesting work along these lines was that done by the Nobel-prize winning psychologist Daniel Kahneman and his colleague Amos Tversky.

They found in their research that people exaggerate potential losses beyond reality – often times incorrectly guessing that what they control (like driving a car) is less risky than what they don’t control (being a passenger in an airplane).

Moreover, a person’s sense of loss is greater if what might be lost has been owned or used for a long time (aka entitlements). Regret and other emotions can also enhance this sense of loss.

The estimate of losses and gains is also affected by a person’s reference point, which can be shifted by even random effects. The classic example of the impact of a reference point is how people react differently to being told either that they have a 10% chance of dying or a 90% chance of living through a major disease. The probabilities are the same, of course.

In general, they found that there is an aversion to losses which outweighs possible gains, even if the gains might be worth more.  

This makes it sound like change is very difficult, since many people often perceive proposed changes as having big risks.

But there is more to the story. Indeed, Kahneman found that there is no across-the-board aversion to change or even merely to risk. Indeed people might make a more risky choice when all options are bad.

As one summary states:

“When faced with a risky prospect, people will be: (1) risk-seeking over low-probability gains, (2) risk-averse over high-probability gains, (3) risk-averse over low-probability losses, and (4) risk-seeking over high-probability losses.”

In just this brief summary, there is some obvious guidance for change agents:

  • Reduce people’s estimate of their potential loss. For example, the new system won’t cost 25% more than the old one, but it will just be an extra nickel each time it is used.
  • Increase the perceived value of the change and/or the perceived likelihood of success – positive vivid images help to overcome lower probability estimates of the chances of success; negative vivid images help to magnify the probability of loss.
  • Help people redefine the perception of loss by shifting their frame of reference, which determines their starting point.
  • Reduce the overall size of the risks, which means it is best to introduce small innovations, piled on each other.  Behavioral scientists have also observed the irrational fear of loss versus the possibility of benefit is reduced when a person has had experience with the trade-off. A series of small innovations will help people to gain that experience and you will also find out which of your great ideas really are good. Since any innovation is an experiment, there’s no guarantee of success. Some will fail, but if the ideas are good and competent people are implementing the changes, you’ll succeed sufficiently more often than you fail so that the overall impact is positive.
  • Work to convince people that their certainty of loss is only a possibility. People react differently to being told something is a sure thing, than a 90% probability.
  • Since risk taking is no longer avoided among bad choices, show that the obvious loss of change is less than a bigger possible loss of not changing.

I’ve just touched the surface here. There other findings of behavioral and social science research that can also enable change agents to get a firmer grasp on the reality of the situation facing them and suggest things they might do to become more successful.

© 2016 Norman Jacknis, All Rights Reserved

Analytics And Organizational Change

The accumulation of data is increasing fast – from wearables, the widespread deployment of sensors in physical locations and the ever increasing use of the Internet by people. 

And someone somehow has to figure it all out.  As a result, data scientists are in demand and analytics is a hot new field of study.  On top of long standing statistical methods, there has been impressive progress recently in machine learning, artificial intelligence and new computer system architectures.

Yet, the use of analytics itself has not had as great an impact on many organizations as the data scientists have hoped.  Some of the failures of analytics were really failures of implementation. 

Perhaps the most public of these was the great Netflix million-dollar prize for a new recommendation engine.  From a purely technical viewpoint, the winning team did exactly what was asked for – create a significantly better engine than the one Netflix had been using.  Nevertheless, Netflix ended up not using their work.  That’s an issue of implementation and integrating the product of analytics into an organization.

Being able to predict behavior or even generate new insights from all this data is one thing.  As with Netflix, having people and organizations actually use that knowledge is another.  Like many other new technologies, adoption is as much a question of managing change as it is developing the technology itself.

This surely bothers some data scientists.  After all, they have a better mousetrap – why aren’t people using it?  Being able to think quantitatively, they can prepare quite convincing business cases with impressive ROI statistics and yet even that isn’t enough to get executives to budge.  But changing an organization isn’t simple no matter how good your arguments.

image

Despite this background, there has been very little overlap between the courses that prepare data scientists and the courses that prepare change agents in organizations. 

Later this year, I’ll be doing something to help align these two fields to improve the success of both.  I’ll be teaching an online course on analytics and leading change.  It will be part of Columbia University’s new executive graduate program in Applied Analytics.

image

We’ll be reviewing what is known about successfully introducing changes into an organization from the classics on the subject that were written as much as twenty years ago to more recent research.  The course will, of course, help its students understand how to get an analytics initiative started.  More important, it will focus on how to sustain, over the long run, both analytics and the changes it informs.

Thinking about the long run, there are three facets of the relationship between analytics and organizational change.

  •  The use of analytics as a part of everyday decision making and the rules of operation in a business – this is the obvious first thing everyone thinks of.
  • The use of analytics to help better implement the changes that its insights imply – a kind of a meta-analysis.
  • The continuing interaction between analytics and change to finally achieve the long desired goal of an organization that learns how to continually optimize itself – this is something of great strategic value to any business.

As the course develops, I’ll be posting more about each topic.

© 2016 Norman Jacknis, All Rights Reserved
[http://njacknis.tumblr.com/post/136679679430/analytics-and-organizational-change]