Point Lookout: a free weekly publication of Chaco Canyon Consulting
Volume 9, Issue 1;   January 7, 2009: The Paradox of Confidence

The Paradox of Confidence

by

Most of us interpret a confident manner as evidence of competence, and a hesitant manner as evidence of lesser ability. Recent research suggests that confidence and competence are inversely correlated. If so, our assessments of credibility and competence are thrown into question.

In this culture, and others, we value confidence in leaders, mechanics, doctors, generals, and even strangers we've asked for directions. But in all these cases, and more, we're actually seeking expertise, knowledge, and capability — in short, competence.

U.S. Secretary of the Treasury Robert Rubin (left) with Federal Reserve Board Chairman Alan Greenspan

U.S. Secretary of the Treasury Robert Rubin (left) with Federal Reserve Board Chairman Alan Greenspan in discussion before meeting with the House Banking Committee on 20 May 1999, just six months before the work of Kruger and Dunning appeared. They were then both at the height of their power, which both used liberally to resist calls for regulation of new and growing sectors of the financial markets — the very sectors that contributed so much to the financial crisis at the end of 2008. Both men were studies in confidence, and that confidence played a role in persuading officials and the population at large that the U.S. economy was healthy and on course. Yet, on 23 October 2008, under questioning by Rep. Henry Waxman, chair of the Committee on Oversight and Government Reform of the U.S. House of Representatives, former Chairman Greenspan testified, with regard to his "conceptual framework with the way people deal with reality," that, "…I found a flaw, I don't know how significant or permanent it is, but I have been very distressed by that fact." He went on, "I found a flaw in the model that I perceived is the critical functioning structure that defines how the world works…I was shocked." One model of what might have happened to him is that he had discovered the limits of his competence. The fourth factor observed by Dunning and Kruger states that, "Incompetent individuals can gain insight about their shortcomings, but this comes (paradoxically) by gaining competence." If this model applies, one might conclude that by October, 2008, Mr. Greenspan was somewhat more competent than he had been in 1999. Read Mr. Greenspan's complete testimony and view other documents related to the hearing. Photo courtesy U.S. Department of the Treasury.

We usually assume that confidence comes from competence. We apply this assumption personally when we seek health care, investment advice, or other services. But we also apply it at work — when we make hiring decisions, when we evaluate the assertions of superiors and subordinates, and when we get advice from consultants.

Trouble is, the assumption is wrong.

We know this because of the pioneering work of Justin Kruger and David Dunning, who, working at Cornell in 1999, discovered a phenomenon now called the Dunning-Kruger effect. They performed experiments that yielded results consistent with these four principles (paraphrasing):

  1. Incompetent individuals, compared with their more competent peers, dramatically overestimate their ability and performance.
  2. Incompetent individuals are less able than their more competent peers to recognize competence when they see it.
  3. Incompetent individuals are less able than their more competent peers to gain insight into their true level of performance.
  4. Incompetent individuals can gain insight about their shortcomings, but this comes (paradoxically) by gaining competence.

Taken together, these four factors contribute to an inverse correlation between confidence and competence — exactly the opposite of what most of us assume.

If we can't rely on confidence as an indicator of competence, on what can we rely? In assessing competence, when we do consider factors beyond confidence, we tend to focus on domain-specific content. That helps, but it's not enough. Here are four generic indicators of competence for application in the workplace.

Awareness of limitations
The truly competent understand that their competence is limited — that there are things they can't do or don't know. This knowledge drives a continued desire to learn.
Desire to learn
Curiosity, practice, questioning, and continued study are signs of a drive to enhance competence. It is this drive that established the existing level of competence. Where this drive is weak, competence is questionable.
Constructive response to failure
Responding to Incompetent individuals, compared
with their more competent peers,
dramatically overestimate their
ability and performance
failure in constructive ways is another important way to build competence. This ability is probably essential to building competence.
Ability to assess risk realistically
Realistic risk assessment requires a reservoir of experience — competence — in the relevant domains. Incompetence leads to mis-assessment of risk. The fearful and incompetent tend to overestimate risks; the brash and incompetent tend to underestimate them. Competence tempers both.

I'm not 100% sure that these indicators are necessary and sufficient — probably not. But they've come to me through a lifetime of experience. If you have others you rely on, send them to me and I'll consider adding them to my list. Go to top Top  Next issue: Asking Clarifying Questions  Next Issue

Read Kruger and Dunning's original paper, courtesy the American Psychological Association.

For more about the Dunning-Kruger Effect, see "How to Reject Expert Opinion: Part II," Point Lookout for January 4, 2012; "Devious Political Tactics: More from the Field Manual," Point Lookout for August 29, 2012; "Overconfidence at Work," Point Lookout for April 15, 2015; "Wishful Thinking and Perception: Part II," Point Lookout for November 4, 2015; "Wishful Significance: Part II," Point Lookout for December 23, 2015; "Cognitive Biases and Influence: Part I," Point Lookout for July 6, 2016; and "The Paradox of Carefully Chosen Words," Point Lookout for November 16, 2016.

52 Tips for Leaders of Project-Oriented OrganizationsAre your projects always (or almost always) late and over budget? Are your project teams plagued by turnover, burnout, and high defect rates? Turn your culture around. Read 52 Tips for Leaders of Project-Oriented Organizations, filled with tips and techniques for organizational leaders. Order Now!

Your comments are welcome

Would you like to see your comments posted here? rbrenolNtwiSKWNHPJlUYner@ChacUSTklKDGnJlRiDOVoCanyon.comSend me your comments by email, or by Web form.

About Point Lookout

Thank you for reading this article. I hope you enjoyed it and found it useful, and that you'll consider recommending it to a friend.

Point Lookout is a free weekly email newsletter. Browse the archive of past issues. Subscribe for free.

Support Point Lookout by joining the Friends of Point Lookout, as an individual or as an organization.

Do you face a complex interpersonal situation? Send it in, anonymously if you like, and I'll give you my two cents.

Related articles

More articles on Personal, Team, and Organizational Effectiveness:

William Ross Ashby, who discovered the Law of Requisite VarietyCompletism
Completism is the desire to create or acquire a complete set of something. In our personal lives, it drives collectors to pay high prices for rare items that "complete the set." In business it drives us to squander our resources in surprising ways.
Mess line, noon, Manzanar Relocation Center, California, 1943Remote Facilitation in Synchronous Contexts: Part II
Facilitators of synchronous distributed meetings — meetings that occur in real time, via telephone or video — encounter problems that facilitators of face-to-face meetings do not. Here's Part II of a little catalog of those problems, and some suggestions for addressing them.
A spider plant, chlorophytum comosum.What Enough to Do Is Like
Most of us have had way too much to do for so long that "too much to do" has become the new normal. We've forgotten what "enough to do" feels like. Here are some reminders.
Portrait of Benjamin Lincoln (1733-1810), Major General of the Continental Army during the American Revolutionary WarThe Deck Chairs of the <i>Titanic</i>: Strategy
Much of what we call work is about as effective and relevant as rearranging the deck chairs of the Titanic. We continue our exploration of futile and irrelevant work, this time emphasizing behaviors related to strategy.
Fugu Rubripes, the Fugu fishEmbolalia and Stuff Like That: Part I
When we address others, we sometimes use filler — so-called automatic speech or embolalia — without thinking. Examples are "uh," "um," and "er," but there are more complex forms, too. Embolalia are usually harmless, if mildly annoying to some. But sometimes they can be damaging.

See also Personal, Team, and Organizational Effectiveness and Critical Thinking at Work for more related articles.

Forthcoming issues of Point Lookout

Rosemary Woods, President Richard Nixon's personal secretaryComing March 1: Yet More Obstacles to Finding the Reasons Why
Part III of our catalog of obstacles encountered in retrospectives, when we try to uncover why we succeeded — or failed. Available here and by RSS on March 1.
Promotional poster for the 1957 film Twelve Angry MenAnd on March 8: The Opposite of Influence
The question of why some people are so influential has a partner question: why are others largely ignored, or opposed, even when their contributions are valuable? Available here and by RSS on March 8.

Coaching services

I offer email and telephone coaching at both corporate and individual rates. Contact Rick for details at rbrenBxJhmPdohQmJEXJHner@ChacQsskBIjMRMniXZocoCanyon.com or (617) 491-6289, or toll-free in the continental US at (866) 378-5470.

Get the ebook!

Past issues of Point Lookout are available in six ebooks:

Reprinting this article

Are you a writer, editor or publisher on deadline? Are you looking for an article that will get people talking and get compliments flying your way? You can have 500 words in your inbox in one hour. License any article from this Web site. More info

Public seminars

Changing How We Change: The Essence of Agility
MasteChanging How We Change: The Essence of Agilityry of the ability to adapt to unpredictable and changing circumstances is one way of understanding the success of Agile methodologies for product development. Applying the principles of Change Mastery, we can provide the analogous benefits in a larger arena. By exploring strategies and tactics for enhancing both the resilience and adaptability of projects and portfolios, we show why agile methodologies are so powerful, and how to extend them beyond product development to efforts of all kinds. Read more about this program. Here are some upcoming dates for this program:

Conflict Resolution Skills for Leaders
ConflConflict Resolution Skills for Leadersict is inherent in collaborative work. When conflict is constructive, it produces better outcomes. When it's destructive, it can be an insurmountable obstacle to success. In this program, we explore the connections between the outcomes of collaboration and conflict in both of its forms. And we emphasize the skills needed most by leaders. The leader's task is to manage conflict so as to ensure that the group achieves its objective with its capacity to collaborate intact, or even enhanced. Rick Brenner shows team leaders and team sponsors the techniques they need to manage team conflict for relationship safety and better outcomes. Read more about this program. Here's an upcoming date for this program:

Influencing Outcomes Without Authority
Your Influencing Outcomes Without Authorityability to influence others — whether upward, downward, laterally, or within a team — always depends on both the quality of your relationships with the people you influence, and on your perception and their perception of your personal power. In this program, Rick Brenner shows you the techniques for making things happen not by using formal organizational power, but by using informal, personal power. Read more about this program. Here's an upcoming date for this program:

Strategies for Leading Teams in Hard Times
When Strategies for Leading Teams in Hard Timesa project team is on task, the contributions of leaders are important, and little noticed. Sometimes the team encounters unexpected difficulty, or requirements change, or budgets are reduced, or any of a number of other things might happen. In these cases, the leader must make or facilitate decisions about how to respond or how to revise the plan. We get through it somehow. Hard times are something else altogether. Despondency, disillusionment, resource shortages, unexpected and severe failure of the plan, and toxic conflict can erode morale. How can leaders deal with such situations? Read more about this program. Here's an upcoming date for this program:

Strategies for Technical Debt: A Workshop for Enterprise Leaders
TechnTechnical Debt Management for Enterprise Leadersical debt is more than mere IT jargon. It's a metaphor that refers to the accumulation of technical artifacts that really ought to be retired, replaced, rewritten, re-implemented, or, if absent, created. We can find technical debt in almost any system, including those that seem to be working well. So what's the problem? The problem is the "interest charges." Systems carrying technical debt are more difficult to maintain, more difficult to extend or enhance, and more difficult to use, than they would be if we "retired" the debt. This engaging and eye-opening program points the way to a path that leads your organization out of technical debt, to make it more adaptable, more transformable, and more agile. Read more about this program. Here's an upcoming date for this program:

Creating High Performance Virtual Teams
Many Creating High Performance Virtual Teamspeople experience virtual teams as awkward, slow, and sometimes frustrating. Even when most team members hail from the same nation or culture, and even when they all speak the same language, geographic dispersion or the presence of employees from multiple enterprises is often enough to exclude all possibility of high performance. The problem is that we lead, manage, and support virtual teams in ways that are too much like the way we lead, manage, and support co-located teams. In this program, Rick Brenner shows you how to change your approach to leading, managing, and supporting virtual teams to achieve high performance using Simons' Four Spans model of high performance. Read more about this program. Here's an upcoming date for this program:

The Race to the South Pole: Ten Lessons for Project Managers
On 14The Race to the Pole: Ten Lessons for Project Managers December 1911, four men led by Roald Amundsen reached the South Pole. Thirty-five days later, Robert F. Scott and four others followed. Amundsen had won the race to the pole. Amundsen's party returned to base on 26 January 1912. Scott's party perished. As historical drama, why this happened is interesting enough, but to organizational leaders, business analysts, project sponsors, and project managers, the story is fascinating. Lessons abound. Read more about this program. Here's an upcoming date for this program:

Follow Rick

Send email or subscribe to one of my newsletters Follow me at LinkedIn Follow me at Twitter, or share a tweet Follow me at Google+ or share a post Subscribe to RSS feeds Subscribe to RSS feeds
The message of Point Lookout is unique. Help get the message out. Please donate to help keep Point Lookout available for free to everyone.
21st Century Business TravelAre your business trips long chains of stressful misadventures? Have you ever wondered if there's a better way to get from here to there relaxed and refreshed? First class travel is one alternative, but you can do almost as well (without the high costs) if you know the tricks of the masters of 21st-century e-enabled business travel…
Go For It: Sometimes It's Easier If You RunBad boss, long commute, troubling ethical questions, hateful colleague? Learn what we can do when we love the work but not the job.
303 Tips for Virtual and Global TeamsLearn how to make your virtual global team sing.
101 Tips for Managing ChangeAre you managing a change effort that faces rampant cynicism, passive non-cooperation, or maybe even outright revolt?
101 Tips for Effective MeetingsLearn how to make meetings more productive — and more rare.
Exchange your "personal trade secrets" — the tips, tricks and techniques that make you an ace — with other aces, anonymously. Visit the Library of Personal Trade Secrets.