Why do so many projects fail to meet their goals for time, cost and performance? Regardless of the answer, many project managers and their executive sponsors seem to be surprised when a new project gets off track: “Why didn’t we see that coming?” Even projects that employ sophisticated techniques for risk management can encounter surprising derailments. Those methods, while powerful, can only manage known risks. But projects are new and unique. What about the things that we don’t even know that we don’t know? These “unknown unknowns” — often called “unk-unks” — are lurking in every project, just waiting to emerge, surprise and derail plans. To what extent are they inevitable? What could we do better?
Project knowledge comes from learning about the project — its overall context, its goals and objectives, the process for achieving them, the people, tools and other resources to be deployed, and how all of these affect one another. This learning begins in the planning stages. One might think that planners would consider all of the scenarios, evaluate all of the options and identify all of the risks — but that is seldom the case. Many planners resist wasting resources on planning projects that may never happen. Even after a project gets the green light, a typical attitude of many managers is: “We’re already behind. We know what we need to do. Let’s get started!” As a result, the distinction between what is knowable about a project and what is actually known can be quite large.
Many so-called “unk-unks” aren’t really unk-unks at all. Rather, they are things no one has bothered to find out. Indeed, there are two kinds of unknowns: unknown unknowns (things we don’t know we don’t know) and known unknowns (things we know we don’t know). (See “Converting Knowable Unk-Unks to Known Unknowns.”) Every project has some of both. The techniques of conventional risk management apply only to the known unknowns. Yet some unk-unks are knowable and can be converted to known unknowns through a process of directed recognition.
1. These five project subsystems have been noted in several prior works, including T.R. Browning, E. Fricke and H. Negele, “Key Concepts in Modeling Product Development Processes,” Systems Engineering 9, no. 2 (summer 2006): 104-128; S.D. Eppinger and T.R. Browning, “Design Structure Matrix Methods and Applications” (Cambridge, Massachusetts: MIT Press, 2012); and R.V. Ramasesh and T.R. Browning, “A Conceptual Framework for Tackling Knowable Unknown Unknowns in Project Management,” Journal of Operations Management 32, no. 4 (May 2014): 190-204.
2. S.D. Eppinger, “Innovation at the Speed of Information,” Harvard Business Review 79, no. 1 (January 2001): 149-158.
3. For a more detailed account of these factors, see Ramasesh and Browning, “A Conceptual Framework.”
4. This example comes from V. Tang and V. Salminen, “Towards a Theory of Complicatedness: Framework for Complex Systems Analysis and Design” (paper presented at the 13th International Conference on Engineering Design, Glasgow, Scotland, August 2001).
5. C.H. Loch, M.E. Solt and E.M. Bailey, “Diagnosing Unforeseeable Uncertainty in a New Venture,” Journal of Product Innovation Management 25, no. 1 (January 2008): 28-46.
6. P.J.H. Schoemaker, “Scenario Planning: A Tool for Strategic Thinking,” Sloan Management Review 36, no. 2 (winter 1995): 25-40.
7. E. Lamarre and M. Pergler, “Risk: Seeing Around the Corners,” McKinsey Quarterly, October 2009: 102-106.
8. A. Gawande, “The Checklist Manifesto: How to Get Things Right” (New York: Metropolitan Books, 2009).
9. S. Leleur, “Systemic Planning: Dealing With Complexity by a Wider Approach to Planning,” Emergence: Complexity & Organization 9, no. 1-2 (2007): 2-10.
10. Mars Observer Mission Failure Investigation Board, “Report of the Mars Observer Mission Failure Investigation Board” (Washington, DC: NASA, 1993).
11. J.W. Mullins, “Discovering ‘Unk-Unks,’” MIT Sloan Management Review 48, no. 4 (summer 2007): 17-21.
13. P.J.H. Schoemaker and G.S. Day, “How to Make Sense of Weak Signals,” MIT Sloan Management Review 50, no. 3 (spring 2009): 81-89.
14. V.S. Parsons, “Searching for ‘Unknown Unknowns,’” Engineering Management Journal 19, no. 1 (March 2007): 43-47.
15. A. De Meyer, C.H. Loch and M.T. Pich, “Managing Project Uncertainty: From Variation to Chaos,” MIT Sloan Management Review 43, no. 2 (winter 2002): 60-67.
16. C. Ivory and N. Alderman, “Can Project Management Learn Anything From Studies of Failure in Complex Systems?” Project Management Journal 36, no. 3 (2005): 5-16.
17. International Risk Governance Council, “The Emergence of Risks: Contributing Factors” (Geneva, Switzerland: International Risk Governance Council, 2010).
18. K.E. Weick and K.M. Sutcliffe, “Mindfulness and the Quality of Organizational Attention,” Organization Science 17, no. 4 (July-August 2006): 514-524.
i. Ramasesh and Browning, “A Conceptual Framework.”