Technology has always been about hope. Since the beginning of the industrial revolution, businesses have embraced new technologies enthusiastically, and their optimism has been rewarded with improved processes, lower costs and reduced workforces. As the pace of technological innovation has intensified over the past two decades, businesses have come to expect that the next new thing will inevitably bring them larger market opportunities and bigger profits. Software, a technology so invisible and obscure to most of us that it appears to work like magic, especially lends itself to this kind of open-ended hope.
Software promises evolutions, revolutions and even transformations in how companies do business. The triumphant vision many buy into is that enterprise software in large organizations is fully integrated and intelligently controls infinitely complex business processes while remaining flexible enough to adapt to changing business needs. This vision of software lies at the core of what Thomas Friedman in “The World Is Flat” calls “the Wal-Mart Symphony in multiple movements — with no finale. It just plays over and over 24/7/365.”1 Whole systems march in lock step, providing synchronized, fully coordinated supply chains, production lines and services, just like a world-class orchestra. From online web orders through fulfillment, delivery, billing and customer service — the entire enterprise, organized end to end — that has been the promise. The age of smart machines would seem to be upon us.
Or is it? While a few companies like Wal-Mart Stores Inc. have achieved something close to that ideal, the way most large organizations actually process information belies that glorious vision and reveals a looking-glass world, where everything is in fact the opposite of what one might expect. Back-office systems — including both software applications and the data they process — are a variegated patchwork of systems, containing 50 or more databases and hundreds of separate software programs installed over decades and interconnected by idiosyncratic, Byzantine and poorly documented customized processes. To manage this growing complexity, IT departments have grown substantially: As a percentage of total investment, IT rose from 2.6% to 3.5% between 1970 and 1980.2 By 1990 IT consumed 9%, and by 1999 a whopping 22% of total investment went to IT. Growth in IT spending has fallen off, but it is nonetheless surprising to hear that today’s IT departments spend 70% to 80% of their budgets just trying to keep existing systems running.
1. T. Friedman, “The World Is Flat: A Brief History of the Twenty-First Century” (New York: Farrar, Straus and Giroux, 2005), 128.
2. J. Dedrick, V. Gurbaxani and K.L. Kraemer, “Information Technology and Economic Performance: A Critical Review of the Empirical Evidence,” ACM Computing Surveys 35, no. 1 (March 2003): 18.
3. J.W. Ross, P. Weill and D.C. Robertson, “Enterprise Architecture As Strategy: Creating a Foundation for Business Execution” (Boston: Harvard Business School Press, 2006), 11.
4. J.W. Cordata, “Progenitors of the Information Age: The Development of Chips and Computers,” in “A Nation Transformed By Information,” ed. A.D. Chandler and J. W. Cordata (New York: Oxford University Press, 2000), 206–208.
5. R.L. Glass, “Facts and Fallacies of Software Engineering” (Boston: Pearson Education, 2003), 58.
6. M. Campbell-Kelly, “From Airline Reservations to Sonic the Hedgehog: A History of the Software Industry” (Cambridge: MIT Press, 2004), 198.
7. K.K. Hong and Y.G. Kim, “The Critical Success Factors for ERP Implementation: An Organizational Fit Perspective,” Information & Management 40, no. 1 (October 2002): 25.
8. L.M. Hitt, D.J. Wu and X. Zhou, “Investment in Enterprise Resource Planning: Business Impact and Productivity Measures,” Journal of Management Information Systems 19, no. 1 (summer 2002): 71–98.
9. N. Carr, “Does IT Matter? Information Technology and the Corrosion of Competitive Advantage” (Boston: Harvard Business School Press, 2004).
10. C. Koch, “The Monopoly That Matters More Than Microsoft,” Nov. 13, 2006, http://advice.cio.com.
11. R. Pool, “Beyond Engineering: How Society Shapes Technology” (New York: Oxford University Press, 1997), 137.
12. C. Mann, “Why Software Is So Bad,” Technology Review (July–August 2002): 32–38.
13. J. Pontin, “Bjarne Stroustrup: The Problem With Programming,” Technology Review (January–February 2007): 22.
14. Author’s interview with John Nicoli, executive vice president, Harte-Hanks Trillium Software; Aug. 8, 2005.
15. S. Rosenberg, “Anything You Can Do, I Can Do Meta,” Technology Review (January–February 2007): 45.
16. M. Wheatley, “ERP Training Stinks,” CIO Magazine, June 1, 2000, 86–96.
17. W. Orlikowski and C.S. Iacono, “The Truth Is Not Out There: An Enacted View of the ‘Digital Economy,’” in “Understanding the Digital Economy: Data, Tools and Research,” ed. E. Brynjolfsson and B. Kahin (Cambridge: MIT Press, 2000), 355.
18. Ross, “Enterprise Architecture As Strategy.”
19. S. Rosenberg, “Dreaming in Code: Two Dozen Programmers, Three Years, 4,732 Bugs, and One Quest for Transcendent Software” (New York: Crown Publishers, 2007), 94–95.
20. Glass, “Facts and Fallacies of Software Engineering.”
21. D. Gelernter, “Mirror Worlds: Or the Day Software Puts the Universe in a Shoebox … How It Will Happen and What It Will Mean” (New York: Oxford University Press, 1992), 51.
22. S. Shay, “CEOs Rate IT: Steady but Uncreative,” CIO Magazine, April 1, 2007, 20.