The Macrosite for News, Analysis and Opinion about the Future of the Internet
Mary Jander

FBI Sentinel: Case Study in Executive Failure

Written by Mary Jander
8/1/2012 7 comments
no ratings
DISCUSS     Email This

Twelve years. Multiple contractors. Several audits revealing numerous cost overruns and inefficiencies. Pricetag: approximately $621 million.

Those are just some of the items associated with the US Federal Bureau of Investigation's notorious Sentinel information and case management system, which finally made its public debut yesterday -- though between 18,000 and 21,000 agency users have deployed it daily since July 1.

"The deployment of Sentinel is an important step forward for FBI' information technology," said FBI Director Robert S. Mueller, III, in a prepared statement.

It's a step emerging from numerous stumbles: a mountain of reversals, false starts, and miscalculations that together make a classic case study in poor executive management -- one that will live in textbooks for years to come.

In 2010, blogger Simon Moore listed the many factors that went into the system's disastrous early history. They are classic: lack of clear goals, poor planning, lack of contractor control. And they all point to a central theme of poor management -- what Moore called a "lack of clear ownership":

Tellingly, a project manager was appointed only late into the project, the FBI cycled through 5 people in the CIO role in 4 years and accountability appears generally absent due to decision making by committees instead of knowledgeable individuals. In addition to a lack of accountability at the contractor level, there was a need for clearer accountability within the FBI. Lack of clear accountability structures is a clear theme in failed projects...

Moore's point about lack of ownership is supported by other studies of the project's failure, and it is clearly illustrated when you consider some of the highlights on the project's timeline:

  • May 2001: The FBI initiates the "Trilogy" project with three goals: to upgrade the FBI hardware and software information infrastructure; to upgrade its communications network; and to improve its case management system.

  • September 2001: The terrorist attacks of 9/11 call attention to the flaws in the FBI's antiquated case management system. The scope of Trilogy changes from an upgrade to a completely new case management system called the Virtual Case File (VDF) system.

  • October 2002: In a public posting on InfoSec News, Matthew Patton, a security team member on the Trilogy project, expresses frustration over the lack of security and failure of project participants to heed his warnings. This "whistleblowing" episode, which resulted in Patton being censured and leaving the project, is often referred to as evidence of the poor management Trilogy revealed from its outset.

  • April 2004: The first two objectives of the original Trilogy project are completed, but the VCF remains mired in problems. A February 2005 Department of Justice audit turns up numerous causes, including "lack of management continuity and oversight." The report sharply criticizes the FBI's inability to create the VCF, despite $170 million and 40 months of development.

  • April 2005: FBI Director Robert Mueller terminates work on the VCF project and announces plans for the new Sentinel case management system.

  • March 2006: Lockheed Martin is awarded the contract to complete Sentinel.

  • September 2010: CIO Zal Azmi resigns.

  • March 2010: Mueller announces that the FBI has run into problems with Sentinel and needs to add at least $30 million to the $300 million-plus already allotted to Sentinel. The DOJ slams the FBI for numerous project problems in a detailed audit.

  • September 2010: FBI CIO Chad Fulgham announces plans to complete Sentinel internally.

  • March 2012: Fulgham resigns.

  • July 2012: Sentinel deployment begins.

Studying these events reveals a lack of strategic planning and overview from the outset. There was no control over the execution of the plan, either, leaving a vacuum quickly filled by expensive contractors. Staff upheaval and rebellion, high executive turnover, and repeated cost and time overruns still failed to prod the agency to establish a clear chain of command and control.

In the end, it looks as though taking this project in-house got the job done. But the enormous costs are no doubt still being counted, and not just in dollar terms.

Related posts:

— Mary Jander Follow me on TwitterVisit my LinkedIn pageFriend me on Facebook, Executive Editor, Internet Evolution

DISCUSS     Email This
Current display:       newest comments first       display in chronological order
robjvargas
IQ Crew
Thursday August 2, 2012 10:49:35 PM
no ratings

More than just D.C., Mary, but yes, that too.

Remember the saying, Edison, I think it was, that invention is 10% inspiration, and 90% perspiration?

This is (I fear), a country that values anti-perspirant above all else.  Or is headed in that direction.

Vast systems like Sentinel, like the ATC system, like the Interstate Highway system, you don't just decide to build it and it happens.

Someone at the (proverbial as well as literal) top seems determined to forget that.

Mary Jander
Thinkernetter
Thursday August 2, 2012 2:32:04 PM
no ratings

Robjvargas, you mention the air traffic control systems. We've seen really scary consequences in Washington, DC this week, no?

robjvargas
IQ Crew
Thursday August 2, 2012 2:05:39 PM
no ratings

Mary, and Kim:

On its own, this looks like a doozy, sure.  But then compare it to the tens of trillions of dollars spent by government during that timeframe, and it's a drop in the bucket.  In fact, The FAA's handling of Air Traffic Control systems and needed upgrades would relegate this story to below-the-fold.  Maybe not even Page One.

Sadly, these case studies are rampant throughout federal government, and represent one of the largest reasons for my federalist/libertarian leanings.

Mary Jander
Thinkernetter
Thursday August 2, 2012 9:51:25 AM
no ratings

Sometimes, government waste is so shocking that you don't know whether to laugh or cry or try to rationalize it in some fashion.

Perhaps the best approach is the one most observers are taking: This is a free and very explicit and detailed lesson in all kinds of organizational problems. It's a textbook in its own right. You might even say an MBA course in its own right, if you have the patience to plow through the documentation.

Chris Poley
Thinkernetter
Wednesday August 1, 2012 7:08:28 PM
no ratings

Ah, the U.S. Government at it's very finest. Their ability to waste taxpayer money always astounds me.

Mary Jander
Thinkernetter
Wednesday August 1, 2012 5:25:35 PM
no ratings

It's a doozy, all right. What surprises me is that it continued for so long -- over a decade. The audits alone are incredibly detailed, showing that there was plenty of government awareness about the situation and what was causing the trouble.  But somehow, no meaningful action was taken until about two years ago.

Kim Davis
Thinkernetter
Wednesday August 1, 2012 5:11:10 PM
no ratings

There are a lot of horror stories along these lines, but this one's a doozy.  And it's "our" money.

The ThinkerNet does not reflect the views of TechWeb. The ThinkerNet is an informal means of communication to members and visitors of the Internet Evolution site. Individual authors are chosen by Internet Evolution to blog. Neither Internet Evolution nor TechWeb assume responsibility for comments, claims, or opinions made by authors and ThinkerNet bloggers. They are no substitute for your own research and should not be relied upon for trading or any other purpose.
previous posts from Executive Clan Editor's Blog
Alison Diana
Alison Diana   5/22/2013   4 comments
Almost everyone agrees that data analytics, digital marketing, apps, and APIs will greatly affect their enterprise's results in the next 12 months. But a report suggests that not all large corporations are moving quickly to adopt these enabling technologies -- and that could seriously harm their profitability, customer satisfaction, and chances for ongoing success.
Alison Diana
Alison Diana   5/15/2013   5 comments
Enterprises are embracing open-source to avoid vendor lock-in, get better-quality software, and gain access to larger libraries of applications. In return, they may be putting themselves at risk for higher, more complex support costs.
Alison Diana
Alison Diana   5/8/2013   8 comments
Although hiring a specialized marketing professional may be out of most IT departments' financial reach, it can be money well spent.
Alison Diana
Alison Diana   5/1/2013   8 comments
Whereas some businesses search externally when they need a CIO, Choice Hotels had to look only at its CTO for someone with the necessary expertise, industry knowledge, and technological know-how to continue leading the company's embrace of enabling technologies.
Mitch Wagner
Mitch Wagner   4/24/2013   9 comments
Local social media can be powerful marketing tools, but they can't just be add-ons. They need to be tightly integrated into the corporate culture, according to Whole Foods social marketers.
5
of
Mary E. Shacklett
Scrum Brings Social MediaThinking to Projects

7|30|12   |   2:12   |   8 comments


The very low-tech "scrum" project technique introduces "crowd talking" to projects and also sets the entire crowd to problem solving. So far, these new social-media-style meetings appear to have supercharged project execution.
Beau Brendler
Terrorism Expert Says US Gave Away Stuxnet Tech

4|4|12   |   3:29   |   9 comments


US counterterrorism expert Richard Clarke, who came to prominence with his prescient warnings before the 9/11 attacks, tells Smithsonian Magazine the US was responsible for the Stuxnet supersmart worm that attacked parts of nuclear reactors in Iran – and in the process, has given away one of the world's most sophisticated cyberweapons.
Mitch Wagner
'Digital Nomads' Work From Anywhere & Everywhere

2|14|13   |   2:35   |   20 comments


New tools like laptops, tablets, smartphone, and wireless connectivity let us work from San Diego to Katmandu, and anywhere in between. But time management remains a problem.
Mary Maida
How Medtronic Overcomes Social Business Resistance

1|31|13   |   1:23   |   No comments


Showing results is the best way to win over social business doubters, according to Mary Maida, Medtronic lead information solutions manager. Internet Evolution's Mitch Wagner interviewed Maida at the E2 Innovate conference.
Alison Diana
Striking a Balance for Website Upgrades

1|24|13   |   1:59   |   3 comments


Companies need to take advantage of new technologies to simplify interfaces, improve capabilities, and enhance back-office processes. But they can't upgrade their Websites too often.
Kelli Carlson-Jagersma
Wells Fargo Sales Get Social Business Boost

1|16|13   |   2:30   |   2 comments


Wells Fargo uses social software to replace email chains and help its sales team collaborate more effectively to land deals, according to Kelli Carlson-Jagersma, VP Collaboration Strategy for Wells Fargo. Mitch Wagner spoke with Carlson-Jagersma at the E2Innovate conference
Second Shooter
Cisco & Linksys: A Problem at the Edge

1|4|13   |   2:15   |   No comments


Cisco's rumored sale of Linksys suggests we may have problem with innovation and profit at the edge of our Internet, and that could be critical to the evolution of many Internet-delivered services.
Mary E. Shacklett
Financial Services Policies Lag Tech Advances

12|4|12   |   2:18   |   6 comments


Regulations haven't kept up with advances in mobile devices and credit cards.
Wisdom of the Big Chair
Price, Not Features, Driving Smartphone Sales

11|29|12   |   2:01   |   7 comments


A survey by JD Powers found that customer interest in product features is lessening as phones evolve. Rather than features, price is driving purchases, and that change could have a dramatic impact on how IT departments secure these devices.
Mary E. Shacklett
Watch Your Business Secrets on Multi-Tenant Clouds

11|26|12   |   1:56   |   1 comment


Multi-tenant clouds assure security for clients, but not necessarily for their ideas. Here's one thing you should discuss with your cloud provider before you sign on.
IETV: the thinkerNet on film
5
of
Kim Davis
Big-Data Can’t Always Sell Wine

5|21|13   |   2:23   |   4 comments


Whole Foods Global Wine Purchaser Doug Bell told me about some of the constraints on using analytics in the US wine market.
Paul J. Fleuranges
Digital Signage Keeps NYC Subway Straphangers on Track

5|6|13   |   3:51   |   No comments


New York's Metropolitan Transit Authority is conducting a pilot test of digital kiosks to guide subway users to where they want to go more efficiently and at lower cost.
Kim Davis
Fast Forward to the Future

4|23|13   |   2:29   |   20 comments


A look back at tech writing in the 90s makes us wonder where enterprise IT will be 20 years from now.
Mitch Wagner
Google Launches Its Most Depressing Service Yet

4|15|13   |   2:59   |   10 comments


Google's new Inactive Account Manager lets you control how Google disposes of your accounts when you die.
Second Shooter
Argument Over Top-Level Domains Is 'Stupid'

4|11|13   |   2:07   |   3 comments


The whole Amazon.reader debate is a double-stupid. It's stupid to think that there's any e-book buyer who doesn't know Amazon's URL, and it was stupider to let ICANN launch the whole free-form TLD initiative to start with.
Kim Davis
Ladies, Your Tablet Awaits

3|21|13   |   2:22   |   37 comments


ePad Femme is the world’s first tablet “made exclusively for women.”
Wisdom of the Big Chair
NFC Moves Into the Mainstream

3|20|13   |   2:16   |   No comments


While NFC's original goal was to enhance mobile commerce applications, it is finding its way into a number of other uses, which is creating both opportunity as well as challenges for IT departments.
Wisdom of the Big Chair
Integrating Security Into Your Cloud Contract

3|19|13   |   3:35   |   No comments


Enterprises would like to move to cloud computing but are hesitant because they are concerned about providers’ ability to secure company data. Here are some tips that help to ensure that if breaches occur, the business is not left holding the bag.
Brian Baron
How Edmunds.com Collects Customer Information

3|18|13   |   1:15   |   No comments


Edmunds separates customers into segments based on the info it collects on its site and from partners, and uses that to push out custom content, said Brian Baron, director of business analytics for Edmunds.com, at Predictive Analytics Innovation Summit.
Brian Baron
How Edmunds.com Uses Analytics to Customize Site

3|14|13   |   0:47   |   No comments


The automotive website uses propensity modeling to target ads and customer registration forms, said Brian Baron, director of business analytics for Edmunds.com, at Predictive Analytics Innovation Summit.
an IBM information resource
sponsored content
big blue blog
an IBM information resource
sponsored content
Expert Integrated Systems: Changing the Experience & Economics of IT
In this e-book, we take an in-depth look at these expert integrated systems -- what they are, how they work, and how they have the potential to help CIOs achieve dramatic savings while restoring IT's role as business innovator.

READ THIS eBOOK
your weekly update of news, analysis, and
opinion from Internet Evolution - FREE!

REGISTER HERE
Wanted! Site Moderators
Internet Evolution is looking for a handful of readers to help moderate the message boards on our site – as well as engaging in high-IQ conversation with the industry mavens on our thinkerNet blogosphere. The job comes with various perks, bags of kudos, and GIANT bragging rights. Interested?

Please email: moderators@internetevolution.com
Internet Evolution – not for thickies
Keep Critical Data With a Knowledge Management System
Taimoor Zubair
Fortune 500 companies lose at least
$31.5 billion a year by failing to share knowledge. A Knowledge Management System (KMS) can help companies significantly reduce these costs.

CLICK FOR MORE
M2M: Rise of the Machines? Not Yet
David Weldon
In the 1970 science fiction thriller
Colossus: The Forbin Project, two giant supercomputers from the United States and Soviet Union secretly join forces to take control of the collective nuclear might of the two countries. In the film, the two machines discover each other's existence, communicate back-and-forth, share their collective data, and cut their human creators out of the process. It is the ultimate example of machine-to-machine communications, or M2M.

CLICK FOR MORE
M2M: Rise of the Machines? Not Yet
David Weldon
In the 1970 science fiction thriller
Colossus: The Forbin Project, two giant supercomputers from the United States and Soviet Union secretly join forces to take control of the collective nuclear might of the two countries. In the film, the two machines discover each other's existence, communicate back-and-forth, share their collective data, and cut their human creators out of the process. It is the ultimate example of machine-to-machine communications, or M2M.

CLICK FOR MORE