The Macrosite for News, Analysis and Opinion about the Future of the Internet
Rick Cook

Why Deep Packet Inspection Isn't Always Evil

Written by Rick Cook
8/17/2012 9 comments
no ratings
DISCUSS     Email This

Deep packet inspection (DPI) is becoming increasingly popular as a tool for network security and for shaping and managing traffic. It consists of examining the contents of packets, not just the headers, as they move over the network. This is usually done at the firewall, but it can be done within the network.

DPI is somewhat controversial, because it can be used for censorship and keeping track of what network users are saying. Many repressive regimes, such as those in Iran, North Korea, and especially China, use DPI in this fashion. Some ISPs have also used DPI, though this produced such a strong reaction from privacy advocates that the practice has been generally discontinued in the United States. As a result of these abuses, DPI has become something of a hot button, regardless of who is using it and how it is applied. This has probably slowed its adoption by enterprises.

Despite the controversy, DPI tools and appliances are widely available. Companies such as Dell, Vineyard Networks, and Stonesoft include it in their security suites. The market analysis firm Infonetics put DPI revenue at more than $400 million for 2011 and expects it to exceed $2 billion by 2016.

By inspecting packet contents via DPI, administrators can protect their networks against intrusion, unwanted file types, malware, and other threats in a much more sophisticated way than conventional security measures allow. Network administrators also can set elaborate business rules for what can and cannot pass over the network, and they can enforce those rules automatically at the packet level.

Beyond security, DPI can play an important role in managing traffic over the network. It allows very precise identification of applications and data. It also allows fine-grained management of the network by classifying packets by network type and applying a rule set to decide things like network priorities. For example, packets from videoconferencing or VOIP, which are sensitive to latency and jitter, can be given high priority to make sure they flow smoothly over the net. Applications such a spreadsheets, which are less sensitive, can be assigned lower priorities, and in most cases, the users will never notice.

Since DPI also examines headers, it is easy to use it to single out various classes of users and decide which classes are allowed to send and receive various kinds of traffic. As network use increases, this kind of control becomes more important in making the most efficient use of the network.

DPI usually compares packet contents against a database of characteristics to determine what kind of traffic the packet contains. Some DPI products include heuristics that allow the application to figure out what kinds of unknown or encrypted traffic the packet contains. This is especially important in controlling P2P recreational traffic, because sites and users often encrypt the packet contents to prevent identification. This keeps the application from reading the contents, but the packet's characteristics can still be used to deduce what sort of traffic is being sent.

All this comes at a price. DPI is computationally intensive, since virtually every byte moving over the network has to be unpacked and inspected. In the past, this prevented enterprises from widely applying DPI. However, with advances in computer power and the availability of appliances with specialized processors, this is much less of a problem.

DPI continues to stir some controversy, but its increased viability is ensuring its place in enterprise IT and its continued growth as an option for security and traffic management.

Related posts:

— Rick Cook is a prolific technology writer and author of the Wizardry series of fantasy novels.

DISCUSS     Email This
Current display:       newest comments first       display in chronological order
stotheco
IQ Crew
Saturday August 18, 2012 12:31:14 AM
no ratings

@Lin, I hope that Google won't go that route just to generate more ad revenue. I'm already iffy how they manage to display targeted ads based on my email and search terms. If they used my conversations.. Well, I'm sure a lot of people will be up in arms over that.

Rick Cook
Thinkernetter
Saturday August 18, 2012 12:17:11 AM
no ratings

Most of the growth in DPI seems to be coming from enterprises using it as a security and management tool.

DPI by itself can't read encrypted packets. But by using heuristics it can usually figure out what kind of data the packet contains and figure out which ones to block.


As to privacy concerns, that depends in large part on where and how it is used. An enterprise using it on enterprise's own accounts doesn't present a problem to me. Use by ISPs to target advertising, that's another story. And of course the use by governments to spy on people, well. . .

robjvargas
IQ Crew
Friday August 17, 2012 7:13:27 PM
no ratings

Kim:

I convinced my previous employer to purchase and install one of Palo Alto Networks' "Next Generation" firewalls that engages in deep packet inspection.  It was capable of man-in-the-middle (MITM) SSL proxying to catch SSH and HTTPS traffic.  And so it could catch that much encrypted traffic.  I never investigated it more deeply to see if it would do more.

In our case, it stopped Web-based proxies because our security requirements called for cutting off file-sharing sites.

Very, very powerful stuff, and management was very happy with the visibility it gave them into the browsing (and circumvention) practices of employees.

Kim Davis
Thinkernetter
Friday August 17, 2012 12:48:11 PM
no ratings

Can encryption prevent the contents of the package from being inspected?  Or will it also prevent it from being delivered if a DPI process is in use?

lin crampton
IQ Crew
Friday August 17, 2012 12:15:05 PM
no ratings

@Bolingbroke - there may be privacy limitations on DPI on VoIP traffic.  I think it might vary on a state by state basis.

I'll really start to worry when Google starts to partner with the ISPs and use information gleaned from DPI to generate advertising revenue.  

Bolingbroke
IQ Crew
Friday August 17, 2012 8:58:47 AM
no ratings

Is the usage of DPI in enterprise acceptable ?

When it comes to privacy concerns over network security measures isn't it pretty much always about where specifically these measures are being applied? Why should there be any limits on privacy at the eneterprise level?

Michael P. Kassner
Thinkernetter
Friday August 17, 2012 8:08:30 AM
no ratings

It is a reactive technology that bad guys easily keep ahead of. Then there's encryption. 

Chris Poley
Thinkernetter
Friday August 17, 2012 7:31:21 AM
no ratings

Thank you Rick for a very informative look at the pros and cons of DPI. I wonder if DPI becomes the industry standard, how much pushback will continue from privacy advocates.

Anand Y
IQ Crew
Friday August 17, 2012 1:56:42 AM
no ratings

"The market analysis firm Infonetics put DPI revenue at more than $400 million for 2011 and expects it to exceed $2 billion by 2016."

@Rick, thanks for the post. Am curious to know where is this growth coming from when we know that DPI can be used for censorship and for tracking users data. Is the usage of DPI in enterprise acceptable ? How to identify the thin line to define if DPI is used to monitor the network or to track the users ?

The ThinkerNet does not reflect the views of TechWeb. The ThinkerNet is an informal means of communication to members and visitors of the Internet Evolution site. Individual authors are chosen by Internet Evolution to blog. Neither Internet Evolution nor TechWeb assume responsibility for comments, claims, or opinions made by authors and ThinkerNet bloggers. They are no substitute for your own research and should not be relied upon for trading or any other purpose.
previous posts from Rick Cook
Rick Cook
Rick Cook   11/5/2012   19 comments
Risk-averse IT managers need to move to the latest version of the Internet protocol or suffer the consequences, which could mean rationing the amount of Internet-connected devices in their enterprises.
Rick Cook
Rick Cook   10/26/2012   43 comments
The Internet has enormous resiliency against damage. Unfortunately, it has very little against malice -- and that's becoming an ever-larger issue for IT managers.
Rick Cook
Rick Cook   10/3/2012   8 comments
How reliable is your network? Can it shift to off-site backup in the event of a disaster? Will the window of renewed uptime meet the recovery time objective (RTO) you have planned?
Rick Cook
Rick Cook   7/9/2012   24 comments
The massive power outages and widespread service interruptions for cloud customers recently drove home an unpleasant lesson for cloud proponents and the Internet in general: The security and reliability of the cloud is what lawyers call a "rebuttable presumption." In other words, as the old song says, “It ain't necessarily so.”
5
of
Second Shooter
The Real Problem With Cloud Security

8|17|12   |   2:12   |   7 comments


All the recent hoopla about cloud security overlooks an important point, which is that it's not strictly a cloud problem. The linkage of online services into cooperative chains creates the risk, and only biometrics and federation of providers can save us.
Beau Brendler
Terrorism Expert Says US Gave Away Stuxnet Tech

4|4|12   |   3:29   |   9 comments


US counterterrorism expert Richard Clarke, who came to prominence with his prescient warnings before the 9/11 attacks, tells Smithsonian Magazine the US was responsible for the Stuxnet supersmart worm that attacked parts of nuclear reactors in Iran – and in the process, has given away one of the world's most sophisticated cyberweapons.
Second Shooter
Cisco & Linksys: A Problem at the Edge

1|4|13   |   2:15   |   No comments


Cisco's rumored sale of Linksys suggests we may have problem with innovation and profit at the edge of our Internet, and that could be critical to the evolution of many Internet-delivered services.
Mary E. Shacklett
Financial Services Policies Lag Tech Advances

12|4|12   |   2:18   |   6 comments


Regulations haven't kept up with advances in mobile devices and credit cards.
Mary E. Shacklett
Watch Your Business Secrets on Multi-Tenant Clouds

11|26|12   |   1:56   |   1 comment


Multi-tenant clouds assure security for clients, but not necessarily for their ideas. Here's one thing you should discuss with your cloud provider before you sign on.
Wisdom of the Big Chair
FBI Turns Attention to Mobile Security

10|30|12   |   3:45   |   8 comments


The FBI recently issued a warning to smartphone users, highlighting two mobile malware applications: Loozfan, which steals personal information, and FinFisher, which is spyware that takes over a smartphone's functions.
Mitch Wagner
A Humbling Lesson From Libya on Why IT Matters

9|17|12   |   3:09   |   5 comments


Sean Smith, a US Foreign Service IT manager, gave his life in service of his country and the world. His life and death are a humbling example for all of us who work in IT.
Mary E. Shacklett
Enterprises Like SaaS for Social Networking

9|6|12   |   2:04   |   8 comments


Enterprises are discovering that using social networking within the secure setting of a SaaS provider's network gives them an unusual opportunity to freely collaborate with partners, suppliers, and even competitors.
Mary E. Shacklett
Scrum Brings Social MediaThinking to Projects

7|30|12   |   2:12   |   8 comments


The very low-tech "scrum" project technique introduces "crowd talking" to projects and also sets the entire crowd to problem solving. So far, these new social-media-style meetings appear to have supercharged project execution.
Mary E. Shacklett
Microsoft Opens Up Office Options

7|16|12   |   1:38   |   2 comments


Microsoft's recent decision to bundle its Office software with business partner offerings indicates that cloud software may be in the news, but licensed packages are still in demand for failover.
IETV: the thinkerNet on film
5
of
Kim Davis
Big-Data Can’t Always Sell Wine

5|21|13   |   2:23   |   No comments


Whole Foods Global Wine Purchaser Doug Bell told me about some of the constraints on using analytics in the US wine market.
Paul J. Fleuranges
Digital Signage Keeps NYC Subway Straphangers on Track

5|6|13   |   3:51   |   No comments


New York's Metropolitan Transit Authority is conducting a pilot test of digital kiosks to guide subway users to where they want to go more efficiently and at lower cost.
Kim Davis
Fast Forward to the Future

4|23|13   |   2:29   |   20 comments


A look back at tech writing in the 90s makes us wonder where enterprise IT will be 20 years from now.
Mitch Wagner
Google Launches Its Most Depressing Service Yet

4|15|13   |   2:59   |   10 comments


Google's new Inactive Account Manager lets you control how Google disposes of your accounts when you die.
Second Shooter
Argument Over Top-Level Domains Is 'Stupid'

4|11|13   |   2:07   |   3 comments


The whole Amazon.reader debate is a double-stupid. It's stupid to think that there's any e-book buyer who doesn't know Amazon's URL, and it was stupider to let ICANN launch the whole free-form TLD initiative to start with.
Kim Davis
Ladies, Your Tablet Awaits

3|21|13   |   2:22   |   37 comments


ePad Femme is the world’s first tablet “made exclusively for women.”
Wisdom of the Big Chair
NFC Moves Into the Mainstream

3|20|13   |   2:16   |   No comments


While NFC's original goal was to enhance mobile commerce applications, it is finding its way into a number of other uses, which is creating both opportunity as well as challenges for IT departments.
Wisdom of the Big Chair
Integrating Security Into Your Cloud Contract

3|19|13   |   3:35   |   No comments


Enterprises would like to move to cloud computing but are hesitant because they are concerned about providers’ ability to secure company data. Here are some tips that help to ensure that if breaches occur, the business is not left holding the bag.
Brian Baron
How Edmunds.com Collects Customer Information

3|18|13   |   1:15   |   No comments


Edmunds separates customers into segments based on the info it collects on its site and from partners, and uses that to push out custom content, said Brian Baron, director of business analytics for Edmunds.com, at Predictive Analytics Innovation Summit.
Brian Baron
How Edmunds.com Uses Analytics to Customize Site

3|14|13   |   0:47   |   No comments


The automotive website uses propensity modeling to target ads and customer registration forms, said Brian Baron, director of business analytics for Edmunds.com, at Predictive Analytics Innovation Summit.
an IBM information resource
sponsored content
big blue blog
Todd Watson
Todd Watson   5/17/2013   2 comments
It's been 17 years since I've visited the city of Dublin, but I still have some very distinct impressions from my one and only visit.
an IBM information resource
sponsored content
Expert Integrated Systems: Changing the Experience & Economics of IT
In this e-book, we take an in-depth look at these expert integrated systems -- what they are, how they work, and how they have the potential to help CIOs achieve dramatic savings while restoring IT's role as business innovator.

READ THIS eBOOK
your weekly update of news, analysis, and
opinion from Internet Evolution - FREE!

REGISTER HERE
Wanted! Site Moderators
Internet Evolution is looking for a handful of readers to help moderate the message boards on our site – as well as engaging in high-IQ conversation with the industry mavens on our thinkerNet blogosphere. The job comes with various perks, bags of kudos, and GIANT bragging rights. Interested?

Please email: moderators@internetevolution.com
Internet Evolution – not for thickies
Keep Critical Data With a Knowledge Management System
Taimoor Zubair
Fortune 500 companies lose at least
$31.5 billion a year by failing to share knowledge. A Knowledge Management System (KMS) can help companies significantly reduce these costs.

CLICK FOR MORE
IT Suffers From Obama Admin's Jekyll & Hyde Approach to Privacy Rights
Ron Miller
Recently, the Obama administration has been of two minds where privacy rights are concerned. On one hand, you have an administration that vowed to
veto CISPA and mandated open data for government websites. On the other hand, you have an increasingly out-of-control Department of Justice on a fishing expedition at AP and demanding legislation to let the FBI wiretap private, encrypted communications and levy fines if a company fails to comply.

CLICK FOR MORE
Yahoo Needs to Break Tumblr in Order to Fix It
Joe Stanganelli
As
Mitch Wagner discussed today, Yahoo is acquiring Tumblr. The big Internet debate at the moment is whether Tumblr will be good or bad for Yahoo. Regardless of their stances on the future of Yahoo itself, many claim that Yahoo will somehow ruin Tumblr.

CLICK FOR MORE