The Macrosite for News, Analysis and Opinion about the Future of the Internet
Lawrence G. Roberts

Fixing the Internet Traffic Jam, Part I: Larry Roberts

7/29/2008 22 comments
no ratings
DISCUSS   Digg   Del.icio.us   Reddit   Email This   TWEET THIS

What is Internet fairness?

In discussions about P2P (peer-to-peer) traffic, there are widely divergent views on what people's inherent rights are when it comes to sharing Internet capacity.

In designing TCP/IP and the Internet over 40 years ago, no rule was made as to how capacity was distributed at each choke point, but the result was "equal capacity (rate) per flow." This most likely reflected our concept of voice networks. Also, in the early years there really was typically just one flow in each direction per person (used for file transfers, voice calls, typing streams, etc.).

Now, however, computers can divide any single flow, such as a file transfer, into many flows with ease. So if we stick with "equal capacity per flow," the only way for each user to get his fair share is to use more and more flows per application.

Outconsuming your neighbor to get what you need will only lead to an arms race that will cause performance problems for a large part of the population.

For example, because of the inherent properties of P2P, we now see a small fraction (under 5 percent) of users consuming 80 to 95 percent of all network capacity with P2P applications. The rest of us are slowed to a crawl, since our one flow gets the same capacity as each of the many flows allotted to each P2P application.

And P2P applications are almost insatiable. If more capacity is added, P2P takes an even higher fraction of the bandwidth. Currently, there is enough video out there to give P2P applications a virtually unlimited appetite.

Economically, P2P is not egalitarian. Where people are charged a flat rate for Internet access, those not using P2P may be getting far less capacity, and far poorer performance, for the same price as P2P users. This is not an ideal situation for the users, or for service providers or organizations with networks that are compromised by P2P.

Thus, it is time to change the network design to one that inherently supports the concept of "equal capacity for equal payment." The current flow equality is a joint result of the design of TCP and the network. Changing TCP is unworkable and unenforceable. Changing the network turns out to be quite economical and straightforward.

The change only needs to be implemented at the network edge, where each subscriber's traffic can be seen. Network equipment is always controlling the rate of every TCP flow -- today, by making all flows equal in rate. Alternatively, when network equipment measures the traffic per subscriber, this information can be used to control each subscriber's flow rates separately, such that in any short period they all receive equitable capacity for what they pay.

[Ed. note: Dr. Lawrence Roberts is the founder and CEO of Anagran Inc. , a flow-based routing company.]

With network equipment that has been designed to manage overload through flow rate control rather than random packet loss, managing subscriber traffic and honoring SLAs based on subscribed usage rates becomes straightforward.

P2P traffic is just the first of a wave of applications that get more capacity by using multiple flows. We need to change the old concept of "equal capacity per flow" to "equal capacity for equal pay" -- or the arms race for more and more flows will hurt us all.

— Dr. Lawrence G. Roberts, CEO, Anagran Inc.

DISCUSS   Digg   Del.icio.us   Reddit   Email This
Current display:       newest comments first       display in chronological order
Page 1 of 3   Next >
Sox316
Rank: Cave Painter
Sunday November 30, 2008 9:48:06 PM
no ratings
GoodBye encrypted or unencrypted P2P traffic bandwidth monster!....ANAGRAN is beyond DPI box out there in the market today.>TESTED!
Asad
Researcher
Tuesday August 5, 2008 4:55:57 PM
no ratings

One of the possible solutions for dealing the internet traffic jam is making use of network coding. Network coding is a feild of coding which helps in achieving this goal. It can help in using the network resources more effeciently resulting in the reduction of delays for users which ultimately can help in reducing traffic jams. . Researchers have been digging up network coding from past few years. It has been shown that network coding can help in reducing traffic jams alongwith acheiving robustness, security and maximizing throughput.

This feild was first introduced in a paper by R. W. Yeung and Z. Zhang. But the term `network coding' was used in a subsequent paper by R. Ahlswede, N. Cai, S.-Y. R. Li and R. W. Yeung in 2000, where this idea was formally explored. Network coidng has found its ways into many feilds like internet, sensor network, P2P file sharing, unicast and multicast wireless networks etc.

The core idea of network coding is to allow mixing of data at intermediate network nodes. A receiver sees these data packets and deduces from them the messages that were originally intended for that data sink. Network coding gurantees to achieve the maxium possible through using max-flow min-cut theorm. Unfortunately finding optimal network coding solution is NP-complete. Reserchers are doing great jobs to somehow exploit this technique by using some polinimial time, LP solutions or heuristic.

(http://arxiv.org/find/cs/1/au:+Sprintson_A/0/1/0/all/0/1

Still there are a lot of open problems to be addressed.

For example how network coding can help in live peer to peer streaming. Check this paper for detailed contents.

http://www.eecg.toronto.edu/~bli/papers/mwang-jsac07.pdf

In another reserch paper

http://piper.csail.mit.edu/papers/copesc.pdf

authors have introduced an architechture "COPE" that have shown improvement for TCP and UDP.

I think by digging this feild a little more and giving it a chance can help us in fixing traffic  jams.

Asad

Mr. Roques
Researcher
Thursday July 31, 2008 4:53:53 PM
no ratings
So maybe Bush was right all this time? there are several Internets!
Drowlord
Rank: Cyborg
Thursday July 31, 2008 2:56:04 PM
no ratings

P2P isn't inherently stoppable.  There have been only mild attempts to relay and encrypt file sharing technology, because of the internet's "neutrality" towards packets.  However it is surely on the horizon.

Any blocking or filtering technology that becomes prevalent will simply yield a new type of P2P that bypasses the limitation.  I would think that the Web -> Napster -> Morpheus -> Gnutella -> Bittorrent evolution would demonstrate that pirates are more flexible than lawyers and network architects.

Bandwidth limits would do the job nicely.... until someone creates malware designed to chew up a user's paid bandwidth, and an ISP is held accountable for their Denial-of-Service policy.

Personally, I can easily imagine meshes of amateur internets -- possibly connected to, but operationally independent of "The Internet."  At this point, the technology is widely available -- and more importantly, cheap -- to create sophisticated internetworks.  It's unfathomable that someone, somewhere isn't forging a "parrallel universe" for people who disdain the authoritarian nature of the internet as it is currently evolving.

Mr. Roques
Researcher
Thursday July 31, 2008 1:03:02 PM
no ratings

Today AT&T said it will block P2P to try to solve their "congestion problem" and in another news the UK record industry made a deal with the ISPs to spy and degrade the service of subscribers accused of downloading illegal content.

 Do you think that will solve the problem? or that people are so stubborn about stealing that they'll look for some other protocol and even more underground techniques to obtain it?

DontHateCuzImRIGHT
Rank: Cyborg
Thursday July 31, 2008 10:58:53 AM
no ratings

Yes I do tell it like it is. Anything else is, well...boring and superficial (and civil...yawn [guffaw]). I'm not a music industry expert, but I have always heard that very few artists make decent $$$ by touring. Maybe Hannah Montana (lol) does w/ her $1000 tickets. Well...get it while it's hot ya bucked teeth, skinny legged, "Go Girl."  It's expensive -  hotels, meals, buses, air fare, semis hauling the equipment, roadies, drugs, booze, etc etc. Or...go into the studio once, cut a record...then sell a few million copies. Which is more lucrative (even with the economic trickle down to the artists in the record industry)? I'd say the latter.

Humor is key to sanity.

Ahhh...I see the hat/6gun link - albeit, pure coincidence.

jwallace
IQ Crew
Thursday July 31, 2008 10:39:46 AM
no ratings

I see you tell it like how it is, not how it ought to be.

I recall someone saying "Industry rule number 480, record company people are SHADY" - I don't think it's the artists that hurt from giving away their copyright material as more people turn out for their shows and they likely embrace ubiquity first revenue later concept.

how many bands oppose bootleg show exchanges?

I find your generalization of 'Hollywood' amusing -LMAO.

It was the cowboy hat and the ivory gripped silver coated gunshot-6 that resulted in my person..ality comment.

DontHateCuzImRIGHT
Rank: Cyborg
Thursday July 31, 2008 10:13:23 AM
no ratings

I'm right here jwallace. I don't have any split personalities in either world...yet (cyber or the "real" world). Extreme? Me? Is that what ppl think? Ha ha. I'd agree w/ Mike Acker w/ one respect though - as much as I hate all those liberal, free wheeling, happy go lucky, dope smoking, good time rock & rollers (musicians), and those liberal, free wheeling, happy go lucky, cokehead, good time plastic pretenders (Hollywood), I do think that sharing copyrighted material w/o paying for it is...(hold onto to yer skate rat hat; doesn't imply anything, the best snide comment I could come up with this am) is...STEALING.

As far as advertising on the net, that doesn’t bother me (well the Ads do) and is what really keeps the net alive ($$$). As people must breathe, corporations must make $ (even if they p1ss me off with all their stoopit FLASH advertising…eww).

I'm sure though, if the shoe was on the other foot Mr. Wallace, that you would LOVE to give all your copyrighted material away, free, at no charge to all the P2P thieves out there...so you could then supplement your income (or less income from lower sales of your material) by doing something else? As far as P2P goes (like so many things in this Grey world of ours), it's a double edged sword and I’m all for it (in a perverse sort of way). Until the Feds can crack down on these illegal file sharers, P2P can blow up and compromise OSs, then I can supplement MY income by repairing them.

Mike Acker
Rank: Web master
Thursday July 31, 2008 9:18:30 AM
no ratings

==>Surely you jest Mike.

Nope

Robb Topolski
Rank: Cave Painter
Wednesday July 30, 2008 11:52:19 PM
no ratings

AT&T must have been reading your mind, because that's exactly what they're doing -- they're stating a floor rate within tiers.

That's a definite improvement, and one that Cable providers will have trouble matching because their shared bandwidth is much smaller and shared with fewer and is more prone to congestion.

Page 1 of 3   Next >
The ThinkerNet does not reflect the views of TechWeb. The ThinkerNet is an informal means of communication to members and visitors of the Internet Evolution site. Individual authors are chosen by Internet Evolution to blog. Neither Internet Evolution nor TechWeb assume responsibility for comments, claims, or opinions made by authors and ThinkerNet bloggers. They are no substitute for your own research and should not be relied upon for trading or any other purpose.
previous posts from Lawrence G. Roberts
Lawrence G. Roberts
There has been widespread discussion lately about the unfairness of the primary protocol we rely on with the Internet – Transmission Control Protocol (TCP) – along with many proposals on how to fix it. Since there are clearly many problems with both slow and unfair service, my question is: Should TCP be overhauled to fix today’s congestion control problem, or does the network itself need fixing?
Lawrence G. Roberts
The Internet has some major problems. The big one involves the cost of supporting the amount of content and services being supplied over the Internet infrastructure. And if it's not fixed soon, the expansion of Internet traffic could outrun our ability to pay for it.
most recent post: hnicolassuero... Great Information!
5
of
IETV: the thinkerNet on film
5
of
2pm EST
Tue
Dec 1st
an IBM information resource
sponsored content
big blue blog
Todd Watson
Todd Watson   11/20/2009   Post a comment
While Google introduces its new Chrome OS (which I'm hearing will be widely available in one year?  Did I mishear that?), IBM announced 10 new products today to help companies using IBM System z mainframe technology.
white papers & case studies
an IBM information resource
sponsored content
Smarter Collaboration: How to Thrive in a Challenging Business Environment
Market conditions are changing faster than ever, and organizations need to improve their agility and adaptability in order to provide better service and improve processes. The ability to work with customers, business partners, and employees as effectively as possible - while at the same time holding down costs - is a key to success.

READ THIS eBOOK
your weekly update of news, analysis, and
opinion from Internet Evolution - FREE!

REGISTER HERE
Wanted! Site Moderators
Internet Evolution is looking for a handful of readers to help moderate the message boards on our site – as well as engaging in high-IQ conversation with the industry mavens on our thinkerNet blogosphere. The job comes with various perks, bags of kudos, and GIANT bragging rights. Interested?

Please email: moderators@internetevolution.com
Copyright © 2009 United Business Media Limited - All rights reserved.      About Us  |  Privacy Policy and Terms of Use  |  Contact Us
CMP Media LLC
Internet Evolution – not for thickies
Sweeney Blog
Microsoft's Relevance in the Windows 7 Era

11|13|09   |   2:17   |   3 comments


The release of Microsoft's newest OS raises the question of the company's relevance in an era when Google dominates applications and search, and Apple runs circles around Redmond with its gadgets and user interfaces.
Full Nelson
Personal Mobile TV Makes Its Debut

10|14|09   |   2:28   |   7 comments


Mobile TV is everywhere, and yet, nowhere. Nobody uses it – because the handsets aren't good, the pricing is too high, and the coverage is not good enough. But Qualcomm's FloTV Personal TV aims to change all of that.
Tom Nolle
Total Telephony Transcends Telepresence

11|20|09   |   2:11   |   2 comments


The problem with telepresence is that it's not universally accepted, because video calling isn't. While we can all do video calling, we also apparently worry too much about how we look. If we want HD telepresence in our future, we have to dress down, mess up our hair, and dive into our online life.
Robert D. Atkinson
America Has Much to Learn About Digital Piracy

11|18|09   |   2:09   |   No comments


The US loses about $20 billion a year on pirated software, movies, and music. But public policy can help stem the tide of digital theft. For example, France has recently passed a 'three strikes and you’re out' law, whereby if after two warning letters an individual continues to download pirated software then his Internet access will be cut off. US policy makers should consider adopting similar policies.
Reiter's Block
Tweeting for Customer Support

11|18|09   |   2:20   |   No comments


When Reiter gets incensed over incompetent Verizon FiOS order-taking and support, he broadcasts it via Twitter. Did it do any good? How should your company offer Twitter support? Watch this for all the answers.
Not Dr. Phil
Internet & TV in Perfect Harmony?

11|16|09   |   2:22   |   3 comments


A new set-top offers an Internet experience without screwing up what we like about TV.
Tom Nolle
Meatballs & Monetization

11|16|09   |   2:00   |   2 comments


Meatballs aren't an obvious source of monetization for the Internet, but Cloudy With a Chance of Meatballs may well be just that, and might also represent a new dynamic in the complex world of Internet content delivery.
The Incredible Hultquist
Tweet Less, Get More Clicks

11|9|09   |   2:24   |   No comments


Evidence shows that you can tweet too much. Sites and services like Twitter and Facebook are a good place to reach your audience, but think quality over quantity.
Reiter's Block
Slobbering Over the N900

11|4|09   |   2:41   |   11 comments


Techies have been going crazy over the pending release of Nokia's N900 cellular phone, which incorporates a newly revised touch-screen operating system. Reiter's got one. Is the craziness justified?
Steve Saunders' Outernet
The New Information Divide: Part 2

Part 2 of 3   |  
See complete series
11|4|09   |   2:19   |   4 comments


Bad news! By eliminating the world’s digital divide we’re likely to create a new divide: the information divide, where we end up creating a two-tier Internet where access to 'quality' content is controlled and charged for by mega-corporations, and the gulf between information haves and have-nots is entirely dependent on how much money they have. This is, of course, an almost exact inversion of the current situation on the Internet – where access is expensive and content is free.
what.the.ferraro
Facebook Lacks Social Skills

11|20|09   |   1:53   |   No comments


Facebook's 'Suggestions' for users demonstrate how little social networking sites understand about true social relationships.
Singer at C-Level
Smart Grid Opportunities

11|20|09   |   2:49   |   No comments


Industry initiatives and government stimulus funds are giving enterprise software vendors a great opportunity to help build out and manage smart grid technologies.
Tom Nolle
Total Telephony Transcends Telepresence

11|20|09   |   2:11   |   2 comments


The problem with telepresence is that it's not universally accepted, because video calling isn't. While we can all do video calling, we also apparently worry too much about how we look. If we want HD telepresence in our future, we have to dress down, mess up our hair, and dive into our online life.
what.the.ferraro
ThinkerNet Wins Min's Award for Best Blogs!

11|19|09   |   1:13   |   4 comments


ThinkerNet wins the Min's award for 'Best Blogs' – Internet Evolution's fifth award this year!
Full Nelson
SanFran.gov

11|19|09   |   8:51   |   No comments


Fritz has an exclusive talk with the mayor and CTO of San Francisco about that city's latest e-government efforts.
Robert D. Atkinson
America Has Much to Learn About Digital Piracy

11|18|09   |   2:09   |   No comments


The US loses about $20 billion a year on pirated software, movies, and music. But public policy can help stem the tide of digital theft. For example, France has recently passed a 'three strikes and you’re out' law, whereby if after two warning letters an individual continues to download pirated software then his Internet access will be cut off. US policy makers should consider adopting similar policies.
Singer at C-Level
Connecting Stakeholders: Part 3

Part 3 of 3   |  
See complete series
11|18|09   |   2:09   |   No comments


Financial management planning does not need to include Voodoo economics, but it does help to tap into the knowledge base of your team through some sort of real-time system. We explore your options.
Reiter's Block
Tweeting for Customer Support

11|18|09   |   2:20   |   No comments


When Reiter gets incensed over incompetent Verizon FiOS order-taking and support, he broadcasts it via Twitter. Did it do any good? How should your company offer Twitter support? Watch this for all the answers.
what.the.ferraro
Dogster.com More Popular Than Gov 2.0

11|17|09   |   2:05   |   1 comment


A lot of attention is being paid to launching Gov 2.0 Websites, but these sites aren't attracting a lot of visitors.
Reiter's Block
Is the BlackBerry 9700 'Bold' Enough?

11|17|09   |   3:07   |   4 comments


The successor to the BlackBerry Bold 9000 – the Bold 9700 – will be available soon in the US. Is it worth upgrading? Reiter's got one, and offers advice.
TechWeb The Global Leader In Technology Media