The Macrosite for News, Analysis and Opinion about the Future of the Internet
Lawrence G. Roberts

Fixing the Internet Traffic Jam, Part I: Larry Roberts

7/29/2008 22 comments
no ratings
DISCUSS   Digg   Del.icio.us   Reddit   Email This   TWEET THIS

What is Internet fairness?

In discussions about P2P (peer-to-peer) traffic, there are widely divergent views on what people's inherent rights are when it comes to sharing Internet capacity.

In designing TCP/IP and the Internet over 40 years ago, no rule was made as to how capacity was distributed at each choke point, but the result was "equal capacity (rate) per flow." This most likely reflected our concept of voice networks. Also, in the early years there really was typically just one flow in each direction per person (used for file transfers, voice calls, typing streams, etc.).

Now, however, computers can divide any single flow, such as a file transfer, into many flows with ease. So if we stick with "equal capacity per flow," the only way for each user to get his fair share is to use more and more flows per application.

Outconsuming your neighbor to get what you need will only lead to an arms race that will cause performance problems for a large part of the population.

For example, because of the inherent properties of P2P, we now see a small fraction (under 5 percent) of users consuming 80 to 95 percent of all network capacity with P2P applications. The rest of us are slowed to a crawl, since our one flow gets the same capacity as each of the many flows allotted to each P2P application.

And P2P applications are almost insatiable. If more capacity is added, P2P takes an even higher fraction of the bandwidth. Currently, there is enough video out there to give P2P applications a virtually unlimited appetite.

Economically, P2P is not egalitarian. Where people are charged a flat rate for Internet access, those not using P2P may be getting far less capacity, and far poorer performance, for the same price as P2P users. This is not an ideal situation for the users, or for service providers or organizations with networks that are compromised by P2P.

Thus, it is time to change the network design to one that inherently supports the concept of "equal capacity for equal payment." The current flow equality is a joint result of the design of TCP and the network. Changing TCP is unworkable and unenforceable. Changing the network turns out to be quite economical and straightforward.

The change only needs to be implemented at the network edge, where each subscriber's traffic can be seen. Network equipment is always controlling the rate of every TCP flow -- today, by making all flows equal in rate. Alternatively, when network equipment measures the traffic per subscriber, this information can be used to control each subscriber's flow rates separately, such that in any short period they all receive equitable capacity for what they pay.

[Ed. note: Dr. Lawrence Roberts is the founder and CEO of Anagran Inc. , a flow-based routing company.]

With network equipment that has been designed to manage overload through flow rate control rather than random packet loss, managing subscriber traffic and honoring SLAs based on subscribed usage rates becomes straightforward.

P2P traffic is just the first of a wave of applications that get more capacity by using multiple flows. We need to change the old concept of "equal capacity per flow" to "equal capacity for equal pay" -- or the arms race for more and more flows will hurt us all.

— Dr. Lawrence G. Roberts, CEO, Anagran Inc.

DISCUSS   Digg   Del.icio.us   Reddit   Email This
Current display:       newest comments first       display in chronological order
Page 1 of 3   Next >
Sox316
Rank: Cave Painter
Sunday November 30, 2008 9:48:06 PM
no ratings
GoodBye encrypted or unencrypted P2P traffic bandwidth monster!....ANAGRAN is beyond DPI box out there in the market today.>TESTED!
Asad
Researcher
Tuesday August 5, 2008 4:55:57 PM
no ratings

One of the possible solutions for dealing the internet traffic jam is making use of network coding. Network coding is a feild of coding which helps in achieving this goal. It can help in using the network resources more effeciently resulting in the reduction of delays for users which ultimately can help in reducing traffic jams. . Researchers have been digging up network coding from past few years. It has been shown that network coding can help in reducing traffic jams alongwith acheiving robustness, security and maximizing throughput.

This feild was first introduced in a paper by R. W. Yeung and Z. Zhang. But the term `network coding' was used in a subsequent paper by R. Ahlswede, N. Cai, S.-Y. R. Li and R. W. Yeung in 2000, where this idea was formally explored. Network coidng has found its ways into many feilds like internet, sensor network, P2P file sharing, unicast and multicast wireless networks etc.

The core idea of network coding is to allow mixing of data at intermediate network nodes. A receiver sees these data packets and deduces from them the messages that were originally intended for that data sink. Network coding gurantees to achieve the maxium possible through using max-flow min-cut theorm. Unfortunately finding optimal network coding solution is NP-complete. Reserchers are doing great jobs to somehow exploit this technique by using some polinimial time, LP solutions or heuristic.

(http://arxiv.org/find/cs/1/au:+Sprintson_A/0/1/0/all/0/1

Still there are a lot of open problems to be addressed.

For example how network coding can help in live peer to peer streaming. Check this paper for detailed contents.

http://www.eecg.toronto.edu/~bli/papers/mwang-jsac07.pdf

In another reserch paper

http://piper.csail.mit.edu/papers/copesc.pdf

authors have introduced an architechture "COPE" that have shown improvement for TCP and UDP.

I think by digging this feild a little more and giving it a chance can help us in fixing traffic  jams.

Asad

Mr. Roques
Researcher
Thursday July 31, 2008 4:53:53 PM
no ratings
So maybe Bush was right all this time? there are several Internets!
Drowlord
Rank: Cyborg
Thursday July 31, 2008 2:56:04 PM
no ratings

P2P isn't inherently stoppable.  There have been only mild attempts to relay and encrypt file sharing technology, because of the internet's "neutrality" towards packets.  However it is surely on the horizon.

Any blocking or filtering technology that becomes prevalent will simply yield a new type of P2P that bypasses the limitation.  I would think that the Web -> Napster -> Morpheus -> Gnutella -> Bittorrent evolution would demonstrate that pirates are more flexible than lawyers and network architects.

Bandwidth limits would do the job nicely.... until someone creates malware designed to chew up a user's paid bandwidth, and an ISP is held accountable for their Denial-of-Service policy.

Personally, I can easily imagine meshes of amateur internets -- possibly connected to, but operationally independent of "The Internet."  At this point, the technology is widely available -- and more importantly, cheap -- to create sophisticated internetworks.  It's unfathomable that someone, somewhere isn't forging a "parrallel universe" for people who disdain the authoritarian nature of the internet as it is currently evolving.

Mr. Roques
Researcher
Thursday July 31, 2008 1:03:02 PM
no ratings

Today AT&T said it will block P2P to try to solve their "congestion problem" and in another news the UK record industry made a deal with the ISPs to spy and degrade the service of subscribers accused of downloading illegal content.

 Do you think that will solve the problem? or that people are so stubborn about stealing that they'll look for some other protocol and even more underground techniques to obtain it?

DontHateCuzImRIGHT
Rank: Cyborg
Thursday July 31, 2008 10:58:53 AM
no ratings

Yes I do tell it like it is. Anything else is, well...boring and superficial (and civil...yawn [guffaw]). I'm not a music industry expert, but I have always heard that very few artists make decent $$$ by touring. Maybe Hannah Montana (lol) does w/ her $1000 tickets. Well...get it while it's hot ya bucked teeth, skinny legged, "Go Girl."  It's expensive -  hotels, meals, buses, air fare, semis hauling the equipment, roadies, drugs, booze, etc etc. Or...go into the studio once, cut a record...then sell a few million copies. Which is more lucrative (even with the economic trickle down to the artists in the record industry)? I'd say the latter.

Humor is key to sanity.

Ahhh...I see the hat/6gun link - albeit, pure coincidence.

jwallace
IQ Crew
Thursday July 31, 2008 10:39:46 AM
no ratings

I see you tell it like how it is, not how it ought to be.

I recall someone saying "Industry rule number 480, record company people are SHADY" - I don't think it's the artists that hurt from giving away their copyright material as more people turn out for their shows and they likely embrace ubiquity first revenue later concept.

how many bands oppose bootleg show exchanges?

I find your generalization of 'Hollywood' amusing -LMAO.

It was the cowboy hat and the ivory gripped silver coated gunshot-6 that resulted in my person..ality comment.

DontHateCuzImRIGHT
Rank: Cyborg
Thursday July 31, 2008 10:13:23 AM
no ratings

I'm right here jwallace. I don't have any split personalities in either world...yet (cyber or the "real" world). Extreme? Me? Is that what ppl think? Ha ha. I'd agree w/ Mike Acker w/ one respect though - as much as I hate all those liberal, free wheeling, happy go lucky, dope smoking, good time rock & rollers (musicians), and those liberal, free wheeling, happy go lucky, cokehead, good time plastic pretenders (Hollywood), I do think that sharing copyrighted material w/o paying for it is...(hold onto to yer skate rat hat; doesn't imply anything, the best snide comment I could come up with this am) is...STEALING.

As far as advertising on the net, that doesn’t bother me (well the Ads do) and is what really keeps the net alive ($$$). As people must breathe, corporations must make $ (even if they p1ss me off with all their stoopit FLASH advertising…eww).

I'm sure though, if the shoe was on the other foot Mr. Wallace, that you would LOVE to give all your copyrighted material away, free, at no charge to all the P2P thieves out there...so you could then supplement your income (or less income from lower sales of your material) by doing something else? As far as P2P goes (like so many things in this Grey world of ours), it's a double edged sword and I’m all for it (in a perverse sort of way). Until the Feds can crack down on these illegal file sharers, P2P can blow up and compromise OSs, then I can supplement MY income by repairing them.

Mike Acker
Rank: Cyborg
Thursday July 31, 2008 9:18:30 AM
no ratings

==>Surely you jest Mike.

Nope

Robb Topolski
Rank: Cave Painter
Wednesday July 30, 2008 11:52:19 PM
no ratings

AT&T must have been reading your mind, because that's exactly what they're doing -- they're stating a floor rate within tiers.

That's a definite improvement, and one that Cable providers will have trouble matching because their shared bandwidth is much smaller and shared with fewer and is more prone to congestion.

Page 1 of 3   Next >
The ThinkerNet does not reflect the views of TechWeb. The ThinkerNet is an informal means of communication to members and visitors of the Internet Evolution site. Individual authors are chosen by Internet Evolution to blog. Neither Internet Evolution nor TechWeb assume responsibility for comments, claims, or opinions made by authors and ThinkerNet bloggers. They are no substitute for your own research and should not be relied upon for trading or any other purpose.
previous posts from Lawrence G. Roberts
Lawrence G. Roberts
There has been widespread discussion lately about the unfairness of the primary protocol we rely on with the Internet – Transmission Control Protocol (TCP) – along with many proposals on how to fix it. Since there are clearly many problems with both slow and unfair service, my question is: Should TCP be overhauled to fix today’s congestion control problem, or does the network itself need fixing?
Lawrence G. Roberts
The Internet has some major problems. The big one involves the cost of supporting the amount of content and services being supplied over the Internet infrastructure. And if it's not fixed soon, the expansion of Internet traffic could outrun our ability to pay for it.
most recent post: hnicolassuero... Great Information!
5
of
IETV: the thinkerNet on film
5
of
2pm EST
Tue
Feb 23rd
2pm EST
Thu
Mar 4th
3pm EST
Tue
Mar 9th
an IBM information resource
sponsored content
big blue blog
Todd Watson
IBM is announcing today the first of its Power7 processor-based systems and the Power7 processor itself at an event in NYC.
white papers & case studies
an IBM information resource
sponsored content
Smarter Collaboration: How to Thrive in a Challenging Business Environment
Market conditions are changing faster than ever, and organizations need to improve their agility and adaptability in order to provide better service and improve processes. The ability to work with customers, business partners, and employees as effectively as possible - while at the same time holding down costs - is a key to success.

READ THIS eBOOK
your weekly update of news, analysis, and
opinion from Internet Evolution - FREE!

REGISTER HERE
Wanted! Site Moderators
Internet Evolution is looking for a handful of readers to help moderate the message boards on our site – as well as engaging in high-IQ conversation with the industry mavens on our thinkerNet blogosphere. The job comes with various perks, bags of kudos, and GIANT bragging rights. Interested?

Please email: moderators@internetevolution.com
CMP Media LLC
Internet Evolution – not for thickies
Congress Hits the Snooze Button With China
Ira Winkler
In his
recent Congressional testimony, Dennis Blair, the U.S. director of national intelligence, stated that the U.S. is "severely threatened" by cyber attacks and that the recent Google (Nasdaq: GOOG) attacks should serve as a wake-up call.

CLICK FOR MORE
Steve Saunders' Outernet
A Hulu Lulu

Part 1 of 3   |  
See complete series
12|9|09   |   2:22   |   6 comments


Hulu is spectacularly popular with users and a total disaster for its owners. What the flegnog do they think they're doing?
Sweeney Blog
Better Web Video & the End of Net Neutrality

12|1|09   |   2:32   |   7 comments


As long as the feds require treating all Internet traffic identically, online video will maintain sub-standard quality.
Sweeney Blog
Microsoft's Relevance in the Windows 7 Era

11|13|09   |   2:17   |   3 comments


The release of Microsoft's newest OS raises the question of the company's relevance in an era when Google dominates applications and search, and Apple runs circles around Redmond with its gadgets and user interfaces.
Full Nelson
Personal Mobile TV Makes Its Debut

10|14|09   |   2:28   |   7 comments


Mobile TV is everywhere, and yet, nowhere. Nobody uses it – because the handsets aren't good, the pricing is too high, and the coverage is not good enough. But Qualcomm's FloTV Personal TV aims to change all of that.
Full Nelson
Go With the FLO, Part 2

Part 2 of 2   |  
See complete series
2|5|10   |   2:17   |   3 comments


Fritz and his sweater continue their review of Qualcomm's FLO TV.
Full Nelson
Go With the FLO, Part 1

Part of 2   |  
See complete series
2|4|10   |   2:39   |   1 comment


Qualcomm's FLO TV gizmo streams live TV shows. Tragically, they include the O'Reilly Factor
Thus Spake Mr. Cramer
3D: It's Baaaaack!

1|22|10   |   3:25   |   8 comments


3D was a pointless, silly gimmick 50 years ago, and it's a pointless, silly gimmick still. It's sure to catch on.
Reiter's Block
If a Google Phone Arrives, Does It Even Matter?

12|17|09   |   02:41   |   13 comments


Techies are going crazy over the possibility that Google might design and sell its own Android phone. Some writers say it's a very big deal. Reiter questions whether it will happen and, if it does, whether it even matters.
TeleGraham
2009: The Year the Internet Went Wireless

12|8|09   |   2:32   |   1 comment


With the number of mobile broadband users more than doubling in 2009, and soon to exceed fixed broadband, the Internet saw a historic transition this year – and the long-term effects are incalculable.
Not Dr. Phil
Comparison Shopping for Broadband – Or Not

12|4|09   |   02:36   |   26 comments


Comparing Internet services is tough because service providers price and market their services based on a best-case scenario connection that most consumers will never enjoy.
Lee H. Berke
The Decline & Fall of Broadcast Television

2|9|10   |   1:00   |   No comments


Want to know the future of broadcast television? Take a look at broadcast radio’s past.
Tom Nolle
Everything New Is Old Again

2|9|10   |   2:13   |   6 comments


Research shows that the youth of today like Facebook – but not blogging or Twitter. Does that mean Facebook has won, or just that it's not yet out of favor? Will all the services we see today fade into Ovaltine-or-Wheaties status in just a few years?
what.the.ferraro
Email Marketing Gets Desperate

2|8|10   |   2:31   |   4 comments


Promotional emails will use just about anything timely to get people to buy things. Seriously, anything.
Steve Saunders' Outernet
America, Truck Yeah!

2|8|10   |   1:42   |   5 comments


Steve likes his new Dodge Ram 1500, but hates Chrysler's Web non-sales strategy. Rant on, li'l buddy.
what.the.ferraro
Twits Go Wild for Resignation Tweet

2|5|10   |   1:48   |   4 comments


Jonathan Schwartz is the first Fortune 200 CEO to resign via Tweet. Can he walk on water, too?
Full Nelson
Go With the FLO, Part 2

Part 2 of 2   |  
See complete series
2|5|10   |   2:17   |   3 comments


Fritz and his sweater continue their review of Qualcomm's FLO TV.
Singer at C-Level
Goldilocks & the Data Center

2|4|10   |   3:39   |   2 comments


What kinds of companies are doing the most innovation in the data center? Turns out it's midtier enterprises that are taking the "Just Right" approach.
Full Nelson
Go With the FLO, Part 1

Part of 2   |  
See complete series
2|4|10   |   2:39   |   1 comment


Qualcomm's FLO TV gizmo streams live TV shows. Tragically, they include the O'Reilly Factor
Eurotrash
High & Dry in Barcelona

2|3|10   |   1:08   |   No comments


Ray’s heading to Barcelona for the Mobile World Congress, and he’s not happy about it, the miserable git.
Sweeney Blog
No Sex, Please... It's the Super Bowl

2|3|10   |   2:24   |   2 comments


The Super Bowl ads that CBS rejected are turning up online, generating lots of attention but zero revenue for the broadcaster.