The Macrosite for News, Analysis and Opinion about the Future of the Internet
DISCUSS   PRINT   Digg   Del.icio.us   Reddit   Email This   TWEET THIS

Alex Payne, Software Engineer, Twitter

Written by Nicole Ferraro
8/18/2008 5 comments

Twitter, the microblogging service launched in 2006, gets some mixed reviews here on Internet Evolution. But there's no denying its current popularity. Whether to document their impending lunch plans, or to promote a new business, the masses are flocking to Twitter with their every thought bubble and hiccup.

But can Twitter stay afloat without having yet established a firm business plan? (Twitter has raised $20.4 million in funding.) With its frequent outages, will it make a comeback before its users flock to rapidly emerging Twitter clones? Can Twitter serve any real business purpose beyond promoting mindless chatterfests about lunch meat?

Internet Evolution spoke with Twitter software engineer, Alex Payne, about all of the above and more -- including future plans for development, expanding the Twitter demographic, and his new site -- DownForEveryoneOrJustForMe -- letting Web users see whether a site is universally inaccessible, or if the trouble is with their connection.

Internet Evolution: What's the real reasoning behind the Twitter outages?

Alex Payne: It's a mix of things. And it sort of depends on what era in Twitter's brief history you're talking about. In early 2007, it was simply that Twitter started as a side project and was fairly under-resourced in terms of both machines and developers. So, for certainly the first few months after the South by South West conference in 2007, when Twitter really started to take off, we just didn't have enough servers to meet the demand and that sort of thing. But, once it became more of a full-time project, it was really a matter of the design of the system, I think, that was responsible for its outages. I've written a little bit about that on the Twitter developer blog, but I've pretty much just said that a messaging system was built out of components that were more appropriate for a content management system. It didn't scale well, it wasn't particularly fault tolerant. That kind of thing.

IE: What's being done right now to prevent future outages?

Payne: We're building a better system. Part of the engineering team is working on building a proper messaging system that borrows more from an engineering perspective from the way a phone company might design a system than the way a Web publication developer would design a system.

IE: How's it going, and how long are we looking at before something is in place?

Payne: So far it's going pretty well. We're developing in kind of a modular way. Some components of it are already live, some will be going live over the next few months. In the meantime, this past month has been one of the best in terms of stability, and message delivery, and of course new user signups -- that kind of thing. We have a better handle on the current system, and we're gradually transitioning it to a newer, more reliable system. So we're in a pretty good place.

IE: How is Twitter standing up to competitors, like Pownce and FriendFeed? Isn't it likely that Twitter users will migrate to a similar service if they have to deal with consistent outages?

Payne: Well, certainly we see that, when we're down, there are fewer signups -- obviously if people can't complete the signup process and that kind of thing. We certainly see more conversations about competing services when the service is unstable.

We don't necessarily view FriendFeed as a competitor, as a majority of data actually comes from Twitter, and they consume a stream of public updates from us, and we're in contact with their founders and development team. FriendFeed is a way for people to take conversations or ideas that popped up on Twitter and to continue that discussion in more of a threaded format which is useful for a certain audience but is not what Twitter is for. As far as we're concerned, that's a symbiotic relationship, not competition.

Likewise, Pownce, to my understanding, is still a fairly small community and is still fairly localized to the Bay Area. We do see people cross-posting status updates to Twitter and Pownce, and whatever the competition of the week is. And it's fine. The philosophy we've had for a while is you should be able to get data in and out of Twitter however you want, and send your status wherever you like. We keep our API open to make that possible, and if people want to use multiple services alongside Twitter so they can keep up with a different group of friends, that's fine.

To Page Two

DISCUSS   PRINT   Digg   Del.icio.us   Reddit   Email This
Page 1 of 5 Next >
Current display:       newest comments first       display in chronological order
Murugan
IQ Crew
Tuesday August 26, 2008 8:59:58 AM
no ratings
It seems for organizations to reduce transaction cost and achieve competitive advantage at a quicker rate, the Ruby on Rails framework, is a powerful tool to achieve just that.
al3x
Thinkernetter
Thursday August 21, 2008 2:57:29 PM
Rails definitely makes it easier to move faster.  I've worked with a number of different languages and frameworks when developing web applications and I'm certainly the most productive with Rails; I think the rest of the Twitter team agrees.  That said, while agility is an asset for the user-facing part of our site, the speed of developing in Ruby hasn't always been an asset for back-end services.  I'm guessing that 2009 will see a lot of the larger Rails sites moving to other technologies to do the heavy lifting, and letting Rails do it what it does best: agile development of simple database-driven web applications.
Murugan
IQ Crew
Wednesday August 20, 2008 10:24:58 AM
no ratings
I joined Twitter a few weeks ago and despite not having a web-enabled mobile device, I’ve been enjoying using Twitter.

One of things that intrigued me about Twitter was its use of the Ruby language as well as the Ruby on Rails framework.   Have you found that to enhance the development experience in the sense that it makes it easier to deploy the solutions?

It’s a great tool that I can see more organizations using it to strengthen the bond with their “customers” in attaining competitive advantage.
al3x
Thinkernetter
Tuesday August 19, 2008 12:57:28 PM

Happy to answer your questions, Michael.

1) Transitioning from the old system to the new system has been a challenge, but designing the new system has taken much more thought-work than finding the integration points.  We don't have a lot of room to get the new system right, so the team working on it has had to be very exacting in their specifications.

2) I'm not sure the "Fail Whale" is the most informative error page we could have chosen.  When we show it to users, though, we clearly don't have the capacity to give them a more dynamic, customized response.  At the very least, I'd suggest that other sites struggling with scale constantly communicate - whether through their error pages, company blog, emails to users, whatever - about why they're down and what their status is.  Users want to know that you're having the same frustrating experience they are, and that you're working on fixing it.

Michael Singer
IQ Crew
Monday August 18, 2008 7:26:30 PM
no ratings

Alex,

Thanks for being honest about what Twitter can and can't do these days. It sounds like more features are in the works. I'm encouraged to hear about your plans for Summize. We love using Twitter as a communication device. Our writers and editors are able to highlight must-read content and readers respond in real time.

A couple of follow up questions

1) What has been harder? The technology behind building a better service? or trying to implement layers of changes over the existing infrastructure to keep it running? We hear from many vendors that rip and replace is becoming the better of the two options.

2) While the Fail Whale is cute, no one wants to see it, especaially your team. Would you recommend a similar straightforward user notification for other companies trying to cope with scale?

twitter.com/MichaelSinger

The ThinkerNet does not reflect the views of TechWeb. The ThinkerNet is an informal means of communication to members and visitors of the Internet Evolution site. Individual authors are chosen by Internet Evolution to blog. Neither Internet Evolution nor TechWeb assume responsibility for comments, claims, or opinions made by authors and ThinkerNet bloggers. They are no substitute for your own research and should not be relied upon for trading or any other purpose.
a moderated blogosphere of internet experts
Don Reisinger
Don Reisinger   7/30/2010   4 comments
In big cities or well populated suburban areas of the United States, broadband is ubiquitous. Getting it is as easy as calling the local cable company and asking to send someone over to hook it up. But in other areas around the country, broadband is non-existent. And the sheer number of people without it might surprise some of the luckier Web users who have high-speed Internet connections.
Jart Armin
Jart Armin   7/29/2010   11 comments
Router hacking and modem security is in the news again, thanks to a presentation at Black Hat in Las Vegas this week and to the associated sensational press response.
Dee-Ann LeBlanc
The beauty of the digital world is that it offers logs and metrics. This can also be a huge problem. Many organizations base everything, from investment value to performance bonuses to what an author is paid per piece, solely on these metrics.
Jeff Kaplan
Jeff Kaplan   7/29/2010   3 comments
As the array of cloud computing alternatives expands, the debate regarding industry standards seems to escalate. The idea of standards is not new to the technology industry, but applying these principles to the cloud computing environment poses unique challenges.
André Amoranto
Most of us would hate to live in a house made of glass. Yet that is what the Internet is -- a big glass house into which many people can peer and see where you are surfing and what you are up to.
IETV: the thinkerNet on film
5
of
2pm EDT
Thu
Sep 2nd
2pm EDT
Thu
Sep 30th
an IBM information resource
sponsored content
big blue blog
Todd Watson
Todd Watson   7/29/2010   Post a comment
IBM announced today it has entered into a definitive agreement to acquire Storwize, a privately held company based in Marlborough, Mass.
white papers & case studies
an IBM information resource
sponsored content
Getting to Work on Smart Work: How IT Is Transforming the Implementation of the 'Internet of Things'
Organizations in all industry sectors are becoming more instrumented, interconnected, and intelligent -- and that's changing the way they approach virtually every facet of their operations. It's up to IT to help organizations adopt a "Three I's" approach that leverages the emerging Internet of Things and enables them to work smarter.

READ THIS eBOOK
your weekly update of news, analysis, and
opinion from Internet Evolution - FREE!

REGISTER HERE
Wanted! Site Moderators
Internet Evolution is looking for a handful of readers to help moderate the message boards on our site – as well as engaging in high-IQ conversation with the industry mavens on our thinkerNet blogosphere. The job comes with various perks, bags of kudos, and GIANT bragging rights. Interested?

Please email: moderators@internetevolution.com
Internet Evolution – not for thickies
Sweeney Blog
Tweets Show West Is Best

7|30|10   |   2:47   |   No comments


Hey, Eastern Timezoners: Lighten up! Or at least Tweet happier thoughts.
Reiter's Block
Inside RIM’s Tablet Survey

7|29|10   |   2:50   |   2 comments


Research in Motion recently emailed a survey about smartphone use and tablet computer preferences. Could it be a prelude to a RIM tablet? Of course!
Second Shooter
Let’s Make Up Our Minds on Copyright

7|29|10   |   2:07   |   2 comments


There's a public-policy war on copyright that nobody is winning, and inconsistencies in viewpoint and interpretation seem to be multiplying. We need to step back and think our policies over again, or we risk having a strategy that fails everyone.
The Sole Man
Cloud-Based Video Sharing: Not Promising

7|28|10   |   2:49   |   1 comment


Ultraviolet is an industry-wide attempt to standardize video content delivery across multiple platforms. Apart from the fact that it’s based in the cloud, relies on the DRM system, and isn’t backed by Apple… it sounds great!
Wisdom of the Big Chair
Using the Web to Clean the Gulf

7|28|10   |   2:12   |   3 comments


The Internet played a key role in disseminating information and helping with the Gulf cleanup. Bravo, Internet!
Second Shooter
The Third Way or the Highway

7|27|10   |   2:09   |   4 comments


The FCC's Sixth Broadband Report has a hidden secret. But here’s a hint: The regulatory body plans to regulate broadband as a telecommunications service.
Singer at C-Level
I Predict You Will Watch This Video

7|27|10   |   1:59   |   No comments


Wouldn’t it be great to be able to predict what your customers want before they know they want it? Check our our latest tutorial about Predictive Analytics to find out how: www.internetevolution.com/tutorial-predictive-analytics.asp
The Sole Man
Shiver Me Timbers

7|26|10   |   2:21   |   No comments


Digital pirates find easy pickings in the open waters of the Internet. Aaarrrrrr!
Cirque Du Solez
Spontaneity Gives New Meaning to 'On the Road'

7|26|10   |   1:46   |   6 comments


Once defined by epic journeys, planning, and maps, the phrase "on the road" takes on new meaning in a digital age, where we can make all our decisions using our connected devices en route.
what.the.ferraro
Facebook the Movie... Awful

7|23|10   |   2:39   |   6 comments


Nothing quite says jumping the gun like making a movie about a six-year-old company.

Enabling People and Organizations to Harness the Transformative Power of Technology