For many marketers, much of the early excitement about the Internet came from the prospect of being able to track everything they wanted to know about their customers. This was particularly important during the first Internet Bubble in the late 1990s, when visitors, more than revenue, were key to so many business plans.
This desire to track Internet visitors generated the field now known as "Web Analytics," which refers to storing and analyzing massive log files that track users.
The changes in the Web analytics industry over time are a mirror of how the overall Internet has evolved. And it's time for another spurt of growth.
The industry was founded in 1993 with the advent of WebTrends, an enterprise-based software tool that read through massive server logs at the speed of molasses, often consuming a large piece of IT resources. The need for real-time storing and processing of data fostered applications for cloud computing -- which, in the late 1990s, operated under the auspices of application service providers (ASPs).
The leading tools of the Web analytics industry -- WebSideStory, Visual Sciences, Coremetrics, Omniture -- several years ago became ASP or cloud solutions. Indeed, even Webtrends, the initial market leader with its roots in enterprise software, would survive only by adding a hosted option.
These ASP solutions relied on JavaScript and cookies, an approach threatened by privacy fears in the early 2000s, when the U.S. government adopted a policy to ban the use of cookies on federal Websites. When the policy was instituted, it initially threatened to set a precedent for broader regulation of cookie use on the Web, but most commercial sites adopted public privacy policies to stem this furor, and the Internet continued to grow. This year, the Obama administration has been working to help crumble this cookie ban and allow government sites to begin learning from visitor behavior.
Having survived the early cookie wars, the Web analytics industry was one of the first to face the specter of “free.” In 2005, Google purchased the Urchin analytics package and launched Google Analytics, a free service whose availability prompts questions about the value of various recent industry mergers.
Whether Adobe or IBM have wasted billions or will prove they can survive even when competing with free remains to be seen. Even in this troubled economy, Web analytics has been one of the few areas where high M&A prices continue unabated.
What does this activity in the Web analytics industry mean? Is it, as some believe, a sign of less innovation as the larger firms like Adobe and IBM focus on profits to appease shareholders?
It’s time for Web analytics to evolve again with the Internet, just as it’s done over time. Most companies continue to be mired in counting clicks and views. But it’s time for some new, fresh takes on the process, particularly as Internet users are finally coming to understand that privacy on the Internet is quite limited and guided more by user actions than by regulation.
It will be interesting to see how the Web analytics industry takes the next step in its evolution, reflecting ongoing trends on the Internet.
— David Silversmith is Vice President Information Technology at FirstBook.org, an organization that provides new books to children in need.
Web Analytics makes perfect sense as long as it is applied keeping in mind the ROI /Cost to the Enterprise deploying the solution.All that data out there on consumers,somebodys Gotta use it.
As for Consumers-Do what I do.Clear your Browser cache every day and Use an Anonymizer...
Brian - great points. I'm not sure as I see these are different issues so much as a spectrum.
At one end of the spectrum is data, pure routine analysis. How many people visited. How many have this browser. How many have this screen resolution. This allows for reporting and tactical decisions.
At the other far far end of the spectrum is information - the result of analysis, A/B testing, real studies of what lures people into and off of the site. This information can be transforming - but requires the involvement, participation and support of both the business people/units and Information Technology.
The Amazons and Googles are on that far end of the spectrum - but so few other companies are and the Web Analytics companies have at least some of the blame for this as all too often they are not helping to migrate their customers from that tactical reporting end to the true business information end of the spectrum.
Web analytics (such as Gomez and keynote) offer great insignt into the customer experience on websites, page load and uptimes. This is very valuable for the IT professional who is monitoring uptime and can react to it. Also, Omniture (embeded tags) offers more marketing type of information that shows what links users click and when.
I think this thread may have hit a fork in the road with two different topics going. While I see the value of user information, I wanted to stop on the pure topic of web analytics for a moment longer.
It seems to me that in terms of web analytics--pure marketing evaluation to include abandonment rates and what lures people further into the site (I know there's more, hence my fork in the road comment)--the thought leaders aren't mainstream.
Yahoo has a genius studying how to paint the screen faster and some websites will email me with "Hey, you were about to buy--what happened?", but I don't see the art of constant analysis regarding ease of doing business on the web pervasively across industries.
So, David, do you see that differently? And, if my sense is right, why do you think that is? My hunch is that it seems theoretical when it is everything but that. Further, I think business people may see the value but need to pull IT along and have a hard time capturing the attention of their counterparts.
Receiving data from visitors is certainly not a right of a website - but it is often part of the exchange for free or discounted services.
Most web sites that are free to the consumer/visitor/user are actually paid for by an advertiser or business that can otherwise gain value from the visitor information.
Take car pricing - Kelley Blue Book and Edmunds and other services used to sell books and then CDs with pricing data (and they still do to a lesser extent) but their real business is now selling advertising on their web site. Because of that advertising they can provide the car valuations for free to the consumer. If you take away the data provided by visitors - the value of that advertising drops dramatically.
Even consider Amazon, with visitor information they are able to respond in ways that brick and mortar book stores could never do. A large part of their growth has been based on the ability to anayze visitor behavior and adapt their web site and what they stock, sell and feature.
If we stop making visitor derived data accessible to marketers - many a business plan will change. Imagine paying for Facebook or Google Docs or the many other "FREE" web 2.0 services.
Just because there is an internet that is used does not necessarily mean that the data that is derived from it has to be accessible by marketers. That was not anywhere in the plan when the internet was created. It's a nice afterthought and a nice fringe benefit, but I don't know if anyone deserves that data just because it can be had. And I am not sure it can be had in the way we want it anyway. Perhaps we work just as hard NOT to provide that data as we do TO provide it?
The saturation point may not be the "analytics" software -- which analyzes and data mines...but the paucity of data itself.
Cookies, in and of themselves, often do not say much about the user. Now in a very large portal site, you might only wish to know which widget sells better, or which image gets more clicks. However, as the web decentralizes into myriads of social networks and twitter threads, at the same time, one needs a rich appreciate of the customer.
In a social network -- the market research is the network. You learn about the customer by letting her tell you about herself...not by placing a tracking tag on the customers hide.
Chris, this consolidation certainly has a component tied to the "preverbal profit wall" that Adobe in particular is reaching. Adobe's profits are very much tied to software sales and then sales of software updates. Web Analytics are tied to annual renewals - a far more renewable revenue stream which is what Adob'e financial analysts were most likely attracted too.
It's also interesting to note that the founder of this industry was Webtrends. In 2001 NetIQ bought Webtrends and during their four year ownersthip tenure Webtrends sank from inudstry leader to the vendor of last choice. Times have changed and Adobe is a different company than NetIQ - but the industry experience does not speak well for a non-analytics company running a web analytics company.
I’m not sure consolidation is a particularly good thing in the analytic industry.I think it will stymie innovation and hamper broader metrics.
Both IBM and Adobe seem to believe there’s gold in them there nuggets, and those are fairly large bets they have made.I think what is really happening is more to your observation, David.These companies have hit the preverbal profit wall and are trying to appease shareholders with a new revenue stream.
Regardless, the consumer probably can anticipate another round of assault on their private data.
The ThinkerNet does not reflect the views of TechWeb. The ThinkerNet is an informal means of communication to members and visitors of the Internet Evolution site. Individual authors are chosen by Internet Evolution to blog. Neither Internet Evolution nor TechWeb assume responsibility for comments, claims, or opinions made by authors and ThinkerNet bloggers. They are no substitute for your own research and should not be relied upon for trading or any other purpose.
In recent years, software manufacturers appeared to be increasing the transparency of communication about bugs. The Internet has allowed for rather rapid delivery of software patches, and Microsoft Corp. (Nasdaq: MSFT) even releases details in its security bulletins and accompanying Webcasts.
Last week, a flawed McAfee Inc. (NYSE: MFE) anti-virus update overloaded enterprise IT staff as the updated signature file quarantined a crucial Windows system file and crippled unknown numbers of Windows XP computers -- causing the computers to shut down until they could be repaired and rebooted.
If Charles Dickens were alive today, his MySpace page would most certainly be headlined by “It was the best of times, it was the worst of times,” for that is the story of MySpace .
The information age is built upon data. Often data is structured in neat spreadsheets and databases. But more often, data is unstructured and stored in text documents, emails, Web pages, books, instant messages, blogs like this, and even Tweets.
Web 2.0 has created numerous scenarios in which enterprise IT policies are at odds with social media. But we are seeing the early signs that the social media vendors have realized that a new focus is required to sustain businesses as customers.
The decision could discourage innovators looking to the past, and require companies to build from the ground up, leading to a new generation of stagnation in the IT world.
Microsoft's buy of Skype could revitalize Phone 7, give Microsoft a social, gaming, and collaborative strategy, and spell the end for old-fashioned telco voice. It will also certainly give Google a headache in its Voice, Chat, and even Android strategy!
Google included a number of consumer-based applications in its latest release of Google Apps, illustrating that the lines between enterprise applications and consumer apps are fading.
Analysts, writers, and – most recently – Steve Jobs have been condemning cellular phone fragmentation. Alan says, "Phooey! Fragmentation is a good thing!"
Techies are going crazy over the possibility that Google might design and sell its own Android phone. Some writers say it's a very big deal. Reiter questions whether it will happen and, if it does, whether it even matters.
Companies used to be confident they'd know exactly what a cellular OS would look like out of the box. Today, that confidence should be fading. Reiter discusses how a cellphone OS's looks could be deceiving, and why businesses need to understand it.
Google Chrome isn't pretty like other OS GUIs, but it's the first OS ever designed from the Internet inward to the desktop instead of the other way around. Crochet a nice border for a Chrome OS window if you like, as long as you realize the world of the cloud will change our conception of desktop computing forever.
New York's Metropolitan Transit Authority is conducting a pilot test of digital kiosks to guide subway users to where they want to go more efficiently and at lower cost.
The whole Amazon.reader debate is a double-stupid. It's stupid to think that there's any e-book buyer who doesn't know Amazon's URL, and it was stupider to let ICANN launch the whole free-form TLD initiative to start with.
While NFC's original goal was to enhance mobile commerce applications, it is finding its way into a number of other uses, which is creating both opportunity as well as challenges for IT departments.
Enterprises would like to move to cloud computing but are hesitant because they are concerned about providers’ ability to secure company data. Here are some tips that help to ensure that if breaches occur, the business is not left holding the bag.
Edmunds separates customers into segments based on the info it collects on its site and from partners, and uses that to push out custom content, said Brian Baron, director of business analytics for Edmunds.com, at Predictive Analytics Innovation Summit.
The automotive website uses propensity modeling to target ads and customer registration forms, said Brian Baron, director of business analytics for Edmunds.com, at Predictive Analytics Innovation Summit.
Expert Integrated Systems: Changing the Experience & Economics of IT In this e-book, we take an in-depth look at these expert integrated systems -- what they are, how they work, and how they have the potential to help CIOs achieve dramatic savings while restoring IT's role as business innovator. READ THIS eBOOK
your weekly update of news, analysis, and
opinion from Internet Evolution - FREE! REGISTER HERE
Wanted! Site Moderators Internet Evolution is looking for a handful of readers to help moderate the message boards on our site as well as engaging in high-IQ conversation with the industry mavens on our thinkerNet blogosphere. The job comes with various perks, bags of kudos, and GIANT bragging rights. Interested?
To save this item to your list of favorite Internet Evolution content so you can find it later in your Profile page, click the "Save It" button next to the item.