The Macrosite for News, Analysis and Opinion about the Future of the Internet
Mitch Wagner

Amazon Puts Your Archival Data on Ice

Written by Mitch Wagner
8/21/2012 15 comments
no ratings
DISCUSS     Email This

Amazon has launched a new service for the digital equivalents of wedding dresses and high school yearbooks -- stuff you need to hang on to, but don't need to keep close by.

The company today launched Amazon Glacier, an archival storage service priced as low as one penny per GB per month. The service is designed to simplify and reduce the expense of archiving data, for which enterprises spend time and money on disk, optical media, and tape, requiring hardware maintenance, planning, negotiating with vendors, and managing facilities, according to an Amazon blog.

The capacity is "Terabytes, Petabytes, and beyond," with no upfront fee, and fees only for what's used, Amazon says.

Glacier differs from Amazon S3, its previous cloud storage service, in two respects: First, S3 is optimized for rapid retrieval, generally tens or hundreds of milliseconds per request. "With Glacier, your retrieval requests are queued up and honored at a somewhat leisurely pace. Your archive will be available for downloading in 3 to 5 hours," Amazon says. Users can retrieve up to 5 percent of their average monthly storage, pro-rated daily, for free each month. Beyond that, the retrieval fee is $0.10 per gigabyte. "So for data that you'll need to retrieve in greater volume more frequently, S3 may be a more cost-effective service," Amazon says.

Also, while S3 allows users to pick their own names for objects, Glacier assigns its own unique ID.

Amazon gave several examples of how Glacier might be used: Enterprise IT might use it to store email, corporate file shares, legal records, and business documents that need to be stored for years or decades with little or no reason to access it. Users in digital media can use it to archive books, movies, images, music, news footage, and more -- content that requires a great deal of storage and little access. And Glacier can be used to store scientific or research data.

Glacier, available now, will be helpful to businesses in legal, healthcare, education, and other industries with regulatory requirements for long-term archiving large volumes of data. At the same time, enterprises need to consult with their legal and regulatory officers to ensure that Glacier complies with regulations.

Amazon will have to convince enterprises that its cloud storage is reliable, which might be difficult in light of a recent outage that took down popular services including Netflix, Instagram, Pinterest, and more.

To start using Glacier, users create a named vault, with up to 1,000 vaults per region in an Amazon Web Services account. Uploaded data is called an "archive," and each archive can be up to 40 terabytes. Amazon encrypts data using AES–256. The annual durability -- or error prevention rate, to stop lost or corrupted data -- is 99.999999999 percent per archive, with integrity checks and self-healing permitting the concurrent loss of data in two facilities without losing any customer data.

Amazon explains Glacier in this video:

What do you think? Can Amazon be trusted with archival data?

— Mitch Wagner Circle me on Google+Follow me on TwitterVisit my LinkedIn pageSubscribe to my Facebook feed, Editor in Chief, Internet Evolution

Related posts:

Channel: Enterprise IT
Tags: Blogs, Cloud, Storage
DISCUSS     Email This
Current display:       newest comments first       display in chronological order
Page 1 of 2   Next >
Kim Davis
Thinkernetter
Thursday August 23, 2012 2:27:51 PM
no ratings

I didn't express it well: I meant that I'd want to be fully indemnified by the cloud vendor against any loss arising from (correct) my liability.

Mitch Wagner
Thinkernetter
Thursday August 23, 2012 1:11:12 PM
no ratings

mhhfive - DNA can be replicated without requiring professional assistance. Har har har. 

Mitch Wagner
Thinkernetter
Thursday August 23, 2012 1:10:19 PM
no ratings

Is that even possible, for all the liability to shift to Amazon? Do the regulations require firms to be liable?

Kim Davis
Thinkernetter
Thursday August 23, 2012 11:48:54 AM
no ratings

I'm sure I have some DNA right here, somewhere...

mhhfive
IQ Crew
Wednesday August 22, 2012 7:47:27 PM
no ratings

If retrieval speed isn't important, then maybe we can just store archival data in DNA.

http://www.computerworld.com/s/article/9230401/Harvard_stores_70_billion_books_using_DNA

A gram of DNA is pretty easy to keep around.. and can be replicated easily too for geographically distributed storage...

Kim Davis
Thinkernetter
Wednesday August 22, 2012 2:56:15 PM
no ratings

My main concern would be to ensure that the contract shifts all liability to Amazon should records I'm retaining for regulatory (or litigation) reasons prove impossible to recover.  Penalties for failing to retain records can be steep.

Mitch Wagner
Thinkernetter
Wednesday August 22, 2012 1:09:16 PM
no ratings

More on the pricing issue:

Is there a landmine hidden in Amazon's Glacier?

Wired's Klint Finley initially expresses concern that the pricing structure could contain hidden charges that will run up a big cost for anybody who actually retrieves the data. Later, Amazon corrects that notion, but he's still concerned that an accidental coding error could prove costly. 

Mitch Wagner
Thinkernetter
Wednesday August 22, 2012 1:06:18 PM
no ratings

kq4ym - It's slow by design. It's not designed to be used for materials you need frequent or rapid access too. It's for materials you almost certainly will never need to look at again, but need to hang on to just to be sure. I think the best example is materials that companies are required to hang on to for regulatory reasons, but never actually look at. 

Mitch Wagner
Thinkernetter
Wednesday August 22, 2012 1:04:32 PM
no ratings

antonis - It could prove disruptive for the data archiving industry. 

Mitch Wagner
Thinkernetter
Wednesday August 22, 2012 1:03:47 PM
no ratings

rdv - You're concerned the AES encryption might be insufficient? 

Yes, pricing is a concern. Users need to be careful they don't get surprised by a huge retrieval charge. 

Page 1 of 2   Next >
The ThinkerNet does not reflect the views of TechWeb. The ThinkerNet is an informal means of communication to members and visitors of the Internet Evolution site. Individual authors are chosen by Internet Evolution to blog. Neither Internet Evolution nor TechWeb assume responsibility for comments, claims, or opinions made by authors and ThinkerNet bloggers. They are no substitute for your own research and should not be relied upon for trading or any other purpose.
previous posts from Cloud Clan Editor's Blog
Mitch Wagner
Mitch Wagner   5/22/2013   5 comments
Precor, which makes exercise equipment for gyms and homes, needed to transform itself into a cloud services provider in order to keep up with the changing demands of its customers.
Mitch Wagner
Mitch Wagner   5/17/2013   11 comments
Like other leading technology-using businesses, Walmart is starting to look like a vendor in its integration of the latest technologies to serve its customers. That's what led it to buy two Silicon Valley cloud startups this week.
Mitch Wagner
Mitch Wagner   5/9/2013   9 comments
IT executives are worried about business units that use social media, Dropbox, Skype, and other public clouds without working through IT. This "cloud sprawl" creates concerns about security, compliance, and other potential problems for the enterprise, according to a study.
Mitch Wagner
Mitch Wagner   5/3/2013   13 comments
Rent-A-Center, the US's biggest operator of rent-to-own stores, cut its procurement budget significantly by centralizing purchasing in the cloud.
Mitch Wagner
Mitch Wagner   4/24/2013   2 comments
Cloud computing helped Netflix score a big win this week, meeting a thousandfold increase in demand and driving the Internet video service provider back to profitability. It provided Netflix with "availability, scalability, and cost savings," chief executive officer Reed Hastings wrote in a letter to shareholders.
5
of
Mary E. Shacklett
Watch Your Business Secrets on Multi-Tenant Clouds

11|26|12   |   1:56   |   1 comment


Multi-tenant clouds assure security for clients, but not necessarily for their ideas. Here's one thing you should discuss with your cloud provider before you sign on.
Rachel Schiff
Multnomah County: Migration & Blogging

4|9|12   |   1:15   |   2 comments


Multnomah County's Web content specialist discusses migration and communication on the Multco Commons project.
Bob Tricoski
Multnomah County: Development Perspective on Multco Commons

4|9|12   |   1:17   |   1 comment


Bob Tricoski, senior developer, discusses why usability was his primary concern with the Multco Commons project.
David Austin
Multnomah County: Moving on From 'Old & Clunky'

11|23|11   |   2:16   |   No comments


Dave Austin, communications director for Multnomah County, discusses why he's excited to move from the county's "old and clunky" intranet and onto an open-source platform, and how this change will help him do his job.
Kim Davis
Fast Forward to the Future

4|23|13   |   2:29   |   20 comments


A look back at tech writing in the 90s makes us wonder where enterprise IT will be 20 years from now.
Wisdom of the Big Chair
Integrating Security Into Your Cloud Contract

3|19|13   |   3:35   |   No comments


Enterprises would like to move to cloud computing but are hesitant because they are concerned about providers’ ability to secure company data. Here are some tips that help to ensure that if breaches occur, the business is not left holding the bag.
Second Shooter
It's Not Tablets That Threaten the PC

2|13|13   |   2:21   |   8 comments


Blaming the PC's gloomy future on tablets is an oversimplification.
Wisdom of the Big Chair
Cloud SLAs Tilt to the Vendor

1|3|13   |   3:47   |   No comments


As enterprises move to cloud computing, they need to be sure their vendors will deliver reliable performance.
Second Shooter
The Cloud May Be Taking Over the Internet

11|28|12   |   2:12   |   6 comments


A change in priorities for networking spending could indicate a fundamental shift in Internet architecture that would affect everyone.
Wisdom of the Big Chair
Enterprise Video Collaboration Tools Improve

11|9|12   |   2:17   |   No comments


Trying to reinvigorate their market position, suppliers added significant enhancements to their enterprise video collaboration tools, including enhanced support for mobile systems, virtualization, and cloud solutions.
IETV: the thinkerNet on film
5
of
Kim Davis
Big-Data Can’t Always Sell Wine

5|21|13   |   2:23   |   3 comments


Whole Foods Global Wine Purchaser Doug Bell told me about some of the constraints on using analytics in the US wine market.
Paul J. Fleuranges
Digital Signage Keeps NYC Subway Straphangers on Track

5|6|13   |   3:51   |   No comments


New York's Metropolitan Transit Authority is conducting a pilot test of digital kiosks to guide subway users to where they want to go more efficiently and at lower cost.
Kim Davis
Fast Forward to the Future

4|23|13   |   2:29   |   20 comments


A look back at tech writing in the 90s makes us wonder where enterprise IT will be 20 years from now.
Mitch Wagner
Google Launches Its Most Depressing Service Yet

4|15|13   |   2:59   |   10 comments


Google's new Inactive Account Manager lets you control how Google disposes of your accounts when you die.
Second Shooter
Argument Over Top-Level Domains Is 'Stupid'

4|11|13   |   2:07   |   3 comments


The whole Amazon.reader debate is a double-stupid. It's stupid to think that there's any e-book buyer who doesn't know Amazon's URL, and it was stupider to let ICANN launch the whole free-form TLD initiative to start with.
Kim Davis
Ladies, Your Tablet Awaits

3|21|13   |   2:22   |   37 comments


ePad Femme is the world’s first tablet “made exclusively for women.”
Wisdom of the Big Chair
NFC Moves Into the Mainstream

3|20|13   |   2:16   |   No comments


While NFC's original goal was to enhance mobile commerce applications, it is finding its way into a number of other uses, which is creating both opportunity as well as challenges for IT departments.
Wisdom of the Big Chair
Integrating Security Into Your Cloud Contract

3|19|13   |   3:35   |   No comments


Enterprises would like to move to cloud computing but are hesitant because they are concerned about providers’ ability to secure company data. Here are some tips that help to ensure that if breaches occur, the business is not left holding the bag.
Brian Baron
How Edmunds.com Collects Customer Information

3|18|13   |   1:15   |   No comments


Edmunds separates customers into segments based on the info it collects on its site and from partners, and uses that to push out custom content, said Brian Baron, director of business analytics for Edmunds.com, at Predictive Analytics Innovation Summit.
Brian Baron
How Edmunds.com Uses Analytics to Customize Site

3|14|13   |   0:47   |   No comments


The automotive website uses propensity modeling to target ads and customer registration forms, said Brian Baron, director of business analytics for Edmunds.com, at Predictive Analytics Innovation Summit.
an IBM information resource
sponsored content
big blue blog
an IBM information resource
sponsored content
Expert Integrated Systems: Changing the Experience & Economics of IT
In this e-book, we take an in-depth look at these expert integrated systems -- what they are, how they work, and how they have the potential to help CIOs achieve dramatic savings while restoring IT's role as business innovator.

READ THIS eBOOK
your weekly update of news, analysis, and
opinion from Internet Evolution - FREE!

REGISTER HERE
Wanted! Site Moderators
Internet Evolution is looking for a handful of readers to help moderate the message boards on our site – as well as engaging in high-IQ conversation with the industry mavens on our thinkerNet blogosphere. The job comes with various perks, bags of kudos, and GIANT bragging rights. Interested?

Please email: moderators@internetevolution.com
Internet Evolution – not for thickies
Keep Critical Data With a Knowledge Management System
Taimoor Zubair
Fortune 500 companies lose at least
$31.5 billion a year by failing to share knowledge. A Knowledge Management System (KMS) can help companies significantly reduce these costs.

CLICK FOR MORE
M2M: Rise of the Machines? Not Yet
David Weldon
In the 1970 science fiction thriller
Colossus: The Forbin Project, two giant supercomputers from the United States and Soviet Union secretly join forces to take control of the collective nuclear might of the two countries. In the film, the two machines discover each other's existence, communicate back-and-forth, share their collective data, and cut their human creators out of the process. It is the ultimate example of machine-to-machine communications, or M2M.

CLICK FOR MORE
M2M: Rise of the Machines? Not Yet
David Weldon
In the 1970 science fiction thriller
Colossus: The Forbin Project, two giant supercomputers from the United States and Soviet Union secretly join forces to take control of the collective nuclear might of the two countries. In the film, the two machines discover each other's existence, communicate back-and-forth, share their collective data, and cut their human creators out of the process. It is the ultimate example of machine-to-machine communications, or M2M.

CLICK FOR MORE
M2M: Rise of the Machines? Not Yet
David Weldon
In the 1970 science fiction thriller
Colossus: The Forbin Project, two giant supercomputers from the United States and Soviet Union secretly join forces to take control of the collective nuclear might of the two countries. In the film, the two machines discover each other's existence, communicate back-and-forth, share their collective data, and cut their human creators out of the process. It is the ultimate example of machine-to-machine communications, or M2M.

CLICK FOR MORE
M2M: Rise of the Machines? Not Yet
David Weldon
In the 1970 science fiction thriller
Colossus: The Forbin Project, two giant supercomputers from the United States and Soviet Union secretly join forces to take control of the collective nuclear might of the two countries. In the film, the two machines discover each other's existence, communicate back-and-forth, share their collective data, and cut their human creators out of the process. It is the ultimate example of machine-to-machine communications, or M2M.

CLICK FOR MORE
Yahoo Needs to Break Tumblr in Order to Fix It
Joe Stanganelli
As
Mitch Wagner discussed today, Yahoo is acquiring Tumblr. The big Internet debate at the moment is whether Tumblr will be good or bad for Yahoo. Regardless of their stances on the future of Yahoo itself, many claim that Yahoo will somehow ruin Tumblr.

CLICK FOR MORE