While innovative technology platforms, such as Hadoop, have enabled enterprises to more efficiently store Big Data, these enterprises require solutions that provide rapid response, low cost operations, and easy scalability in addition to the all-important data security and availability benefits.
Big Data management and analytics are a top priority for most institutions today, and with growth rates reaching 100 percent annually, infrastructure capacity and associated costs become a strain. However, business users–from online trading to equity trading and many other application environments–continue to demand analytics against richer and broader data sets for better business insights.
Retention bonuses are a great idea, @swijeyakumar. I wonder whether this is something midsize companies are able to offer, or only a tool available to enterprises. Also, can government agencies offer this perk to big-data experts or is it out of their reach as well? It's going to be interesting to see how organizations get creative to attract and retain big-data experts. I'd imagine we'll see some fantastic internship opportunities, as smaller companies try to lure students to work on projects during their education, too. Sure, that's a BandAid approach, but it will at least get some projects done.
The talent shortage is already evident. Quality people are expensive and many companies particularly in ecommerce and big data are finding the need to headhunt. Signing bonuses are becoming more commonplace and retention techniques like shares with vesting periods of 4 - 5 years are also making a difference.
The one problem with storing big data on the cloud is the privacy issue, storing all that public information on the cloud that need to be mined latter can cause a headache, and even with new privacy preserving techniques in hte market as far as data mining on big data is concerned, there are still those who'd rather not risk it and go in another direction that costs a little more.
It's really the unstructured data that seems to be the problem. If data could be automatically structured into nice schemes, then accessing and analyzing wouldn't be as big a problem... but the trick is getting data to self-organize... :P
Maria I wont worry much about cost only right now since data is more important to me than the cost. If my data is protected properly and is in managable state Im fine with the cost.
If we're lucky, the data is used to improve products, make better predictions about the weather, the economy, and fashion trends, or to develop new drugs and therapies.
I just hope they're not using brain scans to figure out ways to manipulate us into buying more stuff we don't need. :-)
And now I'm suspicious of those mind-reading headsets for video games... what data are they collecting?
How right you are, Mitch! My current client has about 1.8 petabytes on some of the bigggest arrays that money can buy from vendors like EMC and IBM. Compare and contrast that with a former employer, who used commodity servers and Hadoop to house about 1.1 petabytes of data. The client's bill for all that storage runs upwards of $15 million. If the total cost of the Hadoop solution ran over a quarter million dollars, I would be very surprised (the owners, bless their hearts, didn't get rich by throwing their money away). While some wouldn't consider a $350 million a year company all that small, compared to the client, they're a gnat on an elephant's back. Completely different cultures, too. I guess it's all about what you need to do with the data, and what it will cost you to hold and manipulate it. Either way, it's a scary amount of data, and an interesting insight into what companies are doing with the information they gather.
The ThinkerNet does not reflect the views of TechWeb. The ThinkerNet is an informal means of communication to members and visitors of the Internet Evolution site. Individual authors are chosen by Internet Evolution to blog. Neither Internet Evolution nor TechWeb assume responsibility for comments, claims, or opinions made by authors and ThinkerNet bloggers. They are no substitute for your own research and should not be relied upon for trading or any other purpose.
Midsize businesses rarely achieve the same standards of security in their own datacenters as professional providers that specialize in delivering these services to organizations.
It was about 10 years ago when a new generation of software-as-a-service (SaaS) alternatives started to gain acceptance and adoption among organizations of all sizes. And it has only been about five years since Amazon Web Services captured the marketplace's attention with Amazon EC2 and Amazon S3, which opened the door to a vast array of infrastructure-as-a-service (IaaS) offerings. Now, the third piece of the cloud computing puzzle is beginning to win over organizations seeking to build their own apps: platform-as-a-service (PaaS).
Energy consumption is a primary contributor to global warming. At the end of 2012, 40 percent of energy consumption in the US came from commercial and residential buildings.
Big-data and analytics tools enable marketers to understand customers as individuals, identifying unmet needs and addressing each customer as a "segment of one," says John Kennedy, VP corporate marketing, IBM.
New York's Metropolitan Transit Authority is conducting a pilot test of digital kiosks to guide subway users to where they want to go more efficiently and at lower cost.
The whole Amazon.reader debate is a double-stupid. It's stupid to think that there's any e-book buyer who doesn't know Amazon's URL, and it was stupider to let ICANN launch the whole free-form TLD initiative to start with.
While NFC's original goal was to enhance mobile commerce applications, it is finding its way into a number of other uses, which is creating both opportunity as well as challenges for IT departments.
Enterprises would like to move to cloud computing but are hesitant because they are concerned about providers’ ability to secure company data. Here are some tips that help to ensure that if breaches occur, the business is not left holding the bag.
Edmunds separates customers into segments based on the info it collects on its site and from partners, and uses that to push out custom content, said Brian Baron, director of business analytics for Edmunds.com, at Predictive Analytics Innovation Summit.
The IBM Smarter Commerce Global Summit in Monaco kicked into high gear today, and we've already begun to see news emerging from that lovely city-state by the sea.
Expert Integrated Systems: Changing the Experience & Economics of IT In this e-book, we take an in-depth look at these expert integrated systems -- what they are, how they work, and how they have the potential to help CIOs achieve dramatic savings while restoring IT's role as business innovator. READ THIS eBOOK
your weekly update of news, analysis, and
opinion from Internet Evolution - FREE! REGISTER HERE
Wanted! Site Moderators Internet Evolution is looking for a handful of readers to help moderate the message boards on our site – as well as engaging in high-IQ conversation with the industry mavens on our thinkerNet blogosphere. The job comes with various perks, bags of kudos, and GIANT bragging rights. Interested?
To save this item to your list of favorite Internet Evolution content so you can find it later in your Profile page, click the "Save It" button next to the item.
