While innovative technology platforms, such as Hadoop, have enabled enterprises to more efficiently store Big Data, these enterprises require solutions that provide rapid response, low cost operations, and easy scalability in addition to the all-important data security and availability benefits.
Big Data management and analytics are a top priority for most institutions today, and with growth rates reaching 100 percent annually, infrastructure capacity and associated costs become a strain. However, business users–from online trading to equity trading and many other application environments–continue to demand analytics against richer and broader data sets for better business insights.
Retention bonuses are a great idea, @swijeyakumar. I wonder whether this is something midsize companies are able to offer, or only a tool available to enterprises. Also, can government agencies offer this perk to big-data experts or is it out of their reach as well? It's going to be interesting to see how organizations get creative to attract and retain big-data experts. I'd imagine we'll see some fantastic internship opportunities, as smaller companies try to lure students to work on projects during their education, too. Sure, that's a BandAid approach, but it will at least get some projects done.
The talent shortage is already evident. Quality people are expensive and many companies particularly in ecommerce and big data are finding the need to headhunt. Signing bonuses are becoming more commonplace and retention techniques like shares with vesting periods of 4 - 5 years are also making a difference.
The one problem with storing big data on the cloud is the privacy issue, storing all that public information on the cloud that need to be mined latter can cause a headache, and even with new privacy preserving techniques in hte market as far as data mining on big data is concerned, there are still those who'd rather not risk it and go in another direction that costs a little more.
It's really the unstructured data that seems to be the problem. If data could be automatically structured into nice schemes, then accessing and analyzing wouldn't be as big a problem... but the trick is getting data to self-organize... :P
Maria I wont worry much about cost only right now since data is more important to me than the cost. If my data is protected properly and is in managable state Im fine with the cost.
If we're lucky, the data is used to improve products, make better predictions about the weather, the economy, and fashion trends, or to develop new drugs and therapies.
I just hope they're not using brain scans to figure out ways to manipulate us into buying more stuff we don't need. :-)
And now I'm suspicious of those mind-reading headsets for video games... what data are they collecting?
How right you are, Mitch! My current client has about 1.8 petabytes on some of the bigggest arrays that money can buy from vendors like EMC and IBM. Compare and contrast that with a former employer, who used commodity servers and Hadoop to house about 1.1 petabytes of data. The client's bill for all that storage runs upwards of $15 million. If the total cost of the Hadoop solution ran over a quarter million dollars, I would be very surprised (the owners, bless their hearts, didn't get rich by throwing their money away). While some wouldn't consider a $350 million a year company all that small, compared to the client, they're a gnat on an elephant's back. Completely different cultures, too. I guess it's all about what you need to do with the data, and what it will cost you to hold and manipulate it. Either way, it's a scary amount of data, and an interesting insight into what companies are doing with the information they gather.
The ThinkerNet does not reflect the views of TechWeb. The ThinkerNet is an informal means of communication to members and visitors of the Internet Evolution site. Individual authors are chosen by Internet Evolution to blog. Neither Internet Evolution nor TechWeb assume responsibility for comments, claims, or opinions made by authors and ThinkerNet bloggers. They are no substitute for your own research and should not be relied upon for trading or any other purpose.
Social media has been with us for a decade -- but employer policies and the law are anything but firm about the most appropriate usage of this powerful tool.
Businesses often struggle to decide which domain to use. When it comes to purchasing a domain name, you have plenty of extensions to choose from, ranging from .com and .net, to .me, and even .mobi. But which one should you pick?
I've been writing about how the next evolution of the Internet might just be an advertising revolution, and how corporate IT can stay involved as the enablers and providers of the technologies that make this possible.
In the 1970 science fiction thriller Colossus: The Forbin Project, two giant supercomputers from the United States and Soviet Union secretly join forces to take control of the collective nuclear might of the two countries. In the film, the two machines discover each other's existence, communicate back-and-forth, share their collective data, and cut their human creators out of the process. It is the ultimate example of machine-to-machine communications, or M2M.
New York's Metropolitan Transit Authority is conducting a pilot test of digital kiosks to guide subway users to where they want to go more efficiently and at lower cost.
The whole Amazon.reader debate is a double-stupid. It's stupid to think that there's any e-book buyer who doesn't know Amazon's URL, and it was stupider to let ICANN launch the whole free-form TLD initiative to start with.
While NFC's original goal was to enhance mobile commerce applications, it is finding its way into a number of other uses, which is creating both opportunity as well as challenges for IT departments.
Enterprises would like to move to cloud computing but are hesitant because they are concerned about providers’ ability to secure company data. Here are some tips that help to ensure that if breaches occur, the business is not left holding the bag.
Edmunds separates customers into segments based on the info it collects on its site and from partners, and uses that to push out custom content, said Brian Baron, director of business analytics for Edmunds.com, at Predictive Analytics Innovation Summit.
The automotive website uses propensity modeling to target ads and customer registration forms, said Brian Baron, director of business analytics for Edmunds.com, at Predictive Analytics Innovation Summit.
Expert Integrated Systems: Changing the Experience & Economics of IT In this e-book, we take an in-depth look at these expert integrated systems -- what they are, how they work, and how they have the potential to help CIOs achieve dramatic savings while restoring IT's role as business innovator. READ THIS eBOOK
your weekly update of news, analysis, and
opinion from Internet Evolution - FREE! REGISTER HERE
Wanted! Site Moderators Internet Evolution is looking for a handful of readers to help moderate the message boards on our site – as well as engaging in high-IQ conversation with the industry mavens on our thinkerNet blogosphere. The job comes with various perks, bags of kudos, and GIANT bragging rights. Interested?
To save this item to your list of favorite Internet Evolution content so you can find it later in your Profile page, click the "Save It" button next to the item.
M2M: Rise of the Machines? Not Yet David Weldon In the 1970 science fiction thriller Colossus: The Forbin Project, two giant supercomputers from the United States and Soviet Union secretly join forces to take control of the collective nuclear might of the two countries. In the film, the two machines discover each other's existence, communicate back-and-forth, share their collective data, and cut their human creators out of the process. It is the ultimate example of machine-to-machine communications, or M2M. CLICK FOR MORE
M2M: Rise of the Machines? Not Yet David Weldon In the 1970 science fiction thriller Colossus: The Forbin Project, two giant supercomputers from the United States and Soviet Union secretly join forces to take control of the collective nuclear might of the two countries. In the film, the two machines discover each other's existence, communicate back-and-forth, share their collective data, and cut their human creators out of the process. It is the ultimate example of machine-to-machine communications, or M2M. CLICK FOR MORE
