Forum Views ()
Forum Replies ()
Read more with google mobile :
Analysis: Crunching Big Data more than a byte-sized bet
|
Edition:
U.S.
Article
Comments (0)
Follow Reuters
Facebook
Twitter
RSS
YouTube
Read
Obama holds big 2012 lead over Republicans
4:06pm EDT
China warns U.S. debt-default idea is "playing with fire"
2:15pm EDT
Americans rated most hilarious in global poll
07 Jun 2011
Healthcare battle unfolds in Atlanta court
3:20pm EDT
Apple's Jobs shows off "spaceship" headquarters plan
4:24pm EDT
Discussed
73
”The world is getting warmer”: Romney
70
Moody’s sounds alarm over U.S. debt limit and deficits
56
Diamond says time to withdraw as Fed nominee
Watched
Bodypainters apply their skill
Mon, Jul 19 2010
Four-year-old takes art world by storm
Mon, Jun 6 2011
Bernanke sparks fifth-day fall
3:02am EDT
small business
Talent search favors tech giants
Recruiters say the Web 2.0 hiring boom, which counters nationwide unemployment above 9 percent, shows no sign of abating. And startups are having to be very creative to lure potential hires away from Google and other tech giants. Full Article
Silicon Valley recruiter: "Everyone's desperate"
5 reasons to join a startup after graduating
Analysis: Crunching Big Data more than a byte-sized bet
Tweet
Share this
Email
Print
Related News
Oil jumps as OPEC talks fail, eyes Saudi solo hike
2:50pm EDT
RSA offers to replace SecurIDs after Lockheed hacking
Tue, Jun 7 2011
Apple's Jobs takes stage to talk iCloud
Mon, Jun 6 2011
Euro touches 3-week high, posts worst month since November
Tue, May 31 2011
Lockheed says frequent cyber target from around world
Sun, May 29 2011
Analysis & Opinion
Tech envy: It’s a jungle out there
The digital wallet soon to be in every pocket
Related Topics
Technology »
Media »
A man looks at stock market prices on computer monitors inside a securities company in Taipei January 15, 2009.
Credit: Reuters/Nicky Loh
By Sayantani Ghosh
BANGALORE |
Wed Jun 8, 2011 3:37pm EDT
BANGALORE (Reuters) - Download a full-length movie on your computer and you'll need about 700 megabytes of space. Now multiply that digital mass by 2.7 trillion.
That's roughly how much digital data the world will spit out this year -- a mind-boggling pile of real-time information, which, when processed and analyzed, holds the key to faster service at retailers, better customer care at banks and speedier diagnosis when you visit the doctor.
Market research firm IDC, which pegged 2008 global digital output at 180 exabytes -- 1 exabyte is a little over 1 billion gigabytes -- expects that to jump 10 times this year and reach 35,000 exabytes by 2020.
The tech industry calls it Big Data.
"Think of a stack of DVDs reaching from earth to the moon and back," said David Thompson, Chief Information Officer at Symantec, a firm that manages, searches and secures large data sets.
Every phone call made, web page clicked, e-mail sent and online game played leaves data crumbs. These are now being analyzed in real-time to predict trends, spot potential problems and help find quick solutions.
Tibco Software and Informatica, bigger names including Salesforce.com Inc and IBM, and private firms such as Cloudera and Splunk are looking to cash in on this data tsunami -- betting on the potential returns from scouring and analyzing the data, and so helping customers improve their businesses.
Traditionally, data is stored in vast data warehouses, formatted into something the database can understand, and analyzed at the end of the week or month, if at all.
"Because of the volumes and the ways in which data is generated today, centralized database systems are no longer adequate," said Cloudera CEO Mike Olson.
"Computers are getting faster at a pretty good pace, but data is getting big at a much faster pace."
Businesses, seeking a competitive edge, are no longer satisfied with hindsight analysis. They need swift on-the-go insight to learn more, faster, and to pre-empt problems. And they're turning to companies that can offer that.
"The promise and scope of Big Data is that within all that data lies the answer to just about everything," Tibco CEO Vivek Ranadivé told Reuters.
CASE STUDY
Every month, Reliance Communications, India's No.2 mobile carrier by subscribers, and a Tibco client, adds some 3 million customers, but loses 1 million.
Tibco's analysis of available data found that for every 6 calls dropped by Customer Care, one customer switched to a rival service provider. Armed with that, Reliance offered free text messages to those customers before they switched, and saw a dramatic drop in churn, Ranadivé said.
Customer engagement is tracked very closely and, by applying sophisticated analytics, companies can see what aspects of a product customers like and what they don't, BofA Merrill Lynch said in a recent note.
Tibco's revenue jumped 21 percent in fiscal 2010, to $754 million, and it increased its R&D spend by 15 percent. Its shares have risen 5-fold in 2 years to their highest since the dotcom bubble a decade ago, but have dropped 16 percent in the last 4 weeks as markets have broadly been sold off.
VOLUME, VELOCITY, VARIETY
"Big Data is more than just volume. It's also about velocity of information and variety of information," said James Markarian, Chief Technology Officer at Informatica.
His company sees the concept as the coming together of three trends -- a deluge of transaction data such as orders, payments, storage and travel records; interaction data from social media sites; and warehousing to handle and store the data.
Informatica's products help integrate data in various formats from different data sources, making it easier to get into, and search, masses of data.
The soaraway popularity of smartphones and mobile devices, legions of newcomers to the Internet, rapid growth in online shopping and the spread of Facebook and Twitter are big drivers of Big Data.
"Maybe I'm collecting tweets and doing sentiment analysis about my brand; maybe I want to understand what users do when they visit my site, where do they go? what do they look at? what links do they click?" said Olson at Cloudera, which builds software applications on clients' databases.
Healthcare, too, is undergoing massive digitalization, as medical records are created and stored, and medical imaging is transferred to digital form in databases.
Last quarter, non-profit U.S. healthcare provider Oschner used Informatica to improve the quality of data in its legacy system, migrate that to a new system, and protect confidential medical records.
The potential value from real-time data mining in the U.S. healthcare sector alone could be worth more than $300 billion a year, much of that just from cutting costs by about 8 percent, according to a report by market researcher McKinsey.
U.S. oil company Chevron Corp accumulates some 2 terabytes of data a day -- 1 terabyte is 1,024 gigabytes -- while the Large Hadron Collider, the world's largest particle accelerator, can generate data at 40 terabytes a second, the McKinsey report said.
Informatica increased its R&D spend last year by more than a third to over $100 million, and its revenue rose 31 percent. Its shares have also risen strongly and last week hit a life high of $59.98.
PEERING INTO DARK CAVES?
"Some of the most valuable data is also some of the most challenging to take advantage of, and that's called machine data," said Steve Sommer, Chief Marketing Officer at Splunk, a machine data management company inspired by spelunking, a U.S. term for caving, or potholing.
Sommer said much of this data can't be analyzed through traditional approaches as it doesn't have a standardized format -- for example, the many different types of Facebook posts.
Customers want to be able to constantly add, work with and understand terabytes of data in real time, he noted.
"And they need the flexibility to add, at a moment's notice, any format of data, and they want a system that can immediately understand the data and come up with insights for them."
Splunk, which has Salesforce.com, Facebook and the newly public LinkedIn Corp among its clients, likes to think it's the 'Google for data' -- looking in customers' hardware, databases, servers and networks to understand the infrastructure and see how this can be parsed to help the business.
McKinsey has warned of a shortage of analytical talent to make the most of Big Data, saying the United States alone needs 140,000-190,000 people with the necessary analytical skills.
"Big Data will become a larger liability instead of an asset for most organizations," said Symantec's Thompson.
"Data needs to be handled intelligently and this is an opportunity for IT departments to really get their head around what type of data they have, what they retain long term and what's of true value to the corporation."
With the useful life of data dropping dramatically, so is the amount of time to do something about it.
"The answer is not to try to build the mother of all databases. The answer is to extract the right data at the right time and put it in the right context," said Tibco's Ranadivé.
"You don't need Big Data if you have the right little data."
(Reporting by Sayantani Ghosh in Bangalore, Editing by Ian Geoghegan)
Technology
Media
Related Quotes and News
Company
Price
Related News
Tweet this
Link this
Share this
Digg this
Email
Reprints
We welcome comments that advance the story directly or with relevant tangential information. We try to block comments that use offensive language, all capital letters or appear to be spam, and we review comments frequently to ensure they meet our standards. If you see a comment that you believe is irrelevant or inappropriate, you can flag it to our editors by using the report abuse links. Views expressed in the comments do not represent those of Reuters.
Comments (0)
Be the first to comment on reuters.com.
Add yours using the box above.
Social Stream (What's this?)
© Copyright 2011 Thomson Reuters
Editorial Editions:
Africa
Arabic
Argentina
Brazil
Canada
China
France
Germany
India
Italy
Japan
Latin America
Mexico
Russia
Spain
United Kingdom
United States
Reuters
Contact Us
Advertise With Us
Help
Journalism Handbook
Archive
Site Index
Video Index
Reader Feedback
Mobile
Newsletters
RSS
Podcasts
Widgets
Your View
Analyst Research
Thomson Reuters
Copyright
Disclaimer
Privacy
Professional Products
Professional Products Support
Financial Products
About Thomson Reuters
Careers
Online Products
Acquisitions Monthly
Buyouts
Venture Capital Journal
International Financing Review
Project Finance International
PEhub.com
PE Week
FindLaw
Super Lawyers Attorney Rating Service
Reuters on Facebook
Thomson Reuters is the world's largest international multimedia news agency, providing investing news, world news, business news, technology news, headline news, small business news, news alerts, personal finance, stock market, and mutual funds information available on Reuters.com, video, mobile, and interactive television platforms. Thomson Reuters journalists are subject to an Editorial Handbook which requires fair presentation and disclosure of relevant interests.
NYSE and AMEX quotes delayed by at least 20 minutes. Nasdaq delayed by at least 15 minutes. For a complete list of exchanges and delays, please click here.
Other News on Thursday, 9 June 2011 Niners wideout Michael Crabtree crabby about quarterback Alex Smith
German exports drop 5.5% to more sustainable growth rate
Philippine high court stops Boracay reclamation project
Websites test expanded Internet addressing system
Andy Murray triumphs at Queens Club; Hantuchova winner at Aegon Classic
Inventor designs solar powered bikini
Beyonce responds to early album leak
Lady Gaga's "Born This Way" keeps #1 on Billboard albums chart despite huge drop
Guizhou floods kill 52 in China, 100,000 flee
Brazil's Rousseff tries to move on after aide quits
|
Death toll in Haiti's floods, mudslides rises to 23
|
Unlikely bin Laden in Abbottabad for 5 years: ex-ISI head
|
Reese Witherspoon joins bachelor party for next comedy
Beer and Facebook don't mix, says SEC
|
RIM buys social gaming company Scoreloop
|
Apple's Jobs shows off spaceship headquarters plan
|
EBay seeks acquisitions to speed impulse buys
|
Analysis: Crunching Big Data more than a byte-sized bet
|
Vieira makes farewell appearance on Today show
|
Unpublished Dylan lyrics to be sold in New York
|
Rapper Ja Rule sentenced to two years in prison
|
CSI star Laurence Fishburne quits show
|
Super 8 opening one day early in Twitter promo
|
Willie Nelson on the road and off the hook on pot charge
|
Obreht youngest winner of UK's Orange fiction prize
|
Western, Arab talks to focus on Libya end-game
|
Insurgents shoot dead nine wedding guests in Afghan east
|
Peverly nails two goals as Bruins dominate Canucks to even series at 2-2
Ben Ainslie continues hold on top spot at Finn class at Sail for Gold
China says no expiry date on Communist Party rule
|
Tulowitzki delivers in the ninth as Rockies rally past Padres
Texas Rangers draft partially-paralyzed player from Georgia
Al-Qaedas al-Zawahiri vows to continue Osamas jihad against West
Militant attack in Pakistan's northwest kills at least 20
|
McDonalds fish sandwiches in Europe to have blue eco-label
Bahrain's unseen protests fall on deaf ears
|
Cain goes the distance to lead Giants past Nationals
Germany defends E.coli response as death toll rises
|
Ex-Duke basketball player Tom Emma died in fall from Midtown club
Syrians cross Turkish border to flee violence
Somalia rival leaders agree to defer elections
|
Peoples Liberation Army (PLA) confirms Chinas construction of its first aircraft carrier
Citi says hackers access bank card data
|
Coupons.com raises $200 million in private round
|
Videogame publishers in surprise move back Nintendo
|
Hacking crisis costs EMC reputation in security
|
U.S. urges code of conduct for Internet commerce
|
CSI star Laurence Fishburne leaves show
|
Lindsay Lohan wins restraining order against man
|
First Lady Michelle Obama to appear on iCarly
|
Super 8 opening one day early in Twitter promo
|
Shania Twain to resume career with Vegas residency
|
Willie Nelson off the hook on pot charge
|
Syrians flee into Turkey to evade crackdown
|
Yemen awaits possible Saleh return after surgery
|
Six powers push defiant Iran to address nuclear fears
|
Special Report: Qatar's big Libya adventure
|
Special Report: After Japan, where's the next nuclear weak link?
|
Croatia charges former official with war crimes
|
Japan finance minister a frontrunner to be next PM
|
In media win, Apple to relax rules for publishers: report
|
HP's TouchPad will debut July 1 for $500
|
Videogamers seek more peace, less war
|
Aid workers welcome Burmese refugee census
Microsoft loses U.S. top court case on patent
|
Thousands rally in Mogadishu opposing prime minister's resignation
Sixers explore options for Iguodala trade; swap for Clips' Kaman possible
Nokia CTO on leave amid report of strategy disarray
|
Ex-Ohio State quarterback Pryor faces new allegations, uncertain future
Greek public workers strike over austerity measures
RIM can't grab Nokia space with delayed launches: Citi
|
Ke$ha, Pitbull headline Conan Concert Series
Study: Minority kids greater consumers of media
Taylor Swift, Justin Bieber win CMT Music Awards
Mandisa Dlamini, You don't know the real Gugu Dlamini
Blue Jays Adam Lind on a roll since coming off DL
Visa inks deals for mobile payments push
|
Smartphone deliveries seen up 55 percent in 2011: IDC
|
J.J. Abrams goes back to future in Super 8
|
Sarah Ferguson films return from emotional bankruptcy
|
Edinburgh Fringe festival seen biggest yet in 2011
|
Greece at new risk of being pushed off euro
Bodies of missing Tenn. mom, Jo Ann Bain, and daughter found
Female Breasts Are Bigger Than Ever
AMD Trinity Accelerated Processing Units Now in Volume Production
The Avengers (2012 film), made the second biggest opening- and single-day gross of all-time
AMD to Start Production of piledriver
Ivy Bridge Quad-Core, Four-Thread Desktop CPUs
Islamists Protest Lady Gaga's Concert in Indonesia
Japan Successfully Broadcasts an 8K Signal Over the Air
ECB boosts loans to 1 trillion Euro to stop credit crunch
Egypt : Mohammed Morsi won with 52 percent
What do you call 100,000 Frenchmen with their hands up
AMD Launches AMD Embedded R-Series APU Platform
Fed Should not Ignore Emerging Market Crisis
Fed casts shadow over India, emerging markets
Why are Chinese tourists so rude? A few insights