The Freeland File
Aerospace & Defense
Global Market Data
Lucy P. Marcus
David Cay Johnston
The Great Debate
Jack & Suzy Welch
Macro & Markets
Lipper Awards 2012
Personal Finance Video
Venezuela's Chavez re-elected to extend socialist rule
Chavez supporters party on anticipated win in Venezuela vote
07 Oct 2012
Pressure is on Biden after Obama's lackluster debate performance
07 Oct 2012
Tiny, new African dinosaur species unveiled
04 Oct 2012
Obama acknowledges "bumps in the road" after poor debate
Romney’s strong debate showing puts Europe on edge
Obama and Romney battle over economy at debate
Weak U.S. labor market looms ahead of elections
Our day's top images, in-depth photo essays and offbeat slices of life. See the best of Reuters photography. See more | Photo caption
Battle for Aleppo
The battle for Syria's biggest city. Slideshow
Looking for work
The frontlines of the unemployment crisis. Slideshow
Shopping or browsing on Main St? India's Big Data firms know
Exclusive: Facebook to charge merchants to run offers
Thu, Sep 20 2012
India hit by national strike over economic reforms
Thu, Sep 20 2012
After months of inertia, India unveils big bang reforms
Fri, Sep 14 2012
Analysis & Opinion
Temporary market correction an opportunity to buy
Cauvery River water fight paralyses Bangalore on Saturday
1 of 2. Employees work on their computer terminals on the floor of an outsourcing centre in Bangalore February 29, 2012. The business of storing, decoding and analysing unstructured data - think video, Facebook updates, Tweets, Internet searches and public cameras - along with mountains of facts and figures can help companies increase profits, cut costs and improve service, and is now one of the world's hottest industries. It's called Big Data, and although much of the work is done in the United States, India is getting an increasing slice of the action, re-energising an IT sector whose growth has begun to falter. Picture taken on February 29, 2012.
Credit: Reuters/Vivek Prakash
By Harichandan Arakali and Raju Gopalakrishnan
Sun Oct 7, 2012 5:23pm EDT
BANGALORE (Reuters) - Shopping in a U.S. department store? Surveillance cameras may be watching, and not because you might be a shoplifter.
In minutes, video of which aisles you visited, what products you picked up and put down, what you bought and the displays that caught your fancy will be sent to a company in Bangalore, India.
"These logs can be analyzed to determine propensity to purchase, what a customer's intent, satisfaction, sentiment is," said Dhiraj Rajaram, CEO of Mu Sigma, which says it is among the world's biggest pure-play data analytics companies.
The business of storing, decoding and analyzing unstructured data - think video, Facebook updates, Tweets, Internet searches and public cameras - along with mountains of facts and figures can help companies increase profits, cut costs and improve service, and is now one of the world's hottest industries.
It's called Big Data, and although much of the work is done in the United States, India is getting an increasing slice of the action, re-energizing an IT sector whose growth has begun to falter.
One reason for the emergence of Big Data as India's next big thing in IT is the dramatic fall in the costs of storing and working with huge volumes of data with the advent of cloud computing and open-source software programmes such as Hadoop.
"There are hundreds of (analytics) boutiques in India right now. Every other week I hear some of my friends have started on their own," said Santosh Nair, who quit a job in an IT services provider four months ago to open Analytic Edge.
The Bangalore firm has studied pharmacy sales, population trends and other data to help a U.S. funeral company pinpoint areas for its marketing campaigns.
Others are getting into the business of data storage and processing as costs plummet.
"It doesn't mean I need a server which has 50 terabytes of space. Cloud technology helps me rent space which is cheap," Nair said. "Ten terabytes of space might cost me about $500 a month. It's not expensive."
That amount of data is equivalent to about 20,000 hours of CD-quality music.
Globally, data output last year was estimated at 1.8 zettabytes - 1.8 billion terabytes, or the equivalent of 200 billion full-length high-definition movies.
Millions of networked sensors in cameras, mobile phones and other devices, along with spiraling output from social media sites, are contributing to the data explosion, said a report on Big Data last year by the McKinsey Global Institute.
This has great potential for businesses, it said.
"We are on the cusp of a tremendous wave of innovation, productivity and growth, as well as new modes of competition and value capture - all driven by Big Data as consumers, companies, and economic sectors exploit its potential."
As India stakes its claim in the knowledge-intensive business of Big Data, however, it stands to lose much of the cost advantage that helped it to dominate business-process outsourcing.
Instead, industry officials say, India's success will depend on its large numbers of maths-savvy IT engineers and the skills its IT industry has picked up over 15 years as the world's biggest outsourcing destination.
"The Indian cost benefit is eroding significantly," said Mahinder Mathrani, operating partner at the Symphony Technology Group, a Palo Alto, California-based private equity firm that is in the software and services field.
"In the big data analytics space, it will be more about talent arbitrage," he said. "Good statisticians who have a blend of business acumen and analytic skills and also technical aptitude aren't inexpensive, even in India."
POOL OF TALENT
India's pool of talent will be in demand, with data analytics specialists seen globally in short supply for years to come as Big Data takes off.
But the Indian industry also believes it will gain an advantage from its broader expertise in services.
"We are a services nation," said Sundararaman Viswanathan, a manager at Zinnov, a software consultancy in Bangalore. "For example, we had the Internet and we built the outsourcing industry around it. We are extremely good at it."
"We can build a service which is around asking the right questions, and putting together the insights and giving it to the customer."
India's National Association of Software and Services Companies (Nasscom) forecasts that the Big Data business in India will be worth as much as $1.2 billion within three years, a six-fold increase from current levels.
That would be double the growth rate it expects for Big Data worldwide: to $25 billion from $8.25 billion.
"It's an industry where, because of cost, skill, language and ability to learn, India stands a very, very strong advantage," said Rajeev Baphna, CEO of Bangalore-based data services company Analyttica.
"India started to focus on creating a space in this field by leveraging a number of advantages it has: One, talent; two, the ability to have a very strong process-driven delivery at lower costs that the services industry has mastered."
It's not just boutique firms that have entered the field. The giants of India's outsourcing such as Infosys Ltd and Wipro Ltd have also moved into the Big Data business, but smaller firms may be better placed to deliver.
"The larger, well-established companies have a challenge," said Symphony Technology's Mathrani.
"Their existing business models preclude them from being nimble. This is not about migrating work already being done somewhere else. It's about solving business problems for which no specification exists."
GROWTH IN OUTSOURCING
Globally, Big Data is used in a multitude of applications.
IBM Corp has a team of 5,000 crunching data to help oil companies find, extract and process oil more efficiently.
General Electric Co said in May it could spend up to $1.5 billion to acquire data analytics companies, aiming to mine multiple data points and find ways to extend how long gas turbines, jet engines and other heavy equipment can run without unscheduled maintenance.
In retail, the scope of Big Data is enormous. McKinsey has estimated that a retailer using Big Data to the full, including trends from social media such as Twitter and Facebook, can increase operating margins by more than 60 percent.
Healthcare, insurance, banking and other financial services are also big users.
For India's IT industry as a whole, the surge in Big Data comes at an opportune moment.
India's exports of software and IT services, which make up the outsourcing industry, should grow 11 to 14 percent to $77 billion to $79 billion in the year ending March 2013, according to Nasscom. But this is a tapering off from 20-plus percent growth a few years ago.
In addition, outsourcing and offshoring in the financial industry - about 30 percent of the total - has come under fire and will likely face stricter supervision after recent lapses involving offshore units in India.
These include accusations by the New York State banking regulator in August that Standard Chartered Plc hid $250 billion in transactions with Iran and that the entire foreign asset compliance process of its New York branch was outsourced to Chennai, India, with no evidence of any oversight or communication between the Chennai and New York offices.
In Big Data, however, while the revenue numbers are still small, the mood is upbeat.
"We think this is just the tip of the iceberg," said Rajaram at Mu Sigma. "The world is only going to change faster and faster and faster. There will be more data, more algorithms, more applications, more new technologies."
His eight-year-old company is growing rapidly, and the average age of his 2,000 staff is about 25 or 26, he said.
"It's like hiring a bunch of Tony Starks, train them on the Iron Man Suit and they go out and defeat the bad guys." (Editing by John Chalmers and Edmund Klamann)
Related Quotes and News
We welcome comments that advance the story through relevant opinion, anecdotes, links and data. If you see a comment that you believe is irrelevant or inappropriate, you can flag it to our editors by using the report abuse links. Views expressed in the comments do not represent those of Reuters. For more information on our comment policy, see http://blogs.reuters.com/fulldisclosure/2010/09/27/toward-a-more-thoughtful-conversation-on-stories/
Back to top
New York Legal
Support & Contact
Connect with Reuters
Our Flagship financial information platform incorporating Reuters Insider
An ultra-low latency infrastructure for electronic trading and data distribution
A connected approach to governance, risk and compliance
Our next generation legal research platform
Our global tax workstation
About Thomson Reuters
Thomson Reuters is the world's largest international multimedia news agency, providing investing news, world news, business news, technology news, headline news, small business news, news alerts, personal finance, stock market, and mutual funds information available on Reuters.com, video, mobile, and interactive television platforms. Thomson Reuters journalists are subject to an Editorial Handbook which requires fair presentation and disclosure of relevant interests.
NYSE and AMEX quotes delayed by at least 20 minutes. Nasdaq delayed by at least 15 minutes. For a complete list of exchanges and delays, please click here.