Big Data And The BI Paradigm

Company Focus:  EMC, GreenPlum, Information Builders, Hadoop, Microsoft, Oracle, Forrester Wave

  • Update 02/07/13
    Read Full Article on Hadoop Emerging as Dominant Big Data Analytics Platform
  • Update 02/06/13
    Remarkable Opportunities For Those Who Break Thru The Walls
    Read Full Article on
  • Update 12/10/12
    Microsoft Assists Global Weather Channel With BI Solution
    Read Case Study

Attended a luncheon hosted by EMC, GreenPlum and Information Builders so I could learn more about what is meant by Big Data, understand the business challenges evolving with Big Data and how the right tools can open up some key opportunities for those with strategies in place to embrace the changing landscape.

EMC/GreenPlum is one player in the game and a key player according to the Forrester Wave diagram.

A few takeaways from the luncheon regarding Big Data Solutions
– scalability is key
– integration
– consume internal data sources
– consume external data sources
– structured data
– unstructured data
– predictive analysis insights
– business flexibility
– product agnosticism

Big Data is anything over 12TB.
Big Data requires bigger tools.
The IRS Database is ~200TB and growing.

What is Big Data [Jeff Zakrzewski, VP Sogeti USA]

Technology Trends for 2013 [11/29/12]
#6 on the list –> Strategic Big Data
Organizations need to focus on non-traditional data types and externa data sources. Hadoop and NoSQL gain momentum. Big data will meet social. Five richest big data sources on the Web include social graph, intent graph, consumption graph, interest graph and mobile graph. Concept of single corporate data warehouse is dead. Multiple systems need to be tied together.

Hadoop is a Bandaid for Oracle BI Difficiences [10/18/12]

The need to go beyond Hadoop [10/29/12]
According to the report, how a business manages large sets of structured and unstructured data growing at a rapid pace is still evolving, but deploying only one tool, like Hadoop, is not cutting it.

Hadoop is Hot but Not that Hot
Of the 89% of respondents using relational databases for big data, 93% indicated they also employed a secondary big data tool.
Businesses need to leverage internal and external data sources to game competitive advantage while managing a low TCO.
If we define BI as the integration of internal and external data sources to provide a 360 degree view of ourself, our competitors, our clients and the evolving social paradigm, we need to think beyond Microsoft, Oracle, Hadoop and other tools.

BI brings the ability to perform data analysis, predictive analysis and statistical correlation analysis; it provides the ability to see the answers to problems when we haven’t even asked the right questions yet.

New York City Solves Problem With Big Data Tools
Problem:  The number of fire fighter deaths was steadily increasing each year.

During fires, fire fighters were getting caught in ‘death traps’ or unexpected situations where safety codes had been violated.

The building plans on file were followed but the building entrances, exits, hallways, firedoors, etc were not up to code.

Why were the plans out of date and How did things get disjointed?
They needed a means to identify what the probable causes were.

As the Zig Zigler quote goes “If you can dream it, you can achieve it.”
So they dreamed.

They brought all of the data sources together into a single system.
And they found the answer but not where they had expected.

They found a direct correlation between the most safety violations and the most landlord complaints.

Armed with that information, they are now better prepared to identify the who, when and where of the next buildings that will be renovated and which are the most likely to evade safety codes.  Prevention is worth a pound of cure.

It’s easy to find the solutions when you have the right tools.

The hard part is finding the right tools.

The right tools make all the difference in user adoption, competitive advantage and the overall total cost of ownership (TCO) calculations and ultimately ROI.

Forrester Wave Diagram of Big Data Tools

The right tools provide competitive advantage and often, a very different user experience
Massaging the available data sources together can provide for interesting results.
– internal structured (CRM, ECM, ERP, Financials)
– internal unstructured (Email, Collaboration Sites, Public Site)
– external (Google, Credit Card Purchases, Facebook, LinkedIn, Twitter, Pinterest, etc.)

Example #1
Two people walk into Target and purchase the same products
– the 1st person receives a coupon for $4 off their next purchase of their favorite beer
– the 2nd person receives a coupon for $5 off their next purchase of baby formula
* and the baby isn’t even born yet!

Example #2
Two people drive by the same Starbucks
– the 1st person receives a text message on their phone about a BOGO (Buy One Get One) Latte special
– the 2nd person receives a text message coupon for $1 off their favorite breakfast item

If you are not intentional about your strategy, the results are obvious.
Be intentional.

What’s your strategy for managing and harvesting Big Data?

This entry was posted in Big Data, Business Intelligence, User Adoption. Bookmark the permalink.

One Response to Big Data And The BI Paradigm

  1. Pingback: Data: It’s What’s for Dinner | The SharePoint Effect

Leave a Reply

Fill in your details below or click an icon to log in: Logo

You are commenting using your account. Log Out /  Change )

Google+ photo

You are commenting using your Google+ account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )


Connecting to %s