Big Data Analytics & Business (By Yaju Gupta)

Contents

1. Business & Business Intelligence
2. Intelligent Decision Making 
3. Factors affecting BI capability

4. Data Analytics
5. Importance of Data Analytics 
6. Big Data
7. Advantages of Big Data Analytics
8. Challenges in BDA
9. Big Data Analytics Model
10. BDA Implementation

11. Real world BI Examples

Business
 
Dealing in any activity to earn profit. For example: Selling or Buying of  goods and services (products)  

Business Intelligence 

A set of theories, methodologies, architectures and technologies that transform raw data into meaningful and useful information for business purposes.

BI helps in identifying, develop & create new business strategies and effective decision making through historical, operational and predictive views of business operations.

Intelligent Decision Making

Real time / On time availability of High Quality Information for decision making process  regarding a scenario, situation or problem under consideration

Factors affecting BI capability

Amount, Type, Efficiency and Output format of the analyzed data to be used by decision makers.

Data Analytics

The process of reviewing existing data with multiple angles / dimensions with the intention of finding new additional information based on retrieved co-relations / hidden patterns

Importance of Data Analytics

Organizations uses data for the optimized utilization of all available resources in order to achieve  predefined goals ( Decision making )

Nowadays, organizations are more reliant on data to drive business decision to foster innovation & development  

As per IBM, a very large amount of data being created on daily basis: (In Terra / Zetta Bytes)

Big Data 

Very large in size ( In TB / ZB ), Structured to Unstructured, and Generates very fastly on continuous basis from multiple locations.
( Dimensions : Volume, Variety  & Velocity )

For example : Sensor data (Climate data), CCTV Data, Log Files, Posts on S-N sites, Online Shopping sites data, Call Records, Airlines Data, Hospitality Data, Wikipedia Text and Images

Advantages of Big Data Analytics

1. Higher Customer Satisfaction
2. Improved Business Processes
3. Increased Revenue
4. Reducing Operating Cost and Time
5. Gaining Competitive  Advantages of Business
6. Customized Products ( On Individual customer basis )

Challenges in BDA

Capturing, Storing, Searching, Classification , Clustering,  Analyzing and Visualization of data 

Requirement of running S/w applications on number of nodes in parallel to process a very huge amount of data 

Big Data Analytics Model: Map Reduce Programming Model

A distributed programming model that support parallel processing of data on number of nodes 

Components of Map Reduce : 

1. Input Reader 
2. Output Writer
3. Map and Reduce Function  
4. Partitioning Function  
5. Comparison Function

BDA Implementation

Apache Hadoop Framework  ( 100 % Open Source ): An Implementation of Map Reduce Programming Model

# A Java based framework to process data in parallel on a distributed computing environment  ( Cloud Computing )

# Provides new way of storing and analyzing a huge amount of data ( In TB / ZB ) 

# Cost Effective solution

Hadoop Components

# Map Reduce Framework
# Hive ( Data Analytics & SQL Development )
# Cluster ( Data Loading : Sqoop and Flume )
# Zookeeper ( Hadoop Services Management )
# Ozzie ( Nodes Management )
# HBase ( NoSql - Database )  
# Distributed File System (HDFS)
				
Power Of Hadoop

# Distributed File System
# Fast data transfer rate in between various nodes
# Easier and Quick Recovery from any failure with minimal interruption of services
				
Design Consideration 

# Emerging M2M Communication based market
# Locations, Devices and Network associated with data
# Processing of Complex and Unstructured data 
# Gaining Competitive Advantages of Business

Real world BI Examples 

Business Intelligence has infinite potential uses in organization. BI solutions are used by almost all kind of organizations or companies to drive business decisions. For example :

Telecom Domain
To decide either to invest their resources into securing new customers or engage existing ones and turn them into repeat buyers ( Customer behaviors analysis ) 

Retail Domain
To create better shopping experience for customers and making  business profitable ( By putting trends together to stock popular items before they became in high demand and afterward inventory will not stuck with excess )

Market Research 
To engage relevant customers, illuminate customer trends and uncover their needs & personal preferences ( Historical data analysis ) 

Hospital Quality and Efficiency of Care 
To achieve the goal of having every patient seen by a doctor within 45 minutes of arrival or to improve efficiency of care ( Patients Arrival, Doctors Availability, Turnaround & Bed availability metrics analysis ) 

Sales Forecasting
Historical, Operational and Predictive analysis using Sales data 

Credits
Yajuvendra Gupta

Tags: Big Data,