Big Data is a field that treats ways to analyze, systematically extract information from, or otherwise deal with data sets that are too large or complex to be dealt with by traditional data-processing application software. Data with many cases (rows) offer greater statistical power, while data with higher complexity (more attributes or columns) may lead to a higher false discovery rat↗1
Data analysis, data analytics and Big Data originate from the longstanding domain of database management. It relies heavily on the storage, extraction, and optimization techniques that are common in data that is stored in Relational Database Management Systems (RDBMS)
Since the early 2000s, the Internet and the Web began to offer unique data collections and data analysis opportunities. With the expansion of web traffic and online stores, companies such as Yahoo, Amazon and eBay started to analyze customer behavior by analyzing click-rates, IP-specific location data and search logs. This opened a whole new world of possibilities.
Although web-based unstructured content is still the main focus for many organizations in data analysis, data analytics, and big data, the current possibilities to retrieve valuable information are emerging out of mobile devices
This is a list of areas where Big Data is the most used:
For example you have NHL Statistics. In this example we will take statistics for Tampa Bay Lightnings(TBA) and Boston Bruins(BOS) from 2018-2019 season split monthly
Tampa Bay Lightning and Boston Bruins results season 2018-2019
| Team→ Month ↓ |
TBL | BOS | ||
|---|---|---|---|---|
| W | L | W | L | |
| October | 8 | 3 | 4 | 6 |
| November | 8 | 5 | 7 | 6 |
| December | 11 | 2 | 10 | 4 |
| January | 6 | 6 | 8 | 3 |
| February | 9 | 4 | 9 | 4 |
| March | 9 | 5 | 11 | 5 |
| April | 7 | 4 | 6 | 8 |
| Total | 58 | 29 | 55 | 36 |
To calculate this value we need to follow these steps:
Imagine you have hundred thousands of data like this. Big Data analysis allows you to predict certain outcomes based on previous occurrences using statistical and mathematical equations