BIG DATA

BIG DATA

So what’s this?

It’s just a NAME to a Problem that Industry is facing in the era.

Now What's The Problem

The problem is that the data that we generate is too big for any organization(Google, Facebook, Amazon, etc)to handle but still they are handling! but the question is How they are Managing?

But you must have think that they are a big company they can buy any amount of storage? Right, they can but then there’s another problem rises I/O the speed of writing and reading the data from the HDD/sdd or storage will be affected and so will be the time

And it's not only they have to save it for 2–3 days they have to save the data forever again the problem of Persistent came.

Solution

Distributed Storage

So what's this again?
It’s a method of storing the data in different servers simultaneously to save time and I/O speed.

You can Imagine By yourselves that if you are saving the 10GB of data in single storage that it will take some time but if you cut the data in 1GB parts and then store them it will be much faster to save them on the HDD as compared to the 10GB one coz at the same time we are saving 10 parts of the file compare to 1 file only.

And For that, WE NEED SOME TOOLS
TOOLS:
Hadoop, Cassandra, Drill, and many more

Check Out The Following Links to Know More About The Data That These Tech-Giants are Storing.

Facebook per day data
Google

--

--

--

A learner who is Learning From Anywhere

Love podcasts or audiobooks? Learn on the go with our new app.

Recommended from Medium

To Slot Definition

To Slot Definition

Calculating the Day of the Week with Zeller’s Congruence in Python

Setting up Kubernetes on your local machine via minikube and kubectl.

RedMask — Mask Sensitive Data in Redshift

Here is a lock that we picked recently https://t.co/wTvhKfl1TG https://t.co/Sb9u0muHup

Laravel 9 Image Upload Example

Laravel 9 Image Upload Example

Utilizing QR Codes in Salesforce

Intro to Ruby on Rails

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store
Ashutosh Singh

Ashutosh Singh

A learner who is Learning From Anywhere

More from Medium

Query Optimization Techniques in SQL

Concept of Big Data

Partition by in SQL

Decoding Spark Query — Physical Plan