Discover and read the best of Twitter Threads about #Apachespark

Most recents (4)

🎯 You should know 7 things to become successful in
#dataengineering career 🔥

📌 Credit - Shri Ajay Kadiyala ji ✅

🧵👇
Read 9 tweets
📍 The need for data compression📍
🧵
When we talk about computation time we are also talking about money, data compression represents the most appropriate economic way to shorten the gap between content creators and content consumers.
Compressed files are obviously smaller and it is necessary less money and time to transfer them and cost less money to store them, content creators pay less money to distribute their content, and content consumers pay less money to consume content.
On the other hand, companies in all sectors need to find new ways to control the rapid growth of their data heterogeneous generated every day, data compression and decompression techniques are one of the most viable solutions to these problems. #bigdata
Read 9 tweets
Excellent piece via @noyesk on why #apachespark and #hadoop are #BigData buds arkinv.st/1YeSSeu
2/ While Spark can be 10-100X faster than #Hadoop's #MapReduce, the analytic engines (MapReduce & Spark) have different use cases
3/ #apachespark built to sit on top of #Hadoop, b/c it's an analytic engine while #Hadoop is a #BigData file system and orchestrator
Read 3 tweets

Related hashtags

Did Thread Reader help you today?

Support us! We are indie developers!


This site is made by just two indie developers on a laptop doing marketing, support and development! Read more about the story.

Become a Premium Member ($3.00/month or $30.00/year) and get exclusive features!

Become Premium

Too expensive? Make a small donation by buying us coffee ($5) or help with server cost ($10)

Donate via Paypal Become our Patreon

Thank you for your support!