What is the difference between a Data Engineer and a Data Architect?

🧵[1/x]
A data engineer looks at the immediate set of requirements and works towards that. In other words, data engineers build, rebuild, and tear down. ⚒

Need a new field in the report? Let's just build the whole thing. ⚒

🧵[2/x]
Data Architects think ahead in terms of capacity planning. X years from now, Y will happen, so we'll need to consider Z. In other words, Data Architects look at the full requirements and build it once.😎

This means less waste of money for the company in the long run.

🧵[3/x]
Great conversation between:

- @MaryMacCarthy, Data Advocate at @HightouchData
- Joe Reis founder of @DataTernary
- @InmonBill the father of the #DataWarehouse

Let me share this gem with you: linkedin.com/video/event/ur…

🧵[4/x]
I tweet daily about:

🛠Data Engineering
☁Cloud Computing
👨‍🔬Data Science
📊Data Analytics
📈Data Visualization
🗄Data Management
🤡Data Memes (yes, I know. I love them too)
👨‍💻Code

Follow me because I share free resources!

🧵[5/x]

• • •

Missing some Tweet in this thread? You can try to force a refresh
 

Keep Current with David Regalado

David Regalado Profile picture

Stay in touch and get notified when new unrolls are available from this author!

Read all threads

This Thread may be Removed Anytime!

PDF

Twitter may remove this content at anytime! Save it as PDF for later use!

Try unrolling a thread yourself!

how to unroll video
  1. Follow @ThreadReaderApp to mention us!

  2. From a Twitter thread mention us with a keyword "unroll"
@threadreaderapp unroll

Practice here first or read more on our help page!

More from @thecodemancer_

Jul 20
"Blessing and misfortune are two sides of the same coin. One extreme can transform into another, and there is no right or wrong to this."

🧵[1/x]
During the Han Dynasty, an old man (Sai Weng) living on China’s border one day lost his horse. His neighbors all said what terrible luck that was, and sympathized with the old man. But Sai Weng said: “Maybe losing my horse is not a bad thing after all.”

🧵[2/x]
Lo and behold, the next day the old man’s horse returned, together with a beautiful female horse alongside him. All the neighbors exclaimed: “What great luck!” But the old man responded: “Maybe this is not such good luck after all.”

🧵[3/x]
Read 10 tweets
Jul 18
Did you notice this?

Some #GoogleCloud professional certificates on Coursera have off-platform certification exams. For a limited time, you can get a discount voucher for 20% off the cost of the exam.

This is a 🧵of links to those programs.

🧵[1/x]

@coursera @GoogleCloudTech
Google Cloud Digital Leader Training Professional Certificate lnkd.in/efnhSb57

🧵[2/x] Image
Preparing for Google Cloud Certification: Cloud Data Engineer Professional Certificate lnkd.in/eiwqGYxt

🧵[3/x] Image
Read 7 tweets
Jul 5
💡 Methods for addressing overfitting.



🧵[1/x]

#MachineLearning #ML
1. Increase the number of training examples. I know, I know. Sometimes that's not possible.

🧵[2/x]

#MachineLearning #ML
2. Select a subset of the most relevant features
(👋 hello feature selection!).

🧵[3/x]

#MachineLearning #ML
Read 7 tweets
Jun 25
💡Seven ways to become a more effective founder

Credits to @GoogleStartups

#startups #founders

🧵[1/x]
🚨⚠️People issues are the biggest risk to funded startups.

55% of startups fail because of people problems, according to a study by Harvard, Stanford, and University of Chicago researchers.

🧵[2/x]
1. Minimize unnecessary micromanagement

Micromanaging can be helpful in certain situations, the most effective leaders aim to delegate work in order to scale both themselves and their businesses. Our data suggests that micromanaging can be a fatal flaw for CEOs.

🧵[3/x]
Read 11 tweets
Jun 24
📣Data Engineering Projects for Beginners 2022

👇🧵[1/x]

#dataengineering #python #Docker #developers #aws #GoogleCloud #apacheairflow
Tracking your Uber Rides and Uber Eats expenses through a data engineering process

Technologies and skills:
Python, Docker, Apache Airflow, AWS Redshift, Power BI, data modelling, Task schedulling, ETL and ELT processes, Data warehousing, Cloud

🧵[2/x]

github.com/Wittline/uber-…
Scheduling Big Data Workloads and Data Pipelines in the Cloud with pyDag

Technologies and skills:
Python, Docker, Big Data, Cloud, Google Cloud, Redis, DAG, Parallel Processing, Apache Spark

🧵[3/x]

github.com/Wittline/pyDag
Read 15 tweets
Jun 3
Best websites for data science! 😱

/

¡Las mejores páginas web para aprender ciencia de datos! 😱

🧵⬇ [1/7]

#datascience
Read 9 tweets

Did Thread Reader help you today?

Support us! We are indie developers!


This site is made by just two indie developers on a laptop doing marketing, support and development! Read more about the story.

Become a Premium Member ($3/month or $30/year) and get exclusive features!

Become Premium

Don't want to be a Premium member but still want to support us?

Make a small donation by buying us coffee ($5) or help with server cost ($10)

Donate via Paypal

Or Donate anonymously using crypto!

Ethereum

0xfe58350B80634f60Fa6Dc149a72b4DFbc17D341E copy

Bitcoin

3ATGMxNzCUFzxpMCHL5sWSt4DVtS8UqXpi copy

Thank you for your support!

Follow Us on Twitter!

:(