Tweet

David Regalado

Aug 3 • 6 tweets • 3 min read

What is the difference between a Data Engineer and a Data Architect?

🧵[1/x]

A data engineer looks at the immediate set of requirements and works towards that. In other words, data engineers build, rebuild, and tear down. ⚒

Need a new field in the report? Let's just build the whole thing. ⚒

🧵[2/x]

Data Architects think ahead in terms of capacity planning. X years from now, Y will happen, so we'll need to consider Z. In other words, Data Architects look at the full requirements and build it once.😎

This means less waste of money for the company in the long run.

🧵[3/x]

@MaryMacCarthy

Great conversation between:

- @MaryMacCarthy, Data Advocate at @HightouchData
- Joe Reis founder of @DataTernary
- @InmonBill the father of the #DataWarehouse

Let me share this gem with you: linkedin.com/video/event/ur…

🧵[4/x]

I tweet daily about:

🛠Data Engineering
☁Cloud Computing
👨‍🔬Data Science
📊Data Analytics
📈Data Visualization
🗄Data Management
🤡Data Memes (yes, I know. I love them too)
👨‍💻Code

Follow me because I share free resources!

🧵[5/x]

@threadreaderapp

@threadreaderapp unroll

• • •

Missing some Tweet in this thread? You can try to force a refresh

This Thread may be Removed Anytime!

Twitter may remove this content at anytime! Save it as PDF for later use!

More from @thecodemancer_

David Regalado

@thecodemancer_

Jul 20

"Blessing and misfortune are two sides of the same coin. One extreme can transform into another, and there is no right or wrong to this."

🧵[1/x]

During the Han Dynasty, an old man (Sai Weng) living on China’s border one day lost his horse. His neighbors all said what terrible luck that was, and sympathized with the old man. But Sai Weng said: “Maybe losing my horse is not a bad thing after all.”

🧵[2/x]

Lo and behold, the next day the old man’s horse returned, together with a beautiful female horse alongside him. All the neighbors exclaimed: “What great luck!” But the old man responded: “Maybe this is not such good luck after all.”

🧵[3/x]

Read 10 tweets

David Regalado

@thecodemancer_

Jul 18

@coursera

Did you notice this?

Some #GoogleCloud professional certificates on Coursera have off-platform certification exams. For a limited time, you can get a discount voucher for 20% off the cost of the exam.

This is a 🧵of links to those programs.

🧵[1/x]

@coursera @GoogleCloudTech

Google Cloud Digital Leader Training Professional Certificate lnkd.in/efnhSb57

🧵[2/x]

Preparing for Google Cloud Certification: Cloud Data Engineer Professional Certificate lnkd.in/eiwqGYxt

🧵[3/x]

Read 7 tweets

David Regalado

@thecodemancer_

Jul 5

💡 Methods for addressing overfitting.

⬇

🧵[1/x]

#MachineLearning #ML

1. Increase the number of training examples. I know, I know. Sometimes that's not possible.

🧵[2/x]

#MachineLearning #ML

2. Select a subset of the most relevant features
(👋 hello feature selection!).

🧵[3/x]

#MachineLearning #ML

Read 7 tweets

David Regalado

@thecodemancer_

Jun 25

@GoogleStartups

💡Seven ways to become a more effective founder

Credits to @GoogleStartups

#startups #founders

🧵[1/x]

🚨⚠️People issues are the biggest risk to funded startups.

55% of startups fail because of people problems, according to a study by Harvard, Stanford, and University of Chicago researchers.

🧵[2/x]

1. Minimize unnecessary micromanagement

Micromanaging can be helpful in certain situations, the most effective leaders aim to delegate work in order to scale both themselves and their businesses. Our data suggests that micromanaging can be a fatal flaw for CEOs.

🧵[3/x]

Read 11 tweets

David Regalado

@thecodemancer_

Jun 24

📣Data Engineering Projects for Beginners 2022

👇🧵[1/x]

#dataengineering #python #Docker #developers #aws #GoogleCloud #apacheairflow

Tracking your Uber Rides and Uber Eats expenses through a data engineering process

Technologies and skills:
Python, Docker, Apache Airflow, AWS Redshift, Power BI, data modelling, Task schedulling, ETL and ELT processes, Data warehousing, Cloud

🧵[2/x]

github.com/Wittline/uber-…

Scheduling Big Data Workloads and Data Pipelines in the Cloud with pyDag

Technologies and skills:
Python, Docker, Big Data, Cloud, Google Cloud, Redis, DAG, Parallel Processing, Apache Spark

🧵[3/x]

github.com/Wittline/pyDag

Read 15 tweets