☁ You will likely encounter pushback when moving to the cloud. Moving to something new may seem risky and unnecessary to the developers. This requires a cultural shift.

💎 Here are some tips on how to tackle this problem.

#cloud #googlecloud #azure #aws

1. Sync with cross-functional teams early and often. Train them so they understand the benefits of the cloud and are comfortable and knowledgeable using it.

2. Help teams understand the benefits, the project's processes, the desired goals and outcomes.

Read 6 tweets

David Regalado

@thecodemancer_

May 7

Without effective testing, there's no way to know if your database has been migrated correctly. There are many things you need to verify.

🧵1/10

#databases #databasemigration #dataengineering #sql #googlecloud

1. Was the database schema migrated correctly?
2. Has all the data been migrated?
3. How about user logins?
4. Can all of the users still connect and can users only access the data they're permitted to access?

🧵2/10

#databases #databasemigration #dataengineering #sql

There are basically three categories of testing that needs to be considered; structural, functional and non-functional.

🧵3/10

#databases #databasemigration #dataengineering #sql #googlecloud

Read 11 tweets

David Regalado

@thecodemancer_

Mar 27

Can you imagine serverless Spark + BigQuery together? 🤯

Forget about managing clusters and tuning infrastructure if your job is to focus on create business value.

👇

🧵1/6

#googlecloud #bigquery #spark #dataengineering

Why Serverless Spark?

💡 Developers can focus on code and logic. They do not need to manage clusters or tune infrastructure. They submit #Spark jobs from their interface of choice, and processing is auto-scaled to match the needs of the job.

🧵2/6

#googlecloud #bigquery #gcp

💡 Data engineering teams do not need to manage and monitor infrastructure for their end users. They are freed up to work on higher value #dataengineering functions.

💡 Pay only for the job duration, vs paying for infrastructure time.

🧵3/6

#googlecloud #bigquery #spark

Read 7 tweets

David Regalado

@thecodemancer_

Mar 18

Bored employees are super disengaged, prone to conflict and suffer burnout at a higher rate.

Harvard Business Review found employees who are learning at work experience less anxiety and stress. They are also more ethical than bored workers on autopilot.

🧵1/7

#manager #career

All employees deserve to learn, bored, engaged or somewhere in between. It’s your job as a manager to make that happen. Here are three ideas to create a learning strategy and become a manager whose people won’t leave:

🧵2/7

#manager #career

1. Plan to learn something new every week.

Invite your employees to schedule 10 minutes on their calendars every day to learn something new. Then, weekly, ask your employees about what they’ve learned.

🧵3/7

#manager #career #learning

Read 7 tweets

David Regalado

@thecodemancer_

Mar 16

Is Infrastructure as SQL (IaSQL) a thing? 🤔

🧵1

#dataengineering #sql #IaSQL #cloud

𝗛𝗼𝘄 𝗜𝗮𝗦𝗤𝗟 𝘄𝗼𝗿𝗸𝘀

IaSQL is an open-source SaaS that models cloud infrastructure as data by maintaining a 2-way connection between a AWS account and a hosted PostgreSQL database. ☁

🧵2

𝗪𝗵𝘆 𝗜𝗮𝗦𝗤𝗟?

👉 𝘐𝘮𝘱𝘰𝘳𝘵 𝘦𝘹𝘪𝘴𝘵𝘪𝘯𝘨 𝘤𝘭𝘰𝘶𝘥 𝘪𝘯𝘧𝘳𝘢𝘴𝘵𝘳𝘶𝘤𝘵𝘶𝘳𝘦

Connect an AWS account to a hosted IaSQL DB to automatically backfill the database with your existing cloud resources. No need to redefine or reconcile existing infrastructure.

🧵3

Read 6 tweets

Share this page!

David Regalado

People who liked this thread also liked...

Try unrolling a thread yourself!

More from @thecodemancer_

David Regalado

David Regalado

David Regalado

David Regalado

David Regalado

David Regalado

Did Thread Reader help you today?

Don't want to be a Premium member but still want to support us?