Thread by @thecodemancer_

Can you imagine serverless Spark + BigQuery together? 🤯

Forget about managing clusters and tuning infrastructure if your job is to focus on create business value.

👇

🧵1/6

#googlecloud #bigquery #spark #dataengineering

Why Serverless Spark?

💡 Developers can focus on code and logic. They do not need to manage clusters or tune infrastructure. They submit #Spark jobs from their interface of choice, and processing is auto-scaled to match the needs of the job.

🧵2/6

#googlecloud #bigquery #gcp

💡 Data engineering teams do not need to manage and monitor infrastructure for their end users. They are freed up to work on higher value #dataengineering functions.

💡 Pay only for the job duration, vs paying for infrastructure time.

🧵3/6

#googlecloud #bigquery #spark

Serverless Spark through BigQuery

BigQuery is adding a unified interface for data analysts to write SQL or PySpark. That Preview is now live, you can request access through the signup form.

👉 lnkd.in/eeB2gqH6

🧵4/6

#googlecloud #bigquery #spark #dataengineering

What is BigQuery again?

Is a serverless, highly scalable, and cost-effective 𝗺𝘂𝗹𝘁𝗶𝗰𝗹𝗼𝘂𝗱 data warehouse designed for business agility.

👉Learn BigQuery in a minute: lnkd.in/eMS25HAJ

🧵5/6

#googlecloud #bigquery #spark #dataengineering

What's next?

Watch for the availability of serverless Spark through Vertex AI workbench for data scientists, and Dataplex for data analysts, in the coming months.

👉I tweet about all things data-related. Follow me for more.

🧵6/6

#googlecloud #bigquery #spark #dataengineering

@threadreaderapp unroll