Clouddatalabor

“This is my project from Road to Data engineer by Datath.com”

Did you wonder that what is automate pipeline in GCP(Google Cloud Platform) look like and how to become a Data engineer?

I was curious about what it’s like to work as a data engineer, so I enrolled in this Datath.com online course. I’ve read a lot of the articles on the Datath Facebook page and discovered that becoming a Data engineer is very interesting because it’s very challenging to provide raw data from multiple sources to a data warehouse with cleaned data and to automate it using Apache Airflow. So, let’s get started with my project and what I’ve learned so far in this course.

“What i’ve learned so far in this course”

From the picture showing that i’ve learn on how to do the ETL(Extract Tranform Load) process

First Extract the data from multiple sources like from an web api or website database and web scrapping

Second using a Apache Airflow to automate our ETL process

Third we use Google Bigquery as data warehouse to created a temp view table

Fourth we used Google data studio to make a dashboard by import data from Google Bigquery temp view table

But not only this i’ve learned alot through this course a lot of interview by people who are work in this industry such as P’Keaw Senior data engineer from Wongnai Lineman and that really motivating me alot lookin

Keep on Learning!!

what kind of project that i’ve done.

Thank you to all of my instructors who have been extremely helpful.

Course website https://school.datath.com/ 👍👍👍👍

linkin: www.linkedin.com/in/kriangsak-sumthong

facebook: www.facebook.com/puk.kriangsak/

Github: github.com/thesoulofpuk/Road2De

“While True: learning( )”

#Datath #RoadtoDE