About TA3

TA3

Hi All,I am performing a Poc to trigger dataform via gcp composer, I am using dataform to perform ETL for a multiple clients depending on the client name i pass as an argument. My requirement is to be able to create a Dag which will trigger the dataf...

TA3 · 06-17-2024

Hi All,I am working on a poc to determine how useful can dataform be in our ETL architecture, Our requirement is where we have to fetch data for different client from google cloud storage (every client will have different bucket) and create a externa...

TA3

Thank you for sharing the info. I will try implementing logs in BigQuery itself.I have another issue where i am trying to access the table from the dataform whose defaultRegion is set to us-east1 but the tables are in the region europe-west1for examp...

TA3

Thank you for sharing the steps. This was very helpful. I actually created a table in bigquery itself to store the config related information and get the required info to create the external tables.But what i am struggling currently with is to be abl...

My Stats

TA3's Bio

Badges TA3 Earned

Recent Activity

Composer - Trigger a Dataform Repository with gcp cloud composer

DATAFORM - Create External Tables from Bigquery

Re: DATAFORM - Create External Tables from Bigquery

Re: DATAFORM - Create External Tables from Bigquery