
How to use Sources in dbt?
You have your raw data in your database, but now you want to edit it. In dbt, this raw data is also called "Source(s)". A source is like the
Achille strives to deliver the highest possible accuracy and quality in every task he performs. He is very focused and methodical in his work and understands the importance of having high-quality data to generate valuable insights and decisions. He takes the time to understand what information is needed to achieve the desired results.
Experiences
Relevance Learning
Goal: Implement the 'Modern Data Stack'
Tasks: design, implement data pipelines, configure cloud-based storage (they use Azure Blog Storage) - and processing solutions (ELT) with the following tooling: Fivetran, DBT & Snowflake. In addition, managing/monitoring/guaranteeing the entire infrastructure.
National Postcode Lottery (Novamedia)
Objective: (1 ) Investigate implementation of the data management tool 'Flyway' in Snowflake. ( 2 ) Develop/maintain ETL data models.
Tasks: Figuring out how to implement the data management tool 'Flyway' i.c.m Docker & (Gitlab) CI/CD in Snowflake in order to promote collaboration between different IT departments while continuing to work from Agile methodology. Additionally assist ETL-Developer's team with developing and maintaining ETL data streams which are then used to build data models with the goal of solving business questions.
Cordaan Foundation
Purpose: Data transformation (ETL)
Work: With the Fivetran tool, unlock data from SQL-Server (0n-premise), to Snowflake. Then with the dbt tool, transform data, prepare it and make it available to data analysts to build dashboards with it.
Castor EDC
Purpose: To help set up a Full Data stack - Proof of Concept
Work: Using Fivetran, exported data from SalesForce CRM database to Snowflake. Then connected dbt to it to be able to build transformations on it. Data was visualized in Tableau.
Unigarant/ANWB
Purpose: Build Dashboards
Tasks: To help build dashboards for the 'Market Intelligence' department in Tableau. Also guarding and monitoring already existing dashboards.
Liberty Mutual Surety (formerly, National Borg)
Objective: Assist with migrating data from various databases to the (including the data warehouse) Tableau cloud environment.
Activities: Via SQL scripts from MS Access & using Tableau Prep, built (automatic) workflows to migrate data to the cloud from local storage.
Swiss Sense
Purpose: Build an automated workflow to clean up and prepare data for other stakeholders.
Work: Using Alteryx Designer, designed an automated workflow to automatically download a survey dataset from an FTP server and then further clean it up so that other Data Analysts can build dashboards from it. The workflow was implemented on the client's server.
You have your raw data in your database, but now you want to edit it. In dbt, this raw data is also called "Source(s)". A source is like the
RBAC (Role-based Access Control) is a Snowflake security model that uses roles to grant Snowflake users direct access to the objects within their account. Thus, a user can
Standard way to run all dbt models In dbt you can conceptually build and design your models as you wish, and then run them as a final product in
Cookie | Duration | Description |
---|---|---|
cookielawinfo-checkbox-analytics | 11 months | This cookie is set by GDPR Cookie Consent plugin. The cookie is used to store the user consent for the cookies in the category "Analytics". |
cookielawinfo-checkbox-functional | 11 months | The cookie is set by GDPR cookie consent to record the user consent for the cookies in the category "Functional". |
cookielawinfo-checkbox-necessary | 11 months | This cookie is set by GDPR Cookie Consent plugin. The cookies is used to store the user consent for the cookies in the category "Necessary". |
cookielawinfo-checkbox-others | 11 months | This cookie is set by GDPR Cookie Consent plugin. The cookie is used to store the user consent for the cookies in the category "Other. |
cookielawinfo-checkbox-performance | 11 months | This cookie is set by GDPR Cookie Consent plugin. The cookie is used to store the user consent for the cookies in the category "Performance". |
viewed_cookie_policy | 11 months | The cookie is set by the GDPR Cookie Consent plugin and is used to store whether or not user has consented to the use of cookies. It does not store any personal data. |