A production-grade data engineering project implementing the medallion architecture with Apache Airflow orchestration and dbt transformations for the MovieLens dataset in Snowflake
-
Updated
Mar 25, 2026 - Python
#
scdtype2
Here are 4 public repositories matching this topic...
End-to-End Data Engineering Pipeline using Snowflake, dbt, AWS, and Medallion Architecture (Bronze, Silver, Gold) with Incremental Models, Snapshots, Macros, and Data Quality Testing.
aws sql etl snowflake dbt elt datawarehouse datapipeline dataengineering medallion-architecture analyticsengineer cloud-data-engineering scdtype2 incremental-loading
-
Updated
Jun 11, 2026 - Python
End-to-end Azure data engineering pipeline using Spotify dummy data with Medallion Architecture, Databricks, Delta Live Tables, and incremental loading.
etl azure data-engineering databricks azure-databricks deltalake medallion-architecture backfilling scdtype2 deltalivetables incrementalloading
-
Updated
Dec 28, 2025 - Jupyter Notebook
Built an end-to-end data platform using Azure Data Factory, Databricks, Delta Live Tables, Unity Catalog, and CI/CD.
ci-cd autoloader azure-data-lake azure-data-factory spark-structured-streaming azure-databricks unitycatalog scdtype2 deltalivetables
-
Updated
Feb 8, 2026
Add this topic to your repo
To associate your repository with the scdtype2 topic, visit your repo's landing page and select "manage topics."