End-to-end Azure data engineering pipeline using Spotify dummy data with Medallion Architecture, Databricks, Delta Live Tables, and incremental loading.
-
Updated
Dec 28, 2025 - Jupyter Notebook
End-to-end Azure data engineering pipeline using Spotify dummy data with Medallion Architecture, Databricks, Delta Live Tables, and incremental loading.
A self-hosted, lightweight ETL pipeline for orchestrated exports from REST API data to S3 with zero infrastructure overhead. Intelligent API batching, S3 optimization, retry logic, automatic S3 gap backfilling, customizable logging.
A python project that fetches MLB data, builds daily game panels, and trains/predicts team and player outcomes.
To associate your repository with the backfilling topic, visit your repo's landing page and select "manage topics."