I build cloud-based data pipelines and ETL/ELT solutions, focusing on batch and streaming processing, data transformation, and analytics-ready datasets. My engineering approach emphasizes data quality, automation, reliability, and maintainable pipeline design.
| Category | Technologies & Expertise |
|---|---|
| Azure Data Platform | Azure Data Factory, Azure Databricks, ADLS Gen2, Delta Lake, Unity Catalog |
| Languages & Processing | Python, PySpark, SQL, Spark SQL |
| ETL/ELT & Architecture | Data Pipelines, Incremental Loading, Metadata-Driven Orchestration, Medallion Architecture, Data Modeling |
| Batch & Streaming | REST APIs, Azure Event Hubs, Spark Structured Streaming, Watermarking, Checkpointing |
| Data Quality & DevOps | Data Validation, Deduplication, Error Handling, Git, GitHub Actions, Azure DevOps |
Data Engineer | Azure Data Engineer | ETL Engineer | Data Quality Engineer
- LinkedIn: Connect with me
- Email: abhishek.1anand@outlook.com



