Data Engineer Trainee Nagarro
Architected automated end-to-end ETL data pipelines using Azure Data Factory, Databricks, and PySpark to process high-volume stream telemetry data with incremental watermark-based loads. Implemented a production-grade Medallion Architecture using Delta Lake and optimization techniques like Z-Ordering. Engineered custom data-quality validation engines and designed proactive exception handling and monitoring with alerting. Managed secure data governance, schema evolution, and auditing through Unity Catalog and Azure SQL metadata tables.
