Senior Azure Data Engineer

Designed enterprise migration strategy transitioning Azure SQL Database, Oracle workloads, and Azure Data Factory (ADF) pipelines into Microsoft Fabric Lakehouse and Warehouse architecture integrated with OneLake. Assessed existing ADF ETL pipelines and re-engineered workflows into Fabric Data Factory pipelines. Developed scalable transformation logic using Spark SQL and Delta Lake. Implemented governance and security policies aligned with SEC and SOX. Automated deployments using Azure DevOps and Git. Monitored pipeline execution and performed performance benchmarking. Collaborated with stakeholders to validate migrated datasets and guided data engineering teams on Azure Lakehouse design patterns.

Designed governed Azure Data Lake Storage Gen2 platform ingesting clinical and regulatory datasets. Directed full SDLC execution under GxP governance. Built distributed processing pipelines in Azure Databricks standardizing clinical datasets. Applied Delta Lake ACID controls and schema enforcement. Developed ingestion frameworks using Azure Data Factory. Integrated real-time telemetry pipelines using Azure Event Hubs. Structured dimensional data models in Azure Synapse Analytics. Configured secure access controls under HIPAA and GxP compliance. Built curated analytics data marts in Snowflake and Synapse. Developed automated validation frameworks and prepared ML ready datasets. Established CI/CD workflows and monitored pipeline performance. Partnered with clinical and regulatory teams to deliver governed data solutions.

Established enterprise Azure Data Lake Storage Gen2 platform ingesting credit card, loan, and KYC datasets. Processed credit bureau datasets using Azure Databricks and Python. Developed scalable transformation pipelines for AML screening and fraud detection. Built ingestion and orchestration pipelines in Azure Data Factory. Modeled dimensional datasets in Azure Synapse Analytics. Implemented real-time streaming ingestion using Azure Event Hubs. Applied financial compliance controls aligned with PCI-DSS, SOX, and Basel III. Created data validation frameworks and configured monitoring dashboards. Integrated curated datasets into Snowflake and Synapse. Built CI/CD pipelines automating deployments. Designed Power BI reporting layers and participated in full SDLC lifecycle under Agile/Scrum.

Built centralized AWS S3 data lake with raw, curated, and analytics layers ingesting healthcare datasets. Developed distributed PySpark jobs on AWS EMR processing healthcare data. Configured AWS Glue ETL jobs and Data Catalog. Implemented event-driven ingestion pipelines using Amazon Kinesis and Lambda. Applied healthcare compliance controls aligned with HIPAA and HITECH. Designed dimensional models in Amazon Redshift. Integrated automated data quality checks using AWS Deequ and Python. Collaborated with clinical analysts and compliance officers during requirements gathering and production cutovers under Agile/Scrum.

Translated requirements from banking, loan servicing, risk, and compliance teams into T-SQL stored procedures and parameterized queries. Developed SSIS ETL workflows processing transactional banking feeds. Modeled Customer, Account, Loan, and Transaction fact tables using Star schema. Collaborated with KYC and AML compliance teams implementing validation logic. Developed SSRS dashboards and parameterized reports. Automated nightly ETL cycles using SQL Server Agent. Applied indexing strategies and query refactoring. Conducted data profiling and cleansing on onboarding datasets. Participated in full SDLC lifecycle under Waterfall methodology.