Senior Data Engineer

Build and maintain ETL/ELT pipelines that ingest clinical, housing, and operational data from multiple source systems into Azure SQL and Synapse warehouses. Use Spark and Hive for large-scale processing and develop Spark SQL and PySpark transformations.

Create dimensional data models for Housing for Health reporting, KPI tracking, and CQI initiatives used by more than 200 staff through Power BI. Schedule and monitor loads using Apache Airflow and Azure Data Factory, while implementing validation, quality checks, logging, error handling, alerting, and HIPAA-compliant performance improvements.

Built and maintained SQL, Python, and Spark ETL/ELT pipelines that ingested millions of daily pharmacy and retail transaction records into an Azure SQL warehouse. Developed distributed PySpark and Spark SQL jobs for large datasets and tuned partitions and joins to meet processing windows.

Designed star-schema dimensional models and orchestrated overnight recurring loads with Apache Airflow. Implemented validation, profiling, and data-quality checks, and optimized transformations with indexing, incremental loads, and CDC to reduce recurring data-preparation effort.

Built Spark, Hive, and Kafka data pipelines for high-volume operational and digital-workplace datasets. Implemented Kafka streaming into staging environments to support near-real-time reporting.

Created automated SQL and Spark SQL workflows and reusable datasets that reduced manual data preparation. Produced executive dashboards and KPI reports in Power BI and partnered with engineering and operations teams to define requirements, validate data, and standardize metric definitions.

Master of Science in Health Informatics, Governors State University, Illinois, United States.

Bachelor of Science degree, Osmania University, Hyderabad, India.