Software Engineer

• Engineered REST Web Services utilizing Azure Functions and Flask.
• Led a cross-functional team of developers in backend and data engineering for application development.
• Formulated a database model for capturing product relationships and version history.
• Implemented Kafka producer and consumer scripts, facilitating the handling of 1000+ live stream data requests.
• Architected data factory pipelines for seamless data movement across different database layers for reporting.
• Integrated Single Sign-On (SSO) authentication into the web application using Azure OAuth2 services.
• Managed and developed services orchestrating Spark jobs on AWS EMR, providing EMR step details for execution.

• Engineered Python scripts, leveraging organizational knowledge and an NLP-based platform for data extraction automation, achieving a 70% accuracy rate, and saving 25 hours of manual work weekly.
• Redesigned and organized client data in MongoDB, enhancing data structure and accessibility.
• Developed and maintained a scalable Data Lake Architecture, accommodating 50M+ structured and unstructured records weekly.
• Implemented ETL processes for seamless data transfer from source files and databases to analytical tools.
• Automated tabular data extraction in PDFs using Tableau library, exporting it to a predefined report format, reducing manual data entry processes by 40%.