Data Engineer

Engineered and optimized high-throughput streaming pipelines for behavior metrics, ensuring seamless data flow to an analytics platform that delivers real-time security insights.

Developed and maintained robust APIs that improved data accessibility for engineering and ML teams, transforming raw event data into actionable intelligence.

Ensured the integrity and reliability of streaming and batch data, and designed a scalable pipeline capable of handling 45k RPS during the transition from VMs to Kubernetes.

Spearheaded the establishment of a Centre of Excellence to architect and implement standardized data structures for engineering pipelines, improving operational efficiency.

Directed the management of a trusted data layer and developed monitoring systems for critical data pipelines, increasing visibility and performance tracking.

Created tools to optimize data categorization and integration, and managed GDPR-compliant data pipelines across multiple projects.

Engineered robust databases from integrated RAW layer data, significantly improving automation in monitoring processes and data integrity.

Constructed and optimized high-throughput data pipelines within the GCP environment, ensuring seamless data flow for actionable insights.

Supported engineering and ML teams with reliable data delivery and scalable data processing solutions.

Developed pipelines with Apache Beam.

Automated deployment processes using Cloud Build.

Worked on projects where students computed radiation doses using simple tools to understand and estimate the effects of long-term radiation exposure on astronaut health.

Developed an educational quiz aimed at increasing engagement in learning and classroom activities.