About Me
I am a Senior Data Engineer with 4+ years of experience designing, governing, and cost-optimizing production data platforms across Databricks, Spark, Delta Lake, Azure, and GCP.
I focus on building reliable, scalable, and cost-aware data systems. In my recent work, I led a ground-up platform rebuild for a global CPG client, defining standards for data quality testing, CI/CD, governance, observability, and maintainability.
I have strong hands-on experience with SQL, PySpark, incremental pipelines, dimensional modeling, and medallion architectures. I also work deeply with Databricks features such as Unity Catalog, Jobs API, cluster policies, and Delta Lake optimization patterns.
A major part of my work is reducing infrastructure cost without sacrificing reliability. I have redesigned streaming and batch workloads to dramatically lower cloud spend, including a pipeline cost reduction from USD 8,000 to USD 360 per month and a significant reduction in Azure monthly billing through workload isolation and right-sizing.
I enjoy solving complex data problems end to end, from ingestion and transformation to governance, monitoring, and analytics delivery. I have also built solutions involving web scraping, unstructured document extraction, and cloud automation for legal and operational use cases.
I am comfortable working in remote environments and collaborating with cross-functional teams. I value clean engineering practices, reproducibility, and practical architecture decisions that balance performance, maintainability, and cost.
Skills
PythonSQLDockerCI CDGitTerraformData ModelingData QualityDBTSparkData GovernanceObservabilityBigQueryPysparkApache KafkaAzure Data FactoryWeb ScrapingDelta LakeDataflowCloud FunctionsMedallion ArchitectureGreat ExpectationsUnity Catalog
Experience
Leading a platform rebuild for a global CPG client, defining standards for data quality testing, CI/CD, governance, monitoring, cluster policy, and maintainability. Reduced a streaming pipeline from USD 8,000/month to USD 360/month through architecture redesign and Spark optimization. Built cost governance on Unity Catalog system tables and improved observability using Jobs API metadata.
Delivered GCP-based automation and analytics for law firms, including web scraping, unstructured data extraction, and BigQuery datasets for analysis and reporting. Built cloud infrastructure with Cloud Functions, Compute Engine, Google Cloud Storage, BigQuery, Terraform, GitHub, and Docker-based deployment workflows.
Redesigned claims ingestion architecture by replacing seven daily full-load pipelines with incremental loads, reducing processing time from about 48 hours to near-real-time availability. Built on Azure Synapse Analytics with PySpark and SQL, and refactored analytical structures into business-oriented data models.
Ingested data from APIs, files, Oracle, and SQL Server to support machine learning workflows and BI reporting for fraud prevention. Migrated 40 legacy tables to GCP using Dataflow and batch-incremental strategies with dimensional modeling on GCS, Dataform, and BigQuery.
Education
BSc, Control and Automation Engineering
Thesis: Predictive Model for Apartment Rental Prices in Blumenau.
Portfolio not available.
Services not available.