🔒 Stealth Profile: This professional is browsing anonymously. Personal contacts, photo, and company names are hidden.Skill Assessments This user has not passed any tests yet Languages Portuguese - Native or Bilingual English - Advanced Spanish - Intermediate People also viewed * [![Rafael Crispim Ignacio](https://jobicy.com/data/server-nyc0409/galaxy/mercury/2026/05/avatar_57038_1779685647.jpg) Rafael Crispim Ignacio Software Engineer | Product Management | KMP I | SBK | Web Development](https://jobicy.com/u/id57038.md) * [![Jrugen Becker](https://jobicy.com/data/server-nyc0409/galaxy/mercury/2026/07/avatar_70158_1784312945.jpg) Jrugen Becker Data Scientist | Applied AI, Machine Learning & Predictive Analytics](https://jobicy.com/u/id70158.md) * [![Franco Utrera](https://jobicy.com/data/server-nyc0409/galaxy/mercury/2026/05/avatar_66585_1779685513.jpg) Franco Utrera ANALISTA DE NEGOCIOS & DATOS](https://jobicy.com/u/id66585.md) * [![Suhas Venkat](https://jobicy.com/data/server-nyc0409/galaxy/mercury/2026/05/avatar_65441_1779685690.jpg) Suhas Venkat Machine Learning Engineer](https://jobicy.com/u/id65441.md) * [![Nitha Francis](https://jobicy.com/data/server-nyc0409/galaxy/mercury/2026/05/avatar_56004_1779685628.jpg) Nitha Francis Test Analyst](https://jobicy.com/u/id56004.md) * [![Natalia Iartseva (Paleeva)](https://jobicy.com/data/server-nyc0409/galaxy/mercury/2026/05/avatar_63244_1779685621.jpg) Natalia Iartseva (Paleeva) Researcher and Data Analyst in Social Sciences](https://jobicy.com/u/id63244.md) * [![Otman Mechbal](https://jobicy.com/data/server-nyc0409/galaxy/mercury/2026/06/avatar_68283_1781771691.jpg) Otman Mechbal Deployment Strategist | AI Adoption and Enablement Lead](https://jobicy.com/u/id68283.md) * [![Shafik Mohamed](https://jobicy.com/data/server-nyc0409/galaxy/mercury/2026/05/avatar_57399_1779685603.jpg) Shafik Mohamed Project Manager | IT consltant| Software tester](https://jobicy.com/u/id57399.md) [All talent ↗](https://jobicy.com/talent.md) * [Overview](#overview) * [Portfolio](#portfolio) ## About Me I am a Senior Data Engineer with 4+ years of experience designing, governing, and cost-optimizing production data platforms across Databricks, Spark, Delta Lake, Azure, and GCP. I focus on building reliable, scalable, and cost-aware data systems. In my recent work, I led a ground-up platform rebuild for a global CPG client, defining standards for data quality testing, CI/CD, governance, observability, and maintainability. I have strong hands-on experience with SQL, PySpark, incremental pipelines, dimensional modeling, and medallion architectures. I also work deeply with Databricks features such as Unity Catalog, Jobs API, cluster policies, and Delta Lake optimization patterns. A major part of my work is reducing infrastructure cost without sacrificing reliability. I have redesigned streaming and batch workloads to dramatically lower cloud spend, including a pipeline cost reduction from USD 8,000 to USD 360 per month and a significant reduction in Azure monthly billing through workload isolation and right-sizing. I enjoy solving complex data problems end to end, from ingestion and transformation to governance, monitoring, and analytics delivery. I have also built solutions involving web scraping, unstructured document extraction, and cloud automation for legal and operational use cases. I am comfortable working in remote environments and collaborating with cross-functional teams. I value clean engineering practices, reproducibility, and practical architecture decisions that balance performance, maintainability, and cost. ## Skills ### [Python](https://jobicy.com/talent/python.md)[SQL](https://jobicy.com/talent/sql.md)[Docker](https://jobicy.com/talent/docker.md)[CI CD](https://jobicy.com/talent/ci-cd.md)[Git](https://jobicy.com/talent/git.md)[Terraform](https://jobicy.com/talent/terraform.md)[Data Modeling](https://jobicy.com/talent/data-modeling.md)[Data Quality](https://jobicy.com/talent/data-quality.md)[DBT](https://jobicy.com/talent/dbt.md)[Spark](https://jobicy.com/talent/spark.md)[Data Governance](https://jobicy.com/talent/data-governance.md)[Observability](https://jobicy.com/talent/observability.md)[BigQuery](https://jobicy.com/talent/bigquery.md)[Pyspark](https://jobicy.com/talent/pyspark.md)[Apache Kafka](https://jobicy.com/talent/apache-kafka.md)[Azure Data Factory](https://jobicy.com/talent/azure-data-factory.md)[Web Scraping](https://jobicy.com/talent/web-scraping.md)[Delta Lake](https://jobicy.com/talent/delta-lake.md)[Dataflow](https://jobicy.com/talent/dataflow.md)[Cloud Functions](https://jobicy.com/talent/cloud-functions.md)[Medallion Architecture](https://jobicy.com/talent/medallion-architecture.md)[Great Expectations](https://jobicy.com/talent/great-expectations.md)[Unity Catalog](https://jobicy.com/talent/unity-catalog.md) ## Tech Stack & Tools ### Development [![Image](https://cdn.jsdelivr.net/gh/devicons/devicon@master/icons/github/github-original.svg) GitHub](https://jobicy.com/talent?tool=github.md) [![Image](https://cdn.jsdelivr.net/gh/devicons/devicon@master/icons/terraform/terraform-original.svg) Terraform](https://jobicy.com/talent?tool=terraform.md) ## Experience Senior Data Engineer @ S0$#WS0 2025 - Present Leading a platform rebuild for a global CPG client, defining standards for data quality testing, CI/CD, governance, monitoring, cluster policy, and maintainability. Reduced a streaming pipeline from USD 8,000/month to USD 360/month through architecture redesign and Spark optimization. Built cost governance on Unity Catalog system tables and improved observability using Jobs API metadata. Freelance Data & Software Engineer @ S0$#WS0 Jan 2026 - Jun 2026 Delivered GCP-based automation and analytics for law firms, including web scraping, unstructured data extraction, and BigQuery datasets for analysis and reporting. Built cloud infrastructure with Cloud Functions, Compute Engine, Google Cloud Storage, BigQuery, Terraform, GitHub, and Docker-based deployment workflows. Data Engineer @ S0$#WS0 2023 - 2025 Redesigned claims ingestion architecture by replacing seven daily full-load pipelines with incremental loads, reducing processing time from about 48 hours to near-real-time availability. Built on Azure Synapse Analytics with PySpark and SQL, and refactored analytical structures into business-oriented data models. Data Engineer @ S0$#WS0 2022 - 2023 Ingested data from APIs, files, Oracle, and SQL Server to support machine learning workflows and BI reporting for fraud prevention. Migrated 40 legacy tables to GCP using Dataflow and batch-incremental strategies with dimensional modeling on GCS, Dataform, and BigQuery. ## Education S0$#WS0$#W 2022 BSc, Control and Automation Engineering Thesis: Predictive Model for Apartment Rental Prices in Blumenau. Portfolio not available. Services not available.