Senior Data Engineer Worcester Commons
Develop and maintain scalable data transformation workflows that convert operational and business data into reliable, analytics-ready datasets. Use SQL, Python, Spark, PySpark, and Databricks-oriented patterns to create reusable logic, standardize business rules, and process growing datasets efficiently.
Design dimensional models and layered Bronze, Silver, and Gold data processing patterns. Implement ETL/ELT workflows, incremental processing, data-quality validation, reconciliation, exception handling, logging, and monitoring. Apply Git, pull requests, code reviews, and CI/CD practices while partnering with analysts and stakeholders on data models, documentation, and issue resolution.