[![Image]() Meet Jobicy Copilot — free AI autofill for job applications + remote job alerts ›](#)   [All remote jobs](https://jobicy.com/jobs.md)Open role[![Socure logo](https://jobicy.com/data/server-nyc0409/galaxy/mercury/2022/02/4dd877ff6ea919681d6e790a57ab639c.jpeg)](https://jobicy.com/company/socure.md)Remote opportunity at[Socure](https://jobicy.com/company/socure.md)

# Senior Data Engineer

Review the role, location requirements, compensation details, and application process before deciding whether this opportunity fits your next career move.

[Apply for this job](#job-application)[View company](https://jobicy.com/company/socure.md)Share22 Sep 2026Published58Listing views2Application actions22 Oct 2026Apply before  Opportunity details

## About this role.

AI SummarySocure is hiring a Senior Data Engineer for its Data Automation team to build scalable batch and streaming pipelines that support identity verification products, ML feature engineering, and analytics. The role owns ambiguous initiatives end to end, from architecture and implementation through deployment, monitoring, recovery, and documentation. Core requirements include Python or Scala, SQL, Apache Spark, AWS data services, data modeling, and production reliability practices. The engineer will collaborate with Data Science, Product, and Engineering while improving platform cost, performance, and operational automation.

## Role DNA

A quick view of the complexity, pace, ownership and collaboration implied by the job description.

### Job Complexity

5/5EasyHard

### Pace & Pressure

5/5RelaxedFast-paced

### Autonomy Level

5/5GuidedFull ownership

### Communication Load

4/5IndependentCollaborative

AI insightThis is a senior, highly autonomous platform role requiring deep distributed-data expertise and ownership of complex production systems. The environment emphasizes rapid execution, ambiguous problem solving, reliability, and cross-functional technical leadership.

## Salary analysis

Estimated compensation compared with the broader US market for similar roles.

Estimated job medianHighly competitive$177,500US market range$150k–$205k0$226k

AI insightThe disclosed annual base compensation range is USD 160,000–195,000, with a midpoint of USD 177,500. For a US-based senior data engineer focused on Spark, AWS, streaming, and data-platform ownership, an estimated US market range is approximately USD 150,000–205,000 annually; actual market pay varies by location, company stage, and total-equity package.

## Core skills

Skills and capabilities most closely associated with this opportunity.

[Data Engineering](https://jobicy.com/jobs?search_keywords=Data%20Engineering.md)[Apache Spark](https://jobicy.com/jobs?search_keywords=Apache%20Spark.md)[AWS](https://jobicy.com/jobs?search_keywords=AWS.md)[Python](https://jobicy.com/jobs?search_keywords=Python.md)[SQL](https://jobicy.com/jobs?search_keywords=SQL.md)[Data Pipelines](https://jobicy.com/jobs?search_keywords=Data%20Pipelines.md)[Streaming Data](https://jobicy.com/jobs?search_keywords=Streaming%20Data.md)[Data Warehousing](https://jobicy.com/jobs?search_keywords=Data%20Warehousing.md)[Airflow](https://jobicy.com/jobs?search_keywords=Airflow.md)[CI/CD](https://jobicy.com/jobs?search_keywords=CICD.md)

Sample interview questionsHow would you design a scalable pipeline that supports both batch ingestion and near-real-time feature generation?I would separate ingestion, storage, transformation, and serving concerns while using shared schemas and data-quality contracts. Batch workloads could use Spark on EMR with partitioned lake storage, while streaming events could be processed through Kafka or Kinesis with idempotent writes and checkpointing. I would add orchestration, monitoring, lineage, and backfill mechanisms from the outset so both paths remain reliable and operable.

Describe how you would tune a slow Apache Spark job processing a large, skewed dataset.

I would first inspect Spark UI metrics to identify whether the bottleneck is skew, shuffle volume, poor partition sizing, spills, or inefficient joins. Typical improvements include filtering and projecting early, repartitioning on appropriate keys, using broadcast joins where suitable, handling skewed keys with salting or adaptive query execution, and selecting efficient file formats such as Parquet. I would validate changes with representative production-scale data and track both runtime and infrastructure cost.

What practices would you use to make production data pipelines reliable?

I would implement data contracts, schema validation, freshness and completeness checks, idempotent processing, retries with bounded backoff, and clear dead-letter or quarantine paths. Operationally, I would provide actionable alerts, runbooks, dashboards for latency and failure rates, and tested procedures for backfills and recovery. CI/CD, automated tests, code review, and infrastructure-as-code would help prevent regressions before deployment.

How do you balance data-platform cost optimization with performance and reliability requirements?

I start by defining service-level expectations for latency, freshness, availability, and recovery time, then measure cost per workload and per unit of data processed. I optimize storage layout, retention, compute sizing, scheduling, autoscaling, and query patterns without weakening critical controls. Any change should be benchmarked, monitored after release, and reversible if it creates reliability or user-impact risks.

How would you work with Data Science and Product stakeholders when requirements are incomplete?

I would clarify the customer and business outcome, identify decisions that the data product must enable, and convert those into measurable technical requirements such as data sources, freshness, quality thresholds, and access patterns. I would propose an incremental design, document assumptions and trade-offs, and seek early feedback through lightweight prototypes. Regular communication on risks, dependencies, and delivery milestones keeps technical and non-technical stakeholders aligned.

### Why Socure?

Socure is building the identity trust infrastructure for the digital economy — verifying 100% of good identities in real time and stopping fraud before it starts. The mission is big, the problems are complex, and the impact is felt by businesses, governments, and millions of people every day.

We hire people who want that level of responsibility. People who move fast, think critically, act like owners, and care deeply about solving customer problems with precision. If you want predictability or narrow scope, this won’t be your place. If you want to help build the future of identity with a team that holds a high bar for itself — keep reading.

### About the Role

We are looking for a Senior Data Engineer to join our Data Automation team. You will play a critical role in designing and building scalable data platforms and pipelines that power Socure’s identity verification products and analytics. This role is ideal for someone who has a strong passion for solving real business problems with data, and combines deep hands-on data engineering expertise with strong ownership.

### What You’ll Do

• Design and build batch and streaming data pipelines to support automated data ingestion, ML feature engineering and analytics across multiple product domains.

• Own end-to-end delivery of complex, ambiguous data initiatives, including architecture, implementation, testing, deployment, monitoring, and documentation.

• Develop and evolve the data platform to support large-scale data processing using modern cloud-native technologies.

• Automate data operations (validation, quality checks, alerting, backfills, and recovery workflows) to reduce manual effort and improve consistency.

• Optimize cost, performance, and reliability of data workloads.

• Partner closely with cross-functional teams (Data Science, Product, Engineering) to understand requirements, translate them into technical solutions.

• Evaluate and adopt new technologies (new processing engines, storage formats, orchestration tools, GenAI-assisted ingestion) to keep the platform modern and efficient.

### What You Bring

• 5+ years of hands-on data engineering experience, building and maintaining production-grade data platforms and pipelines.

• Strong programming skills in general-purpose language (such as Python or Scala) for data processing, and SQL for data analytics.

• Deep experience with distributed data processing frameworks, such as Apache Spark, including performance tuning and optimization.

• Proven experience building data solutions using services on AWS (EMR, Lambda, s3, etc).

• Strong understanding of data modeling and data warehousing concepts, including partitioning, schema design for large-scale datasets.

• Experience operating and supporting production pipelines, including monitoring, alerting, incident response, and improving reliability over time.

• Solid foundation in software engineering practices, including version control, CI/CD, testing strategies, and code review.

• Strong communication and collaboration skills, with the ability to work effectively with both technical and non-technical stakeholders.

Preferred Qualifications

• Experience with streaming or near-real-time data processing (Kafka, Kinesis, etc).

• Hands-on experience with data orchestration tools (Airflow, Step Functions, etc).

• Familiarity with modern data platform patterns such as Data Lakehouse, Data Mesh, and large-scale data sharing across teams.

• Experience with prompt engineering using modern GenAI, Large Language Models (LLM).

• Experience mentoring other engineers and contributing to engineering-wide standards, best practices.

As a note; Socure cannot provide sponsorship now or in the future for this role.

Socure is an equal opportunity employer that values diversity in all its forms within our company. We do not discriminate based on race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, or disability status.
If you need an accommodation during any stage of the application or hiring process—including interview or onboarding support—please reach out to your Socure recruiting partner directly.

Follow Us!

[YouTube](https://www.youtube.com/c/Socure) | [LinkedIn](https://www.linkedin.com/company/socure/) | [X (Twitter)](https://x.com/socureme) | [Facebook](https://www.facebook.com/socure/)

Show more

[Apply now >](https://jobicy.com/jobs/153886-senior-data-engineer-4.md)

*

![Upload CV](data:image/svg+xml;base64,PHN2ZyB4bWxucz0iaHR0cDovL3d3dy53My5vcmcvMjAwMC9zdmciIHdpZHRoPSI2NSIgaGVpZ2h0PSI2NSIgZmlsbD0ibm9uZSIgeG1sbnM6dj0iaHR0cHM6Ly92ZWN0YS5pby9uYW5vIj48ZyBjbGlwLXBhdGg9InVybCgjQSkiPjxwYXRoIGQ9Ik0wIDBINjVWNjVIMFYwWiIgZmlsbD0iIzAyOWFlYiIvPjxnIGZpbGw9IiNmZmYiIHN0cm9rZT0iI2ZmZiIgc3Ryb2tlLXdpZHRoPSIyIj48cGF0aCBkPSJNMzMuMDQ5IDE1LjQ1NGExLjQzIDEuNDMgMCAwIDAtMi4wOTcgMGwtNy41NzkgOC4xNDdhMS4zOCAxLjM4IDAgMCAwIC4wOSAxLjk3MyAxLjQ0IDEuNDQgMCAwIDAgMi4wMDgtLjA4OGw1LjEwOS01LjQ5MnYyMC42MWExLjQxIDEuNDEgMCAwIDAgMS40MjEgMS4zOTdjLjc4NSAwIDEuNDIxLS42MjUgMS40MjEtMS4zOTd2LTIwLjYxbDUuMTA5IDUuNDkyYTEuNDQgMS40NCAwIDAgMCAyLjAwOC4wODggMS4zOCAxLjM4IDAgMCAwIC4wOS0xLjk3M2wtNy41NzktOC4xNDZ6TTE2Ljc2OSAzOC40YzAtLjc3My0uNjItMS40LTEuMzg1LTEuNFMxNCAzNy42MjcgMTQgMzguNHYuMTAybC4yMTUgNi4yMjljLjIyMyAxLjY4LjcwMSAzLjA5NSAxLjgxMyA0LjIxOHMyLjUxIDEuNjA3IDQuMTcyIDEuODMzYzEuNi4yMTggMy42MzYuMjE4IDYuMTYuMjE4aDExLjI4bDYuMTYtLjIxOGMxLjY2Mi0uMjI2IDMuMDYxLS43MDkgNC4xNzItMS44MzNzMS41ODktMi41MzggMS44MTMtNC4yMThDNTAgNDMuMTEzIDUwIDQxLjA1NSA1MCAzOC41MDNWMzguNGMwLS43NzMtLjYyLTEuNC0xLjM4NS0xLjRzLTEuMzg1LjYyNy0xLjM4NSAxLjRsLS4xOSA1Ljk1OGMtLjE4MiAxLjM3LS41MTUgMi4wOTUtMS4wMjYgMi42MTJzLTEuMjI4Ljg1My0yLjU4MyAxLjAzOGMtMS4zOTUuMTktMy4yNDMuMTkzLTUuODkzLjE5M0gyNi40NjJjLTIuNjUgMC00LjQ5OC0uMDAzLTUuODkzLS4xOTMtMS4zNTUtLjE4NC0yLjA3Mi0uNTIxLTIuNTgzLTEuMDM4cy0uODQ0LTEuMjQyLTEuMDI2LTIuNjEyYy0uMTg3LTEuNDEtLjE5MS0zLjI3OS0uMTkxLTUuOTU4eiIvPjwvZz48L2c+PGRlZnM+PGNsaXBQYXRoIGlkPSJBIj48cGF0aCBmaWxsPSIjZmZmIiBkPSJNMCAwaDY1djY1SDB6Ii8+PC9jbGlwUGF0aD48L2RlZnM+PC9zdmc+)

### Upload your resume now

To unlock remote work opportunities and be discovered by global employers.

This job listing has been manually reviewed by the Jobicy Trust & Safety Team for compliance with our posting guidelines, including verification of the company's legitimacy, accuracy of job details, clarity of remote work policy, and absence of misleading or fraudulent content.

Next step

## Apply now.

Follow the employer’s application method and review Jobicy’s safety guidance before sharing personal information.

Keep exploring

## Related remote jobs.

Matched by job category10 related opportunities[Data Science & Analytics](https://jobicy.com/categories/data-science.md) [Browse all jobs](https://jobicy.com/jobs.md)
*
![Pleo logo](https://jobicy.com/data/server-nyc0409/galaxy/mercury/2025/06/b27fbed2-221.jpg)
Pleo  Sep 22

### [Senior Data Engineer (Commercial Analytics)](https://jobicy.com/jobs/153896-senior-data-engineer-commercial-analytics.md)

About Pleo Messy spend management is tricky business. And tedious processes are a lose-lose situation for all involved, not just finance. At Pleo, we’re changing that. We build spend solutions…

*
![Oddball logo](https://jobicy.com/data/server-nyc0409/galaxy/mercury/2022/02/8c034287ffd7b6474f90645b1c72e60a.jpeg)
Oddball  Sep 22

### [Cloud Data Architect](https://jobicy.com/jobs/151390-cloud-data-architect.md)

Oddball believes that we can bring change and improve the daily lives of millions by bringing quality software to the federal space. Our team is full of experienced engineering, product,…

*
![Thermo Fisher Scientific logo](https://jobicy.com/data/server-nyc0409/galaxy/mercury/2026/06/fbe52b8e-221.webp)
Thermo Fisher Scientific  Sep 22

### [Clinical Data Team Lead](https://jobicy.com/jobs/149471-clinical-data-team-lead.md)

Work ScheduleStandard (Mon-Fri)Environmental ConditionsOfficeJob DescriptionJoin Us as a Clinical Data Team Lead – Make an Impact at the Forefront of InnovationWe have successfully supported the top 50 pharmaceutical companies and…

*
![Ruby Labs logo](https://jobicy.com/data/server-nyc0409/galaxy/mercury/2025/06/0799a7b7-221-1.jpeg)
Ruby Labs  Sep 22

### [Data Analytics Engineer](https://jobicy.com/jobs/151318-data-analytics-engineer.md)

About usRuby Labs is a leading tech company that creates and operates innovative consumer products. We offer a diverse range of opportunities across the health, education, and entertainment industries. Our…

*
![Mozilla logo](https://jobicy.com/data/server-nyc0409/galaxy/mercury/2020/10/mozilla.jpg)
Mozilla  Sep 21

### [Marketing Data Science Manager](https://jobicy.com/jobs/153828-marketing-data-science-manager.md)

To learn the Hiring Ranges for this position, please select your location from the Apply Now dropdown menu. To learn more about our Hiring Range System, please click this link….

*
![Mactores logo](https://jobicy.com/data/server-nyc0409/galaxy/mercury/2025/06/cea77a13-221.jpeg)
Mactores  Sep 21

### [AWS Data Engineer (Associate)](https://jobicy.com/jobs/151141-aws-data-engineer-associate.md)

Mactores is the agent-native AWS modernization firm. Most modernization work doesn’t ship, it stalls in pilots, slips a year, or lands at three times the budget. We exist to ship…

*
![Liftoff logo](https://jobicy.com/data/server-nyc0409/galaxy/mercury/2025/06/c47aea9f-221.png)
Liftoff  Sep 21

### [Machine Learning Engineer](https://jobicy.com/jobs/151331-machine-learning-engineer-5.md)

Liftoff is a leading AI-powered performance marketing platform for the mobile app economy. Our end-to-end technology stack helps app marketers acquire and retain high-value users, while enabling publishers to maximize…

*
![Ruby Labs logo](https://jobicy.com/data/server-nyc0409/galaxy/mercury/2025/06/0799a7b7-221-1.jpeg)
Ruby Labs  Sep 21

### [Senior Data Analyst](https://jobicy.com/jobs/143979-senior-data-analyst-4.md)

About usRuby Labs is a leading tech company that creates and operates innovative consumer products. We offer a diverse range of opportunities across the health, education, and entertainment industries. Our…

*
![Natera logo](https://jobicy.com/data/server-nyc0409/galaxy/mercury/2025/06/1c3a8032-221.png)
Natera  Sep 20

### [Associate Director of Bioinformatics (Women’s Health and Organ Health)](https://jobicy.com/jobs/153751-associate-director-of-bioinformatics-womens-health-and-organ-health.md)

Natera is seeking an Associate Director to lead a team of Bioinformatics Scientists in our Women’s Health and Organ Health research organization. You will oversee the scientific planning and execution…

*
![Mactores logo](https://jobicy.com/data/server-nyc0409/galaxy/mercury/2025/06/cea77a13-221.jpeg)
Mactores  Sep 20

### [AWS Data Engineer (Senior)](https://jobicy.com/jobs/151146-aws-data-engineer-senior.md)

Mactores is the agent-native AWS modernization firm. Most modernization work doesn’t ship, it stalls in pilots, slips a year, or lands at three times the budget. We exist to ship…