Senior Data Engineering Manager

Remote from
USA
Annual salary
Undisclosed
Salary information is not provided for this position. Check our Salary Directory to estimate the average compensation for similar roles.
Employment type
Full Time,
Job posted
Apply before
23 Aug 2026
Experience level
Senior
Views / Applies
33 / 3

About YipitData

YipitData provides reliable insights to investment funds and corporations by analyzing billions of data points.

Actively Hiring
Verified job posting
This job post has been manually reviewed for authenticity and compliance.

AI Summary

YipitData is seeking a Senior Data Engineering Manager to lead a team building large-scale data pipelines for alternative datasets. This player-coach role involves hands-on technical contribution, team development, and architectural guidance. The role requires expertise in Databricks, Airflow, SQL, PySpark, and modern AI-assisted development. The company offers a fast-paced, ownership-driven culture with exposure to high-stakes decisions. Ideal for engineering leaders who combine strong technical judgment, operational rigor, and people leadership.

Role DNA

Job Complexity
Easy Hard
Pace & Pressure
Relaxed Fast-paced
Autonomy Level
Guided Full Ownership
Communication Load
Independent Highly Collaborative
AI Insight The role demands senior-level technical expertise, team leadership, and strategic ownership, making it challenging but not the hardest.

Salary Analysis

Median Market Rate
$180,000
US Market
$130k – 250k
0 $275k
AI Insight The salary is not specified in the listing. Based on market data for a Senior Data Engineering Manager role, the median salary is approximately $180,000, with a typical range of $130,000 to $250,000. This is competitive for a leadership role in data engineering.

Dear Hiring Manager,

I am excited to apply for the Senior Data Engineering Manager role at YipitData. With over 8 years of experience in data engineering and leadership, I have led teams to build scalable pipelines and production-grade data systems. I am drawn to YipitData's focus on alternative data and its impact-driven culture.

In my previous role at a data analytics firm, I managed a team of 10 engineers, architecting data workflows using Spark, Airflow, and Databricks. I have a strong track record of delivering reliable, AI-ready datasets and implementing robust data quality frameworks. I am also proficient in leveraging AI-assisted development tools to accelerate delivery without compromising quality.

I am eager to bring my technical expertise and people leadership to YipitData, where I can drive innovation and scale data systems to support the company's growth. Thank you for considering my application.

Sincerely,
[Your Name]

Can you describe your experience leading data engineering teams and how you balance hands-on technical work with management responsibilities?
I have led teams of 5-10 data engineers, spending about 50% of my time on code reviews, architecture design, and hands-on coding, and the rest on mentoring, sprint planning, and stakeholder alignment. I ensure the team stays technically strong while meeting delivery goals.
How would you design a data pipeline for processing high-volume transactional data with strict SLAs on timeliness and accuracy?
I would use a layered architecture: raw ingestion with Apache Kafka or Kinesis, processing with Spark streaming, and storage in Databricks Delta Lake. I'd implement monitoring for latency and data quality checks, with automated alerting and reprocessing logic.
Describe a time you improved data quality and observability in a production system.
In a previous role, I implemented a data quality framework using Great Expectations and custom validation rules. This reduced data incidents by 80% and improved trust in the data products used by analysts.
How do you stay current with AI-assisted development tools, and how have you integrated them into your team's workflow?
I regularly experiment with tools like GitHub Copilot and Claude Code. I introduced weekly 'AI office hours' where engineers share tips. This has increased our code generation speed by 30% while maintaining code quality through rigorous review.
What approach would you take to build datasets that are 'AI-ready' for downstream AI agents?
I would focus on clear schema definitions, comprehensive metadata, and thorough documentation. Additionally, I'd ensure data lineage is traceable and that datasets are versioned. This allows AI agents to understand context and trust the data.

 

About Us:

YipitData is the leading market research and analytics firm for the disruptive economy and most recently raised $475M from The Carlyle Group at a valuation of over $1B. Every day, our proprietary technology analyzes billions of alternative data points to uncover actionable insights across sectors like software, AI, cloud, e-commerce, ridesharing, and payments.

Our data and research teams transform raw data into strategic intelligence, delivering accurate, timely, and deeply contextualized analysis that our customers—ranging from the world’s top investment funds to Fortune 500 companies—depend on to drive high-stakes decisions. From sourcing and licensing novel datasets to rigorous analysis and expert narrative framing, our teams ensure clients get not just data, but clarity and confidence.

We operate globally with offices in the US, APAC, and India. Our award-winning, people-centric culture—recognized by Inc. as a Best Workplace for three consecutive years—emphasizes transparency, ownership, and continuous mastery.

What It’s Like to Work at YipitData:

YipitData isn’t a place for coasting—it’s a launchpad for ambitious, impact-driven professionals.

From day one, you’ll take the lead on meaningful work, accelerate your growth, and gain exposure that shapes careers.

Why Top Talent Chooses YipitData:

  • Ownership That Matters: You’ll lead high-impact projects with real business outcomes
  • Rapid Growth: We compress years of learning into months
  • Merit Over Titles: Trust and responsibility are earned through execution, not tenure
  • Velocity with Purpose: We move fast, support each other, and aim high—always with purpose and intention

If your ambition is matched by your work ethic—and you’re hungry for a place where growth, impact, and ownership are the norm—YipitData might be the opportunity you’ve been waiting for.

About The Role:

We are looking for a highly skilled Senior Data Engineering Manager to lead one of our data engineering teams. This is a hands-on player-coach role for someone who can develop engineers, guide technical architecture, and contribute directly to the systems that support our products, AI platforms, and customer-facing data feeds.

You will own critical central data pipelines built on large-scale alternative datasets, including transaction data, email receipt data, B2B spend data, and other third-party datasets. Your team will transform complex data into reliable, production-grade assets used by research analysts, product teams, and internal applications.

This role is ideal for an engineering leader who combines strong technical judgment, operational rigor, people leadership, and modern AI-assisted development practices. You should be comfortable using tools like Claude Code, Codex, Cursor, or similar systems to accelerate implementation, code review, testing, documentation, debugging, and technical exploration while maintaining a high bar for correctness, reliability, and production ownership.

What You’ll Own

You will lead the data engineering team responsible for building and scaling data systems for all of YipitData’s businesses, including:

  • Large scale data pipelines built for the public investor business units, corporate investor team, and/or private investor team
  • Production datasets and analytical models used in research workflows, applications, internal products, and customer-facing deliverables.
  • Architecting data flows and data models to support various business stakeholders use cases focusing on accuracy, timeliness, and reliability.
  • AI-ready analytical datasets designed with the structure, metadata, documentation, and business context needed for effective use by AI agents..
  • Data quality and observability frameworks, including validation checks, freshness monitoring, coverage monitoring, outlier detection, and automated QA controls.
  • Technical execution across Databricks, Airflow, SQL, PySpark, and related data infrastructure.
  • Operational excellence practices across documentation, incident response, monitoring, reliability, and production support.

What You’ll Do

  • Lead, coach, and develop a global team of data engineers while staying close to architecture, design, code reviews, debugging, and delivery.
  • Partner with Technical Product Managers and Data leads to translate roadmap priorities, customer needs, and research requirements into scalable technical plans.
  • Build and improve scalable data pipelines, data models, and QA systems for various data products.
  • Collaborate with business stakeholders and PMs to support reliable delivery of data pipelines, incident resolution, methodologies, and operational improvements.
  • Use AI coding tools to develop and enhance methodologies, accelerate engineering execution, improve documentation, strengthen QA, support technical exploration, and raise team productivity.
  • Create clarity and momentum in ambiguous environments by breaking down complex data, research, and product challenges into actionable engineering plans.

What We’re Looking For

  • 8+ years of professional experience in data engineering, data architecture, big data development, ETL engineering, or related technical roles.
  • 3+ years of managerial experience, including mentoring, team leadership, and supporting delivery.
  • Experience managing, mentoring, or formally leading data engineers or technical teams in a hands-on player-coach capacity.
  • Strong hands-on expertise with SQL, PySpark, Databricks, and Airflow or similar workflow orchestration tools and AI toolings.
  • Experience building, maintaining, or scaling business-critical data systems, including pipelines, production datasets, data delivery systems, or customer-facing data products.

Experience working with application teams with OLTP and OLAP use cases

  • Deep technical judgment across data modeling, distributed data systems, pipeline architecture, orchestration, data quality, observability, and production reliability.
  • Strong communication and cross-functional collaboration skills, especially with Product, Research, Operations, Client Success, Sales, and Engineering stakeholders.

Nice to Have

  • Experience with alternative data or financial data, including consumer transaction data, email receipt data, B2B spend data, or other large-scale third-party datasets.
  • Experience supporting internal business stakeholders, including collaboration with leadership to aligned on strategic initiatives
  • Experience building data pipelines that support AI agents, LLMs, automated insight generation, or AI-powered analytical workflows.

What We Offer:

Our compensation package includes comprehensive benefits, perks, and a competitive salary: 

  • We care about your personal life, and we mean it. We offer flexible work hours, flexible vacation, a generous 401K match, parental leave, team events, wellness budget, learning reimbursement, and more!
  • Your growth at YipitData is determined by the impact that you are making, not by tenure, unnecessary facetime, or office politics. Everyone at YipitData is empowered to learn, self-improve, and master their skills in an environment focused on ownership, respect, and trust. See more on our high-impact, high-opportunity work environment above!
  • The annual salary for this position is anticipated to be up to $215,000 per year, with a variable target up to 10%. The compensation package also includes equity. The final offer may be determined by a number of factors, including, but not limited to, the applicant’s experience, knowledge, skills, abilities, as well as internal team benchmarks.

This role may be performed fully remotely within the United States. Please note that our US headquarters are located in NYC. We also have office hubs in Austin, Miami, and Mountain View. If the remote work is performed outside of these offices, income may be subject to New York State tax withholding.

Please note that for this position, we are not able to consider candidates who currently or in the future will require visa sponsorship.

We are committed to equal employment opportunity regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, marital status, disability, gender, gender identity or expression, or veteran status. We are proud to be an equal opportunity employer.

Job Applicant Privacy Notice

Apply now >

This job listing has been manually reviewed by the Jobicy Trust & Safety Team for compliance with our posting guidelines, including verification of the company's legitimacy, accuracy of job details, clarity of remote work policy, and absence of misleading or fraudulent content.

How to apply

Did you apply? Let us know, and we’ll help you track your application.

See a few more

Similar Software Engineering remote jobs

Jobs Talent Salaries
Menu