[![Image]() Meet Jobicy Copilot — free AI autofill for job applications + remote job alerts ›](#)   [All remote jobs](https://jobicy.com/jobs.md)Open role[![ANGI logo](https://jobicy.com/data/server-nyc0409/galaxy/mercury/2021/09/50cccf084c34089de2274f72e18841d0.jpg)](https://jobicy.com/company/angi.md)Remote opportunity at[ANGI](https://jobicy.com/company/angi.md)

# Staff AI Product Analyst

Review the role, location requirements, compensation details, and application process before deciding whether this opportunity fits your next career move.

[Apply for this job](#job-application)[View company](https://jobicy.com/company/angi.md)Share9 Sep 2026Published43Listing views3Application actions9 Oct 2026Apply before  Opportunity details

## About this role.

AI SummaryAngi is seeking a Staff AI Product Analyst to establish AI-native product analytics for agentic workflows. The role defines north-star metrics, causal measurement approaches, evaluation frameworks, golden datasets, and production monitoring for AI-generated analytics. This senior individual contributor partners closely with AI product, engineering, analytics engineering, data science, and business leadership. Success depends on converting AI capabilities and failure modes into trusted, measurable business outcomes and prioritized engineering improvements.

## Role DNA

A quick view of the complexity, pace, ownership and collaboration implied by the job description.

### Job Complexity

5/5EasyHard

### Pace & Pressure

4/5RelaxedFast-paced

### Autonomy Level

5/5GuidedFull ownership

### Communication Load

5/5IndependentCollaborative

AI insightThis is a staff-level role requiring more than 10 years of analytics, data science, or technical product experience plus practical LLM evaluation expertise. The incumbent must create durable measurement and governance systems amid technical ambiguity while influencing senior cross-functional stakeholders.

## Salary analysis

Estimated compensation compared with the broader US market for similar roles.

Estimated job medianMarket rate$195,000US market range$170k–$240k0$264k

AI insightThe disclosed US yearly salary band is $165,000 to $225,000, with a midpoint of $195,000. A competitive US market base-salary range for a staff-level AI product analytics specialist is approximately $170,000 to $240,000 annually; bonus and equity may add material total compensation but are not quantified in the posting.

## Core skills

Skills and capabilities most closely associated with this opportunity.

[AI product analytics](https://jobicy.com/jobs?search_keywords=AI%20product%20analytics.md)[LLM evaluation](https://jobicy.com/jobs?search_keywords=LLM%20evaluation.md)[Agentic AI](https://jobicy.com/jobs?search_keywords=Agentic%20AI.md)[Product metrics](https://jobicy.com/jobs?search_keywords=Product%20metrics.md)[Experimentation](https://jobicy.com/jobs?search_keywords=Experimentation.md)[Python](https://jobicy.com/jobs?search_keywords=Python.md)[Data governance](https://jobicy.com/jobs?search_keywords=Data%20governance.md)[Golden datasets](https://jobicy.com/jobs?search_keywords=Golden%20datasets.md)[Production monitoring](https://jobicy.com/jobs?search_keywords=Production%20monitoring.md)[Stakeholder communication](https://jobicy.com/jobs?search_keywords=Stakeholder%20communication.md)

Sample interview questionsHow would you define success metrics for a new agentic analytics journey?I would begin with the user decision or workflow the agent is intended to improve, then define a north-star outcome such as validated task completion or time-to-insight. I would pair it with guardrails for accuracy, policy safety, user abandonment, fallback use, human overrides, latency, and downstream business impact. I would establish baselines and instrument the full journey before assessing incremental lift through experiments or carefully framed observational analysis.

Describe how you would build an evaluation framework for an LLM-powered analytics agent.

I would construct a representative golden dataset covering common requests, high-value workflows, edge cases, ambiguous prompts, and known failure modes. Each case would include expected outputs or scoring rubrics for factual accuracy, completeness, correct tool use, uncertainty communication, and policy compliance. The framework would run pre-release regression tests and be supplemented by production sampling, human review, and severity-based incident tracking.

How do you distinguish an AI agent that appears useful from one that delivers reliable business value?

I separate superficial engagement from validated outcomes. Beyond usage, I measure whether users complete the intended task, whether outputs are accepted or overridden, whether recommendations are accurate, and whether the workflow changes a downstream business metric. I also assess cost, latency, and operational risk so that apparent productivity gains are not offset by errors or expensive human verification.

What would you do after detecting a rise in incorrect metrics produced by an analytics agent?

I would first triage severity, isolate affected users and decisions, and add safeguards or temporarily restrict risky capabilities if necessary. I would classify examples by root cause, such as retrieval gaps, semantic-layer defects, incorrect tool selection, prompt ambiguity, or source-data quality. I would then prioritize fixes with engineering partners, add the cases to regression evaluations, and communicate the issue, uncertainty, mitigation, and recovery criteria clearly to stakeholders.

How would you communicate uncertainty in AI measurement to non-technical leaders?

I would use a concise narrative that states the decision, evidence, confidence level, limitations, and recommended next action. For example, I would distinguish a measured experiment result from directional production signals and quantify known error or override rates. This gives leaders a practical basis for action without overstating the certainty of the AI system or the analysis.

For over 30 years, Angi has powered the future of the home services industry, creating an environment where homeowners and pros benefit from more jobs done well.

For homeowners, our platform is a reliable way to find skilled pros. For pros, we’re a reliable business partner who helps them find the winnable work they want, when they want. For employees, we’re an amazing place to call home. We can’t wait to welcome you.

Angi at a glance:

*

Founded in 1995 as Angie’s List and rebranded in 2021

*

Global company with 9 brands in 8 countries and employees worldwide

*

Homeowners have turned to us for 300 million home projects and counting

### About the team

The Staff AI Product Analyst will define AI-native product analytics for Angi, turning visionary technology into prioritized use cases, robust evaluation disciplines, and a trusted data ecosystem. This role is central to building Angi’s agentic product analytics capability—defining where AI-native analytics creates real leverage, designing the evaluation frameworks that earn organizational trust, and establishing repeatable system standards. As a senior individual contributor, you will have broad influence across the product analytics function and beyond, ensuring that both human teams and AI agents remain aligned on truth, quality, and usefulness.

The ideal candidate is a systems-thinking data expert who bridges the gap between deep AI capabilities and practical business outcomes.

### What you’ll do

AI Product Strategy & Metrics Design

*

Flagship Journey Measurement: Partner with AI product, engineering, and domain experts to define north-star and guardrail metrics for flagship AI journeys, focusing on adoption, task completion, quality, and downstream business outcomes.

*

Causal Framing & Experimentation: Align closely with data science partners on test design, interpretation, and causal framing when new AI products ship.

*

Data Layer Systems Thinking: Map how agents interact with metrics, raw tables, documentation, and APIs to ensure requirements for data and analytics engineering are explicit, structured, and testable.

Evaluation, Governance & Backlog Management

*

Eval Framework Architecture: Design and maintain formal evaluation sets, “golden datasets,” rubrics, and regression checks for agent outputs to guarantee accuracy, completeness, policy safety, and usefulness.

*

Taxonomy & Failure Mode Analysis: Systematically categorize wrong answers, tool misuse, context gaps, and data edge cases, feeding those insights back into prompts, retrieval (RAG), tools, and data modeling pipelines.

*

Performance Monitoring: Monitor live usage of Agentic AI analytics workflows—tracking success, abandonment, fallback patterns, and human override rates to maintain a prioritized engineering improvement backlog.

Cross-Functional Leadership & Enablement

*

Playbooks & Narrative: Own internal documentation defining when to use agents, required human checkpoints, and how to communicate uncertainty. Support enablement and leadership storytelling around agentic AI analytics.

*

Strategic Collaboration: Partner with business leaders, the Principal Analytics Engineer, and data engineering teams to translate complex AI capabilities into measurable business outcomes.

*

Defining Success: Deliver recurring measurement artifacts (dashboards, reviews, or written readouts) that leadership uses to prioritize roadmaps, while continuously reducing high-severity incidents where agents produce incorrect metrics.

### Who you are

Minimum Qualifications

*

Bachelor’s in computer science or a quantitative field (e.g., Computer Science, Statistics, Mathematics, or related fields).

*

10+ years of experience across product analytics, data science, or technical product management within a complex, high-scale operating environment.

*

1+ years of direct, hands-on experience working with AI/LLM systems in an applied context, with a specific focus on evaluating, trusting, and deploying them responsibly.

*

Deep technical proficiency with Python, ML frameworks, data visualization/analytics platforms, and standard data management/governance practices.

*

Proven track record designing AI evaluation frameworks, including formal evals, golden datasets, production monitoring, or equivalent rigor in a related data discipline.

*

Exceptional communication skills with a demonstrated ability to translate highly technical AI insights and tradeoffs into clear narratives for non-technical business stakeholders.

Preferred Qualifications

*

Experience building or evaluating agentic analytics workflows, orchestration frameworks, and familiarity with multi-agent systems.

*

Demonstrated ability to operate fluidly in ambiguity, run structured experiments or pilots, and default to fast action and iteration.

*

A systems-oriented mindset with a healthy skepticism of AI hype, focusing strictly on organizational outcomes and driving technical investments that yield true business value.

Compensation & Benefits

*

The salary band for this position ranges from $165,000 – $225,000 commensurate with experience and performance. Compensation may vary based on factors such as cost of living.

*

This position will be eligible for a competitive year end performance bonus & equity package.

*

Full medical, dental, vision package to fit your needs

*

Flexible vacation policy; work hard and take time when you need it

*

Pet discount plans & retirement plan with company match (401K)

*

The rare opportunity to work with sharp, motivated teammates solving some of the most unique challenges and changing the world

We value diversity

We know that the best ideas come from teams where diverse points of view uncover new solutions to hard problems. We welcome and value individuals who bring diverse life experiences, educational backgrounds, cultures, and work experiences.

Our hiring process may utilize artificial intelligence (AI) tools to assist in candidate screening and assessment. Our AI tools are designed to complement, not replace, human decision-making.

#LI-Remote

Show more

[Apply now >](https://jobicy.com/jobs/152924-staff-ai-product-analyst.md)

*

![Upload CV](data:image/svg+xml;base64,PHN2ZyB4bWxucz0iaHR0cDovL3d3dy53My5vcmcvMjAwMC9zdmciIHdpZHRoPSI2NSIgaGVpZ2h0PSI2NSIgZmlsbD0ibm9uZSIgeG1sbnM6dj0iaHR0cHM6Ly92ZWN0YS5pby9uYW5vIj48ZyBjbGlwLXBhdGg9InVybCgjQSkiPjxwYXRoIGQ9Ik0wIDBINjVWNjVIMFYwWiIgZmlsbD0iIzAyOWFlYiIvPjxnIGZpbGw9IiNmZmYiIHN0cm9rZT0iI2ZmZiIgc3Ryb2tlLXdpZHRoPSIyIj48cGF0aCBkPSJNMzMuMDQ5IDE1LjQ1NGExLjQzIDEuNDMgMCAwIDAtMi4wOTcgMGwtNy41NzkgOC4xNDdhMS4zOCAxLjM4IDAgMCAwIC4wOSAxLjk3MyAxLjQ0IDEuNDQgMCAwIDAgMi4wMDgtLjA4OGw1LjEwOS01LjQ5MnYyMC42MWExLjQxIDEuNDEgMCAwIDAgMS40MjEgMS4zOTdjLjc4NSAwIDEuNDIxLS42MjUgMS40MjEtMS4zOTd2LTIwLjYxbDUuMTA5IDUuNDkyYTEuNDQgMS40NCAwIDAgMCAyLjAwOC4wODggMS4zOCAxLjM4IDAgMCAwIC4wOS0xLjk3M2wtNy41NzktOC4xNDZ6TTE2Ljc2OSAzOC40YzAtLjc3My0uNjItMS40LTEuMzg1LTEuNFMxNCAzNy42MjcgMTQgMzguNHYuMTAybC4yMTUgNi4yMjljLjIyMyAxLjY4LjcwMSAzLjA5NSAxLjgxMyA0LjIxOHMyLjUxIDEuNjA3IDQuMTcyIDEuODMzYzEuNi4yMTggMy42MzYuMjE4IDYuMTYuMjE4aDExLjI4bDYuMTYtLjIxOGMxLjY2Mi0uMjI2IDMuMDYxLS43MDkgNC4xNzItMS44MzNzMS41ODktMi41MzggMS44MTMtNC4yMThDNTAgNDMuMTEzIDUwIDQxLjA1NSA1MCAzOC41MDNWMzguNGMwLS43NzMtLjYyLTEuNC0xLjM4NS0xLjRzLTEuMzg1LjYyNy0xLjM4NSAxLjRsLS4xOSA1Ljk1OGMtLjE4MiAxLjM3LS41MTUgMi4wOTUtMS4wMjYgMi42MTJzLTEuMjI4Ljg1My0yLjU4MyAxLjAzOGMtMS4zOTUuMTktMy4yNDMuMTkzLTUuODkzLjE5M0gyNi40NjJjLTIuNjUgMC00LjQ5OC0uMDAzLTUuODkzLS4xOTMtMS4zNTUtLjE4NC0yLjA3Mi0uNTIxLTIuNTgzLTEuMDM4cy0uODQ0LTEuMjQyLTEuMDI2LTIuNjEyYy0uMTg3LTEuNDEtLjE5MS0zLjI3OS0uMTkxLTUuOTU4eiIvPjwvZz48L2c+PGRlZnM+PGNsaXBQYXRoIGlkPSJBIj48cGF0aCBmaWxsPSIjZmZmIiBkPSJNMCAwaDY1djY1SDB6Ii8+PC9jbGlwUGF0aD48L2RlZnM+PC9zdmc+)

### Upload your resume now

To unlock remote work opportunities and be discovered by global employers.

This job listing has been manually reviewed by the Jobicy Trust & Safety Team for compliance with our posting guidelines, including verification of the company's legitimacy, accuracy of job details, clarity of remote work policy, and absence of misleading or fraudulent content.

Next step

## Apply now.

Follow the employer’s application method and review Jobicy’s safety guidance before sharing personal information.

Keep exploring

## Related remote jobs.

Matched by job category10 related opportunities[Data Science & Analytics](https://jobicy.com/categories/data-science.md) [Browse all jobs](https://jobicy.com/jobs.md)
*
![Cordance logo](https://jobicy.com/data/server-nyc0409/galaxy/mercury/2025/06/e9fec3ef-221.png)
Cordance  Sep 9

### [Data Architect](https://jobicy.com/jobs/152947-data-architect.md)

Cordance is dedicated to accelerating the growth of vertically focused business-to-business (B2B) software-as-a-service (SaaS) companies through acquisition and long-term tactical and financial guidance. We’re experienced operators and subject-matter experts with…

*
![Launch Potato logo](https://jobicy.com/data/server-nyc0409/galaxy/mercury/2025/06/30f8890f-221-1.png)
Launch Potato  Sep 9

### [Staff Data Scientist, Marketing](https://jobicy.com/jobs/152875-staff-data-scientist-marketing.md)

WHO ARE WE? Launch Potato is the discovery and conversion company. We reach tens of millions of people every month through our brands, including FinanceBuzz, All About Cookies, and OnlyInYourState….

*
![Launch Potato logo](https://jobicy.com/data/server-nyc0409/galaxy/mercury/2025/06/30f8890f-221-1.png)
Launch Potato  Sep 9

### [Staff Applied Scientist, AdTech](https://jobicy.com/jobs/152870-staff-applied-scientist-adtech.md)

WHO ARE WE? Launch Potato is the discovery and conversion company. We reach tens of millions of people every month through our brands, including FinanceBuzz, All About Cookies, and OnlyInYourState….

*
![Launch Potato logo](https://jobicy.com/data/server-nyc0409/galaxy/mercury/2025/06/30f8890f-221-1.png)
Launch Potato  Sep 9

### [Lead Data Scientist, AdTech](https://jobicy.com/jobs/152863-lead-data-scientist-adtech.md)

WHO ARE WE? Launch Potato is the discovery and conversion company. We reach tens of millions of people every month through our brands, including FinanceBuzz, All About Cookies, and OnlyInYourState….

*
![Tremendous logo](https://jobicy.com/data/server-nyc0409/galaxy/mercury/2025/01/c2bd8be5-221.jpeg)
Tremendous  Sep 9

### [Senior Data Analyst](https://jobicy.com/jobs/152859-senior-data-analyst.md)

Tremendous is the global platform built for businesses to send thousands of payouts to anyone, anywhere, for free. We’re trusted by 20,000 organizations like Atlassian, MIT, and United Way to…

*
![Launch Potato logo](https://jobicy.com/data/server-nyc0409/galaxy/mercury/2025/06/30f8890f-221-1.png)
Launch Potato  Sep 9

### [Lead Applied Scientist, Marketing](https://jobicy.com/jobs/152852-lead-applied-scientist-marketing.md)

WHO ARE WE? Launch Potato is the discovery and conversion company. We reach tens of millions of people every month through our brands, including FinanceBuzz, All About Cookies, and OnlyInYourState….

*
![Bayesian Health logo](https://jobicy.com/data/server-nyc0409/galaxy/mercury/2025/08/f74593d8-221.png)
Bayesian Health  Sep 8

### [Senior/Staff Machine Learning Data Scientist](https://jobicy.com/jobs/152824-senior-staff-machine-learning-data-scientist.md)

Senior/Staff Machine Learning Data Scientist In Brief We’re an early-stage startup on a mission to make healthcare proactive by empowering physicians, nurses, and care team members with real-time data to…

*
![Veeam Software logo](https://jobicy.com/data/server-nyc0409/galaxy/mercury/2025/06/f7716b71-221.jpg)
Veeam Software  Sep 8

### [Director, Data Governance (REMOTE, WA)](https://jobicy.com/jobs/152823-director-data-governance-remote-wa.md)

Veeam is the Data and AI Trust Company, specializing in helping organizations ensure their data and AI are fully understood, secured, and resilient to enable the acceleration of safe AI…

*
![Beyond Finance logo](https://jobicy.com/data/server-nyc0409/galaxy/mercury/2022/01/68cd015e123539d873279c7b82f1ca6a.jpg)
Beyond Finance  Sep 8

### [Manager, Strategy & Analytics](https://jobicy.com/jobs/152802-manager-strategy-analytics.md)

At Beyond Finance, we’ve made it our mission to help everyday Americans escape the endless cycle of crippling debt and step into a brighter financial future. Through compassionate, individualized care,…

*
![Beyond Finance logo](https://jobicy.com/data/server-nyc0409/galaxy/mercury/2022/01/68cd015e123539d873279c7b82f1ca6a.jpg)
Beyond Finance  Sep 8

### [Lead Data Platform Engineer](https://jobicy.com/jobs/152793-lead-data-platform-engineer-2.md)

At Beyond Finance, we’ve made it our mission to help everyday Americans escape the endless cycle of crippling debt and step into a brighter financial future. Through compassionate, individualized care,…