[All remote jobs](https://jobicy.com/jobs.md)Open role[![Welo Global logo](https://jobicy.com/data/server-nyc0409/galaxy/mercury/2026/06/83c40f94-221.webp)](https://jobicy.com/company/welo-global.md)Remote opportunity at[Welo Global](https://jobicy.com/company/welo-global.md)

# Project Lion – Lead Prompt Engineer – United States (Remote, Part-Time)

Review the role, location requirements, compensation details, and application process before deciding whether this opportunity fits your next career move.

[Apply for this job](#job-application)[View company](https://jobicy.com/company/welo-global.md)Share31 Aug 2026Published28Listing views2Application actions30 Sep 2026Apply before  Opportunity details

## About this role.

AI SummaryWelo Global seeks a senior Lead Prompt Engineer to lead a technical migration from templates to LLM-based autoraters. The role combines hands-on prompt design and optimization with oversight of APG/APO workflows, gold-data evaluation, and model-quality measurement using F1, precision, and recall. The lead will mentor junior engineers, troubleshoot difficult template and tooling edge cases, and prepare launch-certification documentation. Candidates must be U.S.-based, have native English fluency, an advanced degree in a relevant analytical discipline, and at least seven years of prompt-engineering experience.

## Role DNA

A quick view of the complexity, pace, ownership and collaboration implied by the job description.

### Job Complexity

5/5EasyHard

### Pace & Pressure

4/5RelaxedFast-paced

### Autonomy Level

5/5GuidedFull ownership

### Communication Load

5/5IndependentCollaborative

AI insightThis is a highly specialized lead role requiring deep LLM prompt-optimization expertise, rigorous evaluation methodology, and the ability to resolve complex failures when automated tooling plateaus. It also requires independent technical leadership, mentoring, and clear launch-readiness documentation.

## Salary analysis

Estimated compensation compared with the broader US market for similar roles.

Estimated job medianMarket rate$180,000US market range$145k–$220k0$242k

AI insightNo actual compensation is disclosed in the posting. These are estimated U.S. annual-market figures in USD for a senior/lead prompt engineering and LLM evaluation specialist; actual freelance or part-time compensation may instead be structured as an hourly or project-based rate.

## Core skills

Skills and capabilities most closely associated with this opportunity.

[Prompt Engineering](https://jobicy.com/jobs?search_keywords=Prompt%20Engineering.md)[Large Language Models](https://jobicy.com/jobs?search_keywords=Large%20Language%20Models.md)[LLM Evaluation](https://jobicy.com/jobs?search_keywords=LLM%20Evaluation.md)[Prompt Optimization](https://jobicy.com/jobs?search_keywords=Prompt%20Optimization.md)[Automatic Prompt Generation](https://jobicy.com/jobs?search_keywords=Automatic%20Prompt%20Generation.md)[SQL](https://jobicy.com/jobs?search_keywords=SQL.md)[Data Analysis](https://jobicy.com/jobs?search_keywords=Data%20Analysis.md)[Model Performance Metrics](https://jobicy.com/jobs?search_keywords=Model%20Performance%20Metrics.md)[Technical Leadership](https://jobicy.com/jobs?search_keywords=Technical%20Leadership.md)[Computational Linguistics](https://jobicy.com/jobs?search_keywords=Computational%20Linguistics.md)

Sample interview questionsHow would you approach migrating a complex parent-child template cluster to an LLM autorater?I would first map the decision logic, dependencies, expected output schema, and known edge cases. I would generate an initial baseline prompt, evaluate it against a representative gold set, then iteratively refine instructions, examples, and output constraints while tracking quality metrics by template segment.

What do you do when an automated prompt optimization workflow reaches a plateau?

I verify that the evaluation data is representative and inspect error clusters rather than relying solely on aggregate scores. I then identify whether the issue is caused by ambiguity, missing context, schema constraints, adversarial inputs, or model limitations, and apply targeted manual prompt revisions or escalate tooling defects where appropriate.

How would you measure whether an autorater is ready for launch?

I would compare its outputs with human-labeled gold data using precision, recall, F1, agreement rates, and error severity. Launch readiness should also include threshold-based acceptance criteria, analysis of high-risk failure modes, monitoring plans, and documented justification for any remaining deviations from the human baseline.

Describe how you would mentor junior prompt engineers working on evaluation workflows.

I would establish clear prompt-design standards, review processes, experiment documentation, and metric definitions. I would pair mentoring with practical feedback on error analysis and prompt revisions, while gradually assigning ownership of bounded template clusters so engineers build sound judgment and autonomy.

How do you ensure prompts produce strict, structured outputs reliably?

I define an explicit schema, tightly constrain valid values and formatting, provide representative few-shot examples, and separate instructions from source content. I test malformed, ambiguous, and boundary inputs, then use automated validation and error analysis to improve both prompt robustness and downstream handling.

We are looking for an experienced Lead Prompt Engineer to guide and manage a team through the full technical migration process, transitioning templates to LLM autoraters. In this role, you will leverage advanced prompt engineering techniques and the client’s internal tools to optimize model performance, ensuring the successful integration and ongoing enhancement of AI systems. As the team lead, you will drive the strategy, mentor junior engineers, and play a key role in shaping the future of our AI-driven solutions.

### Responsibilities:

*

Utilize Automatic Prompt Generation (APG) tools to create baseline prompts for complex parent-child template clusters.

*

Run and supervise Automated Prompt Optimization (APO) tool, review the outputs, and flag when the APO reaches deadlocks or plateaus.  

*

Manually draft, test, and refine prompts to navigate complex template architectures, overcome anti-patterns, and handle edge cases where tooling is lacking or broken. Solve edge-case scenarios by designing and refining manual prompts.

*

Monitor shadowbot runs to ensure sufficient disagreements (between human and LLM ratings) are registered, generated, and tracked.  

*

Run prompt versions against established gold data to continuously measure autorater quality against the human crowd baseline, calculating accuracy metrics such as F1 scores, precision, and recall.  

*

Draft technical launch readiness justifications (Launch Certification Documentation) for final.

### Requirement:

*

Language Skills: Native fluency in English.

*

Location: Must be based in United States.

*

Education: Master’s, or Doctorate degree in Computer Science, Data Science, Computational Linguistics, Human-Computer Interaction (HCI), Cognitive Science, or a related analytical field. 

*

Prompt Engineering & AI Expertise: At least 7 years’ experience as Prompt Engineer. Proven experience tuning Large Language Models (LLMs) for strict, structured outputs, complex classification tasks, and familiarity with chain-of-thought and few-shot learning. 

*

Data Analysis: Strong proficiency in identifying error patterns, analyzing model performance, and using SQL or other data analytics tools. 

*

Technical Agility: Ability to quickly learn and master proprietary tools with minimal supervision. 

*

Communication: Excellent verbal and written communication skills. 

### Optional / Preferred Skills: 

*

Familiarity with enterprise-grade LLM interfaces like the Goose API. 

*

Experience in AI model evaluation, data science, computational linguistics, or software engineering. 

*

Hands-on experience with Automated Prompt Optimization (APO) systems or tuning workflows. 

*

Linguistic expertise, including an understanding of semantics and logic. 

### Compensation

### Additional Information

Federal Law Compliance 

 

In compliance with federal law, all persons hired will be required to: 

– Verify identity and eligibility to work in the United States; and 

– Complete a required employment eligibility verification form.

Please note that in order to verify work authorization as is required by Federal law (I-9 process), all new employees must complete a live video verification with their selected IDs and provide photos of these selected IDs within their first 3 days of employment.

To know more details [(Click here)](https://www.youtube.com/watch?v=hN1jzAueN4Y&ab_channel=WelocalizeTalent)

Show more

[Apply now >](https://jobicy.com/jobs/152182-project-lion-lead-prompt-engineer-united-states-remote-part-time.md)

>  Annual salary information is not provided for this position. Explore salary ranges for similar roles in our [Salary Directory ›](https://jobicy.com/salaries.md)

*

![Upload CV](data:image/svg+xml;base64,PHN2ZyB4bWxucz0iaHR0cDovL3d3dy53My5vcmcvMjAwMC9zdmciIHdpZHRoPSI2NSIgaGVpZ2h0PSI2NSIgZmlsbD0ibm9uZSIgeG1sbnM6dj0iaHR0cHM6Ly92ZWN0YS5pby9uYW5vIj48ZyBjbGlwLXBhdGg9InVybCgjQSkiPjxwYXRoIGQ9Ik0wIDBINjVWNjVIMFYwWiIgZmlsbD0iIzAyOWFlYiIvPjxnIGZpbGw9IiNmZmYiIHN0cm9rZT0iI2ZmZiIgc3Ryb2tlLXdpZHRoPSIyIj48cGF0aCBkPSJNMzMuMDQ5IDE1LjQ1NGExLjQzIDEuNDMgMCAwIDAtMi4wOTcgMGwtNy41NzkgOC4xNDdhMS4zOCAxLjM4IDAgMCAwIC4wOSAxLjk3MyAxLjQ0IDEuNDQgMCAwIDAgMi4wMDgtLjA4OGw1LjEwOS01LjQ5MnYyMC42MWExLjQxIDEuNDEgMCAwIDAgMS40MjEgMS4zOTdjLjc4NSAwIDEuNDIxLS42MjUgMS40MjEtMS4zOTd2LTIwLjYxbDUuMTA5IDUuNDkyYTEuNDQgMS40NCAwIDAgMCAyLjAwOC4wODggMS4zOCAxLjM4IDAgMCAwIC4wOS0xLjk3M2wtNy41NzktOC4xNDZ6TTE2Ljc2OSAzOC40YzAtLjc3My0uNjItMS40LTEuMzg1LTEuNFMxNCAzNy42MjcgMTQgMzguNHYuMTAybC4yMTUgNi4yMjljLjIyMyAxLjY4LjcwMSAzLjA5NSAxLjgxMyA0LjIxOHMyLjUxIDEuNjA3IDQuMTcyIDEuODMzYzEuNi4yMTggMy42MzYuMjE4IDYuMTYuMjE4aDExLjI4bDYuMTYtLjIxOGMxLjY2Mi0uMjI2IDMuMDYxLS43MDkgNC4xNzItMS44MzNzMS41ODktMi41MzggMS44MTMtNC4yMThDNTAgNDMuMTEzIDUwIDQxLjA1NSA1MCAzOC41MDNWMzguNGMwLS43NzMtLjYyLTEuNC0xLjM4NS0xLjRzLTEuMzg1LjYyNy0xLjM4NSAxLjRsLS4xOSA1Ljk1OGMtLjE4MiAxLjM3LS41MTUgMi4wOTUtMS4wMjYgMi42MTJzLTEuMjI4Ljg1My0yLjU4MyAxLjAzOGMtMS4zOTUuMTktMy4yNDMuMTkzLTUuODkzLjE5M0gyNi40NjJjLTIuNjUgMC00LjQ5OC0uMDAzLTUuODkzLS4xOTMtMS4zNTUtLjE4NC0yLjA3Mi0uNTIxLTIuNTgzLTEuMDM4cy0uODQ0LTEuMjQyLTEuMDI2LTIuNjEyYy0uMTg3LTEuNDEtLjE5MS0zLjI3OS0uMTkxLTUuOTU4eiIvPjwvZz48L2c+PGRlZnM+PGNsaXBQYXRoIGlkPSJBIj48cGF0aCBmaWxsPSIjZmZmIiBkPSJNMCAwaDY1djY1SDB6Ii8+PC9jbGlwUGF0aD48L2RlZnM+PC9zdmc+)

### Upload your resume now

To unlock remote work opportunities and be discovered by global employers.

This job listing has been manually reviewed by the Jobicy Trust & Safety Team for compliance with our posting guidelines, including verification of the company's legitimacy, accuracy of job details, clarity of remote work policy, and absence of misleading or fraudulent content.

Next step

## Apply now.

Follow the employer’s application method and review Jobicy’s safety guidance before sharing personal information.

Keep exploring

## Related remote jobs.

Matched by job category10 related opportunities[Data Science & Analytics](https://jobicy.com/categories/data-science.md) [Browse all jobs](https://jobicy.com/jobs.md)
*
![Teachable logo](https://jobicy.com/data/server-nyc0409/galaxy/mercury/2021/04/Teachable.png)
Teachable  Aug 31

### [Sr. Data Engineer](https://jobicy.com/jobs/152190-sr-data-engineer-2.md)

What is Teachable? Teachable is the platform for experts and businesses who take education seriously. In a world where anyone can ask AI for information, we’re the home for those…

*
![Databricks logo](https://jobicy.com/data/server-nyc0409/galaxy/mercury/2021/12/4e3f864ba9cf3c62d471e1c62414d098.jpg)
Databricks  Aug 31

### [Specialist Solutions Architect – AI/ML](https://jobicy.com/jobs/152187-specialist-solutions-architect-ai-ml.md)

P-226 As an AI/ML Specialist Solutions Architect (SSA), you will be the trusted technical ML & AI expert to both Databricks customers and the Field Engineering organization. You will work…

*
![Oddball logo](https://jobicy.com/data/server-nyc0409/galaxy/mercury/2022/02/8c034287ffd7b6474f90645b1c72e60a.jpeg)
Oddball  Aug 31

### [Data Engineer](https://jobicy.com/jobs/152170-data-engineer-3.md)

Oddball believes that we can bring change and improve the daily lives of millions by bringing quality software to the federal space. Our team is full of experienced engineering, product,…

*
![Oddball logo](https://jobicy.com/data/server-nyc0409/galaxy/mercury/2022/02/8c034287ffd7b6474f90645b1c72e60a.jpeg)
Oddball  Aug 31

### [Applied AI/ML Engineer](https://jobicy.com/jobs/152165-applied-ai-ml-engineer.md)

Oddball believes that the best products are built when companies understand and value the things they are working on. We value learning and growth and the ability to make a…

*
![Cloudbeds logo](https://jobicy.com/data/server-nyc0409/galaxy/mercury/2025/06/3aef1a38-221.png)
Cloudbeds  Aug 31

### [Principal ML Engineer](https://jobicy.com/jobs/148056-principal-ml-engineer.md)

What Makes Us Unique  At Cloudbeds, we’re not just building software, we’re transforming hospitality. Our intelligently designed platform powers properties across 150 countries, processing billions in bookings annually. From independent…

*
![Nebius logo](https://jobicy.com/data/server-nyc0409/galaxy/mercury/2026/06/d90c0566-221.webp)
Nebius  Aug 31

### [Product Growth Analytics Lead – Token Factory](https://jobicy.com/jobs/149856-product-growth-analytics-lead-token-factory.md)

About Nebius: Nebius is leading a new era in cloud infrastructure for the global AI economy. We are building a full-stack AI cloud platform that supports developers and enterprises from…

*
![ClinChoice logo](https://jobicy.com/data/server-nyc0409/galaxy/mercury/2026/06/757ea04d-221.webp)
ClinChoice  Aug 31

### [Senior/Principal Biostatistician Consultant remote (Infectious Disease)](https://jobicy.com/jobs/149864-senior-principal-biostatistician-consultant-remote-infectious-disease.md)

Are you interested in working directly for a single sponsor while having the security and additional career opportunities that working for a global CRO can bring? Our team says it’s…

*
![Sonatype logo](https://jobicy.com/data/server-nyc0409/galaxy/mercury/2020/12/WRILS-201223232219-694679.jpg)
Sonatype  Aug 30

### [Data Scientist](https://jobicy.com/jobs/152101-data-scientist-2.md)

Sonatype is the software supply chain management company that invented componentized software development and pioneered the software supply chain category. As leaders in the open-source community and the DevSecOps industry,…

*
![Instacart logo](https://jobicy.com/data/server-nyc0409/galaxy/mercury/2023/03/fe39c2bc9bb5ebb0b5e24318b1f3b60d.jpeg)
Instacart  Aug 30

### [Ads AI Analytics Lead II](https://jobicy.com/jobs/152090-ads-ai-analytics-lead-ii.md)

We’re transforming the grocery industry At Instacart, we invite the world to share love through food because we believe everyone should have access to the food they love and more…

*
![Quantum Metric logo](https://jobicy.com/data/server-nyc0409/galaxy/mercury/2025/06/52363ead-221.jpg)
Quantum Metric  Aug 30

### [Senior/Strategic Digital Analytics Consultant – Spain](https://jobicy.com/jobs/152083-senior-strategic-digital-analytics-consultant-spain.md)

😎 Our Culture Quantum Metric’s number one objective is happy people, diverse and inclusive culture. We’re passionate about empowering our people to become the best version of themselves, offering coaching…