[All remote jobs](https://jobicy.com/jobs.md)[![Welo Global logo](https://jobicy.com/data/server-nyc0409/galaxy/mercury/2026/06/83c40f94-221.webp)](https://jobicy.com/company/welo-global.md)[Welo Global](https://jobicy.com/company/welo-global.md) # Project Lion – Senior Prompt Engineer – Portugal (Remote, Part-Time) AI Summary This senior prompt-engineering contract role leads the technical migration of template workflows to LLM autoraters. The specialist will use automated prompt generation and optimization tools, manually refine prompts for complex edge cases, and monitor model-versus-human evaluation outcomes. Core work includes validating autorater quality against gold data using F1, precision, and recall, then preparing launch-readiness documentation. The position requires native Portuguese, fluent English, Portugal residency, and at least four years of relevant prompt-engineering experience.[Apply for this job](#job-application)[View company](https://jobicy.com/company/welo-global.md)ShareRemote from[Portugal](https://jobicy.com/job-region/portugal.md)SalaryUndisclosedDepartment[Data Science & Analytics](https://jobicy.com/categories/data-science.md)EmploymentContractExperienceSeniorPublished8 Nov 2026Apply before8 Dec 2026Listing views54Application actions1Application toolkit ## Make your next move. Prepare your resume, explore your fit, and draft a cover letter for this opportunity. Opportunity details ## About this role.  We are seeking a Prompt Engineer to be responsible for the end-to-end technical migration workflow for transitioning templates to LLM autoraters. The role is required to use client’s internal tools to leverage prompt engineering techniques to maximize model performance. ### Responsibilities: * Utilize Automatic Prompt Generation (APG) tools to create baseline prompts for complex parent-child template clusters. * Run and supervise Automated Prompt Optimization (APO) tool, review the outputs, and flag when the APO reaches deadlocks or plateaus.   * Manually draft, test, and refine prompts to navigate complex template architectures, overcome anti-patterns, and handle edge cases where tooling is lacking or broken. Solve edge-case scenarios by designing and refining manual prompts. * Monitor shadowbot runs to ensure sufficient disagreements (between human and LLM ratings) are registered, generated, and tracked.   * Run prompt versions against established gold data to continuously measure autorater quality against the human crowd baseline, calculating accuracy metrics such as F1 scores, precision, and recall.   * Draft technical launch readiness justifications (Launch Certification Documentation) for final. ### Requirement: * Language Skills: Native fluency in Portuguese and fluent in English. * Location: Must be based in Portugal. * Education: Bachelor’s, Master’s, or Doctorate degree in Computer Science, Data Science, Computational Linguistics, Human-Computer Interaction (HCI), Cognitive Science, or a related analytical field.  * Prompt Engineering & AI Expertise: At least 4 years’ experience as Prompt Engineer. Proven experience tuning Large Language Models (LLMs) for strict, structured outputs, complex classification tasks, and familiarity with chain-of-thought and few-shot learning.  * Data Analysis: Strong proficiency in identifying error patterns, analyzing model performance, and using SQL or other data analytics tools.  * Technical Agility: Ability to quickly learn and master proprietary tools with minimal supervision.  * Communication: Excellent verbal and written communication skills.  ### Optional / Preferred Skills:  * Familiarity with enterprise-grade LLM interfaces like the Goose API.  * Experience in AI model evaluation, data science, computational linguistics, or software engineering.  * Hands-on experience with Automated Prompt Optimization (APO) systems or tuning workflows.  * Linguistic expertise, including an understanding of semantics and logic.  ### Compensation ### Additional Information Show more [Apply now >](https://jobicy.com/jobs/159779-project-lion-senior-prompt-engineer-portugal-remote-part-time.md) > Annual salary information is not provided for this position. Explore salary ranges for similar roles in our [Salary Directory ›](https://jobicy.com/salaries.md) * ![Upload CV](data:image/svg+xml;base64,PHN2ZyB4bWxucz0iaHR0cDovL3d3dy53My5vcmcvMjAwMC9zdmciIHdpZHRoPSI2NSIgaGVpZ2h0PSI2NSIgZmlsbD0ibm9uZSIgeG1sbnM6dj0iaHR0cHM6Ly92ZWN0YS5pby9uYW5vIj48ZyBjbGlwLXBhdGg9InVybCgjQSkiPjxwYXRoIGQ9Ik0wIDBINjVWNjVIMFYwWiIgZmlsbD0iIzAyOWFlYiIvPjxnIGZpbGw9IiNmZmYiIHN0cm9rZT0iI2ZmZiIgc3Ryb2tlLXdpZHRoPSIyIj48cGF0aCBkPSJNMzMuMDQ5IDE1LjQ1NGExLjQzIDEuNDMgMCAwIDAtMi4wOTcgMGwtNy41NzkgOC4xNDdhMS4zOCAxLjM4IDAgMCAwIC4wOSAxLjk3MyAxLjQ0IDEuNDQgMCAwIDAgMi4wMDgtLjA4OGw1LjEwOS01LjQ5MnYyMC42MWExLjQxIDEuNDEgMCAwIDAgMS40MjEgMS4zOTdjLjc4NSAwIDEuNDIxLS42MjUgMS40MjEtMS4zOTd2LTIwLjYxbDUuMTA5IDUuNDkyYTEuNDQgMS40NCAwIDAgMCAyLjAwOC4wODggMS4zOCAxLjM4IDAgMCAwIC4wOS0xLjk3M2wtNy41NzktOC4xNDZ6TTE2Ljc2OSAzOC40YzAtLjc3My0uNjItMS40LTEuMzg1LTEuNFMxNCAzNy42MjcgMTQgMzguNHYuMTAybC4yMTUgNi4yMjljLjIyMyAxLjY4LjcwMSAzLjA5NSAxLjgxMyA0LjIxOHMyLjUxIDEuNjA3IDQuMTcyIDEuODMzYzEuNi4yMTggMy42MzYuMjE4IDYuMTYuMjE4aDExLjI4bDYuMTYtLjIxOGMxLjY2Mi0uMjI2IDMuMDYxLS43MDkgNC4xNzItMS44MzNzMS41ODktMi41MzggMS44MTMtNC4yMThDNTAgNDMuMTEzIDUwIDQxLjA1NSA1MCAzOC41MDNWMzguNGMwLS43NzMtLjYyLTEuNC0xLjM4NS0xLjRzLTEuMzg1LjYyNy0xLjM4NSAxLjRsLS4xOSA1Ljk1OGMtLjE4MiAxLjM3LS41MTUgMi4wOTUtMS4wMjYgMi42MTJzLTEuMjI4Ljg1My0yLjU4MyAxLjAzOGMtMS4zOTUuMTktMy4yNDMuMTkzLTUuODkzLjE5M0gyNi40NjJjLTIuNjUgMC00LjQ5OC0uMDAzLTUuODkzLS4xOTMtMS4zNTUtLjE4NC0yLjA3Mi0uNTIxLTIuNTgzLTEuMDM4cy0uODQ0LTEuMjQyLTEuMDI2LTIuNjEyYy0uMTg3LTEuNDEtLjE5MS0zLjI3OS0uMTkxLTUuOTU4eiIvPjwvZz48L2c+PGRlZnM+PGNsaXBQYXRoIGlkPSJBIj48cGF0aCBmaWxsPSIjZmZmIiBkPSJNMCAwaDY1djY1SDB6Ii8+PC9jbGlwUGF0aD48L2RlZnM+PC9zdmc+) ### Upload your resume now To unlock remote work opportunities and be discovered by global employers. This job listing has been manually reviewed by the Jobicy Trust & Safety Team for compliance with our posting guidelines, including verification of the company's legitimacy, accuracy of job details, clarity of remote work policy, and absence of misleading or fraudulent content. ## Role DNA A quick view of the complexity, pace, ownership and collaboration implied by the job description. ### Job Complexity 5/5EasyHard ### Pace & Pressure 4/5RelaxedFast-paced ### Autonomy Level 5/5GuidedFull ownership ### Communication Load 4/5IndependentCollaborative AI insightThe role combines advanced LLM prompt optimization, structured-output evaluation, error analysis, and ownership of production launch decisions. It requires independent work with proprietary tools and resolution of failures where automation cannot produce a satisfactory result. ## Salary analysis Estimated compensation compared with the broader US market for similar roles. Estimated job median (per hour)Market rate$55US market range (per hour)$45–$750$82.50 AI insightThe hourly pay period is inferred from the job context; it was not explicitly stated by the employer. No employer salary was disclosed. The hourly cadence and USD market estimate are inferred for a senior, part-time freelance prompt-engineering engagement in Portugal; estimated market range is $45–$75 per hour, with a midpoint of $55 per hour. ## Core skills Skills and capabilities most closely associated with this opportunity. [Prompt engineering](https://jobicy.com/jobs?search_keywords=Prompt%20engineering.md)[Large language models](https://jobicy.com/jobs?search_keywords=Large%20language%20models.md)[LLM evaluation](https://jobicy.com/jobs?search_keywords=LLM%20evaluation.md)[Automated Prompt Generation](https://jobicy.com/jobs?search_keywords=Automated%20Prompt%20Generation.md)[Automated Prompt Optimization](https://jobicy.com/jobs?search_keywords=Automated%20Prompt%20Optimization.md)[Prompt testing](https://jobicy.com/jobs?search_keywords=Prompt%20testing.md)[Structured output design](https://jobicy.com/jobs?search_keywords=Structured%20output%20design.md)[Few-shot learning](https://jobicy.com/jobs?search_keywords=Few-shot%20learning.md)[Classification modeling](https://jobicy.com/jobs?search_keywords=Classification%20modeling.md)[SQL](https://jobicy.com/jobs?search_keywords=SQL.md)[Error analysis](https://jobicy.com/jobs?search_keywords=Error%20analysis.md)[F1 score analysis](https://jobicy.com/jobs?search_keywords=F1%20score%20analysis.md)[Precision and recall](https://jobicy.com/jobs?search_keywords=Precision%20and%20recall.md)[Computational linguistics](https://jobicy.com/jobs?search_keywords=Computational%20linguistics.md)[Technical documentation](https://jobicy.com/jobs?search_keywords=Technical%20documentation.md) Sample interview questionsHow would you evaluate whether an autorater prompt is ready for production?I would first run it against representative gold data and compare outcomes with the human baseline. I would measure precision, recall, F1, disagreement patterns, and performance across important edge-case segments. I would approve launch only after the metrics meet defined thresholds and the remaining errors are understood, documented, and acceptable for the use case. What do you do when an automated prompt optimization tool reaches a plateau? I inspect the optimization history and error clusters to determine whether the limitation comes from ambiguous instructions, insufficient examples, schema constraints, or problematic source templates. I then create targeted manual prompt variants, add contrastive few-shot examples where appropriate, and test changes against the gold set. I document the plateau, hypotheses, experiments, and final recommendation. How would you design prompts for strict structured outputs in a complex classification task? I would define an unambiguous output schema, explicit label definitions, decision rules, and handling for missing or conflicting evidence. I would use carefully selected examples that cover normal cases, boundary cases, and common anti-patterns. Finally, I would validate formatting compliance and classification quality separately so a well-formed output does not conceal weak reasoning or incorrect labels. Describe how you would investigate a low F1 score for a newly migrated template cluster. I would break down false positives and false negatives by template, label, language, and input pattern, then review representative examples with the human-rating criteria. This helps distinguish prompt defects from unclear taxonomy, data quality issues, or inconsistent human labels. I would prioritize the largest and highest-impact error groups, test focused revisions, and confirm improvements on a held-out evaluation set. How do you communicate a technical launch-readiness decision to non-technical stakeholders? I provide a concise recommendation supported by the purpose of the workflow, evaluation coverage, key quality metrics, known limitations, and mitigation steps. I translate model behavior into practical business risk, clearly stating whether the system is ready, conditionally ready, or requires further work. The accompanying documentation includes reproducible evidence and ownership for post-launch monitoring. Next step ## Apply now. Follow the employer’s application method and review Jobicy’s safety guidance before sharing personal information. Keep exploring ## Related remote jobs. * ![Welo Global logo](https://jobicy.com/data/server-nyc0409/galaxy/mercury/2026/06/83c40f94-221.webp) Welo Global Nov 8 New ### [Shape the Future of AI — Ilocano Talent Hub](https://jobicy.com/jobs/159816-shape-the-future-of-ai-ilocano-talent-hub.md) Welo Data, part of Welocalize, is a global AI data company with 500,000+ contributors delivering high-quality, ethical data to train the world’s most advanced AI systems. We’re building smarter, more… * ![Welo Global logo](https://jobicy.com/data/server-nyc0409/galaxy/mercury/2026/06/83c40f94-221.webp) Welo Global Nov 8 New ### [Project Lyra Mandarin Culture Expert](https://jobicy.com/jobs/159813-project-lyra-mandarin-culture-expert.md) Overview Are you passionate about languages, writing, and quality evaluation? We are launching an exciting language evaluation project and are looking for Mandarin-speaking experts to join our team. In this… * ![Welo Global logo](https://jobicy.com/data/server-nyc0409/galaxy/mercury/2026/06/83c40f94-221.webp) Welo Global Nov 8 New ### [Project Lion – Senior Prompt Engineer – Japan (Remote, Part-Time)](https://jobicy.com/jobs/159812-project-lion-senior-prompt-engineer-japan-remote-part-time.md)  We are seeking a Prompt Engineer to be responsible for the end-to-end technical migration workflow for transitioning templates to LLM autoraters. The role is required to use client’s internal tools to… * ![Reddit logo](https://jobicy.com/data/server-nyc0409/galaxy/mercury/2020/10/Reddit.jpg) Reddit Nov 8 New ### [Principal Data Scientist, User Ecosystem](https://jobicy.com/jobs/159801-principal-data-scientist-user-ecosystem.md) Reddit is a community of communities. It’s built on shared interests, passion, and trust, and is home to the most open and authentic conversations on the internet. Every day, Reddit… * ![Banyan Software logo](https://jobicy.com/data/server-nyc0409/galaxy/mercury/2025/06/bf5d3bb2-221.png) Banyan Software Nov 8 New ### [Lead AI Architect – Data Platform](https://jobicy.com/jobs/159786-lead-ai-architect-data-platform.md) Banyan Software is the best permanent home for software businesses that serve specialized industries, their employees, and their customers. With a buy-grow-and-hold-for-life approach and a permanent capital base, Banyan acquires… * ![Welo Global logo](https://jobicy.com/data/server-nyc0409/galaxy/mercury/2026/06/83c40f94-221.webp) Welo Global Nov 8 New ### [Project Lion – Senior Prompt Engineer – Netherland (Remote, Part-Time)](https://jobicy.com/jobs/159778-project-lion-senior-prompt-engineer-netherland-remote-part-time.md)  We are seeking a Prompt Engineer to be responsible for the end-to-end technical migration workflow for transitioning templates to LLM autoraters. The role is required to use client’s internal tools to… * ![Welo Global logo](https://jobicy.com/data/server-nyc0409/galaxy/mercury/2026/06/83c40f94-221.webp) Welo Global Nov 8 New ### [Project Lion – Senior Prompt Engineer – Italy (Remote, Part-Time)](https://jobicy.com/jobs/159777-project-lion-senior-prompt-engineer-italy-remote-part-time.md)  We are seeking a Prompt Engineer to be responsible for the end-to-end technical migration workflow for transitioning templates to LLM autoraters. The role is required to use client’s internal tools to… * ![Welo Global logo](https://jobicy.com/data/server-nyc0409/galaxy/mercury/2026/06/83c40f94-221.webp) Welo Global Nov 8 New ### [Project Lion – Senior Prompt Engineer – Germany (Remote, Part-Time)](https://jobicy.com/jobs/159776-project-lion-senior-prompt-engineer-germany-remote-part-time.md)  We are seeking a Prompt Engineer to be responsible for the end-to-end technical migration workflow for transitioning templates to LLM autoraters. The role is required to use client’s internal tools to… * ![Welo Global logo](https://jobicy.com/data/server-nyc0409/galaxy/mercury/2026/06/83c40f94-221.webp) Welo Global Nov 8 New ### [Project Lion – Senior Prompt Engineer – France (Remote, Part-Time)](https://jobicy.com/jobs/159775-project-lion-senior-prompt-engineer-france-remote-part-time.md)  We are seeking a Prompt Engineer to be responsible for the end-to-end technical migration workflow for transitioning templates to LLM autoraters. The role is required to use client’s internal tools to… * ![1Password logo](https://jobicy.com/data/server-nyc0409/galaxy/mercury/2020/09/WRILS-200909195848-296323.png) 1Password Nov 8 New ### [Staff Data Analyst, Marketing](https://jobicy.com/jobs/159746-staff-data-analyst-marketing.md) 1Password is growing. We’ve surpassed $500M in ARR and we’re continuing to accelerate, earning a spot on the Forbes Cloud 100 for four years in a row and teaming up… [Browse all jobs](https://jobicy.com/jobs.md)