About this role.
Appen is seeking a Project Specialist to support end-to-end delivery of GenAI data annotation, evaluation, and collection projects. The role coordinates productivity, contributor qualification and training, crowd communications, task configuration, and quality assurance across concurrent workstreams. It also analyzes datasets for quality and optimization insights and supports Project Managers and Client Partners in client-facing meetings, workshops, QBRs, and reporting. This is a hands-on project-delivery position requiring strong ownership, documentation discipline, AI data-quality knowledge, and cross-functional communication.
Role DNA
A quick view of the complexity, pace, ownership and collaboration implied by the job description.
Job Complexity
4/5Pace & Pressure
4/5Autonomy Level
4/5Communication Load
4/5Salary analysis
Estimated compensation compared with the broader US market for similar roles.
Core skills
Skills and capabilities most closely associated with this opportunity.
Sample interview questions
I would first translate client requirements into measurable acceptance criteria, clear annotation guidelines, and a calibration set. I would monitor inter-annotator agreement, error categories, productivity, and escalation trends, then use findings to refine instructions and training before scaling production.
I would version the updated guidance, summarize what changed and why, and publish it through the agreed communication channels before work resumes. I would require acknowledgement where appropriate, provide examples and FAQs, and use targeted calibration or spot checks to confirm the change was understood.
I would review quality scores, disagreement rates, rework volume, throughput, task abandonment, time per task, and recurring error types. Segmenting these metrics by task type, guideline version, training cohort, and contributor performance can identify whether the issue is task design, documentation, tooling, or capability.
I prioritize based on delivery risk, client commitments, quality impact, and dependencies. I maintain a visible plan with owners and checkpoints, communicate trade-offs early, and escalate blockers with a proposed resolution rather than waiting for deadlines to be affected.
I would present concise evidence on delivery performance, quality trends, key insights, risks, and improvement actions. I would connect operational metrics to client objectives, explain any changes in a transparent way, and align on next-quarter priorities and success measures.
Role Purpose
Appen’s GenAI Project Delivery team sits at the intersection of AI development and real-world data quality, executing the annotation, evaluation, and data collection work that shapes how frontier models perform. The purpose of this role is to drive end-to-end delivery excellence across GenAI projects by ensuring task configuration, contributor performance, and data quality outcomes stay tightly aligned to client expectations. This is a hands-on, cross-functional role with influence over delivery standards, client outcomes, and the continuous improvement of how Appen executes at scale.
Your Impact
- Coordinate assigned project workstreams covering productivity, qualification, training and crowd communications.
- Deliver high-quality annotation and QA during POC and pilot phases to establish quality benchmarks.
- Analyze datasets to surface patterns, insights, and optimization opportunities that inform automation strategy and drive thought leadership content for customers.
- Support Project Managers and Client Partners as the AI expert point of contact across client meetings, workshops, QBRs, and status updates.
- Maintain version control and change communication protocols to ensure contributors are informed of guideline updates prior to launch and throughout production.
What You Bring
- Strong understanding of data quality principles, QA methodologies, and annotation workflows within GenAI or adjacent AI domains.
- Ability to create clear, accurate contributor-facing documentation including guidelines and FAQs.
- Confident communicator with experience engaging cross-functional stakeholders, including client-facing participation in meetings, workshops, or reporting cycles.
- Comfortable operating across multiple concurrent workstreams with a high degree of ownership and attention to delivery standards.
Compensation
Additional Information
Why You’ll Love Working Here
At Appen, we foster a culture of innovation, collaboration, and excellence. We value curiosity, accountability, and a commitment to delivering the highest quality AI solutions for frontier models. You’ll work on complex challenges that shape the future of AI across industries and geographies, alongside talented people in a culture that values humility over ego. You’ll have the flexibility to deliver in a way that works for you and your team, supported by tools, resources, and development opportunities to continue to build your capability over time.
About Appen
Appen has been a leader in AI training data for over 30 years. We specialise in human generated data to train, fine tune, and evaluate models across generative AI, large language models, computer vision, and speech recognition. Our AI assisted data annotation platform and global crowd of more than 1 million contributors in over 200 countries support model pre training, supervised fine tuning, evaluation and benchmarking, safety and red teaming, and multilingual global expansion.
Annual salary information is not provided for this position. Explore salary ranges for similar roles in our Salary Directory ›
Upload your resume now
- To unlock remote work opportunities and be discovered by global employers.
This job listing has been manually reviewed by the Jobicy Trust & Safety Team for compliance with our posting guidelines, including verification of the company's legitimacy, accuracy of job details, clarity of remote work policy, and absence of misleading or fraudulent content.
