In this role on our global content development team, you will be responsible for both AI-driven and traditional content development activities. You will provide input for the development and enhancement of AI software, utilizing this and other artificial intelligence tools to generate and curate test items, engage in prompt engineering, and collaborate with AI specialists to refine content generation algorithms.
You will be expected to manage a workstream of overlapping projects such as client-centric prompt engineering experiments. You also will likely lead small projects to tackle specific integration challenges and provide vision for innovation within the content development process. You will partner with clients and cross-functional teams on multiple exam programs and deliverables, monitoring scope and deadlines as well as escalating risks as needed.
In your support of the content development teams, you may facilitate in-person and virtual content development workshops with subject matter experts (SMEs) to write and review exam items and assemble examinations. You will evaluate test items applying best practices in assessment and statistical performance data.
SCOPE AND IMPACT OF THE JOB
The tasks performed in this position highly impact the business interests of the company. This position will play a critical role in shaping Pearson VUE’s approach to integrating generative AI in test development processes.
PRIMARY RESPONSIBILTIES
- Content Creation and Curation: Utilize both artificial intelligence tools and traditional methods to generate and curate test items and exam content, ensuring alignment with best practices in assessment and educational standards. Engage in prompt engineering to design and refine AI prompts that yield high-quality, relevant content.
- Research and Development: Contribute to the research and design of AI applications specifically tailored for content development in high-stakes exams. Stay current with the latest advancements in AI and machine learning to identify potential applications within the content development lifecycle.
- Integration and Implementation: Integrate AI-generated content into existing item banks and exam forms, ensuring seamless compatibility and functionality. Work with cross-functional teams to implement AI solutions, providing training and support to ensure smooth adoption.
- Quality Assurance: Perform rigorous quality checks on both AI-generated and traditionally developed content to ensure it meets Pearson VUE’s standards for accuracy, validity, and style.
- Data Analysis and Feedback: Analyse performance data of both AI-generated and traditionally developed content to identify trends, strengths, and areas for improvement. Provide feedback to AI development teams based on statistical analysis and SME input to enhance AI algorithms.
- Training and Support: Train fellow content developers and SMEs on how to effectively use AI tools for content creation and review. Offer ongoing support and troubleshooting assistance for AI-related queries and issues.
- Collaboration and Communication: Collaborate effectively with members of testing services teams and other cross-functional Pearson teams, providing timely and complete input on reports, documentation, projects, teams, meetings, and process improvements.
- Confidentiality and Security: Understand intellectual property confidentiality and security considerations and abide by defined business practices to provide appropriate protection.
CORE COMPETENCIES
- AI Literacy and Technical Proficiency: Demonstrate a solid understanding of artificial intelligence and its applications, particularly in content development and assessment. Show proficiency in using and evaluating AI content creation tools and software, with the ability to troubleshoot and optimize their use.
- Innovation and Adaptability: Embrace and champion innovative technologies and approaches, adapting quickly to new tools and methodologies in both AI-driven and traditional content development.
- Collaboration and Communication: Work effectively with AI specialists, developers, and product teams as a key stakeholder to integrate AI solutions into the content development process. Communicate information effectively to various stakeholders, including subject matter experts (SMEs), ensuring clarity and understanding.
- Content Development Expertise: Exhibit strong skills in traditional content development processes, including item writing, item bank management, and quality control, ensuring alignment with best practices in assessment and educational standards.
- Analytical Thinking: Apply strong analytical skills to evaluate both AI-generated and traditionally developed content, using statistical data and performance metrics to inform decisions and improvements.
- Continuous Improvement: Maintain a continuous learning orientation, staying current with the latest AI advancements and traditional content development techniques. Incorporate new knowledge into the content development workflow to drive ongoing improvement.
- Integrity and Attention to Detail: Demonstrate integrity in all tasks and maintain a high level of attention to detail to ensure accuracy and quality in both AI-generated and traditionally developed content.
QUALIFICATIONS
- Bachelor’s degree required, master’s degree preferred
- Experience as content or test developer, related coursework, or other direct applicable experience preferred
- Experience with generative AI, LLMs (Large Language Models) and prompt engineering preferred
WORK ENVIRONMENT AND CONDITIONS
- Use of phone, PC, and keyboard for data input and communications
- Ability to work remotely in a secure environment
- Ability to negotiate transportation for off-site meetings and to keep on-person a laptop during transit
- Travel requirement up to 25%