Overview

Girl Effect is seeking a GenAI Narrative, Content & Evaluation Specialist (Individual Consultant) for a short-term consultancy to work on impactful projects for empowering adolescent girls in South Africa. The role involves curating and refining datasets for AI models, designing prompts, and evaluating chatbot responses.

Scope of Work

Curate and refine datasets for training and testing AI models, ensuring cultural relevance and safety.
Design and optimize prompts to control AI agent tone, persona, and safety protocols.
Conduct system analysis using tools like LangSmith to identify failure modes and safety issues.
Evaluate chatbot responses on parameters like empathy, tone, cultural relevance, and accuracy.
Develop evaluation reports, dialogue frameworks, and curated datasets for the AI systems.

Key Responsibilities

Generate and label high-quality datasets for model training.
Create system prompts and dialogue frameworks for mental health and SBCC agents.
Conduct system analysis to monitor reasoning, safety, and failure modes.
Evaluate chatbot responses for safety, tone, and cultural relevance.
Collaborate with technical teams and document findings for iterative improvements.

Qualifications & Experience

Native or near-native fluency in English, with deep familiarity with South African slang and linguistic patterns.
2-3 years of experience in content creation, linguistic roles, or related fields.
Strong understanding of youth language and behavioral content.
Experience with AI/ML datasets and evaluation tools like LangSmith is highly desirable.
Passion for making a positive impact on young women and girls.
Ability to work remotely and collaborate across multiple time zones.

Application Details

Interested candidates should submit a comprehensive proposal (max 5 pages) including a cover letter, CV/Profile, references, detailed cost breakdown in ZAR, and demonstration of understanding of the project requirements.

How to Apply

Submit proposal to suppliers@girleffect.org with the subject line: “GenAI Narrative, Content & Evaluation Specialist – South Africa” by 18 February 2026.

Deadline

18 February 2026