Data Scientist - AI Curation

Description

Job Summary: Capgemini is seeking a Data Scientist - AI Curation to develop and optimize prompts for LLMs, curate responses, and monitor generative AI metrics. Key Highlights: 1. Inclusive, collaborative, and continuously evolving environment 2. Develop and optimize prompts and contexts for LLMs 3. Stay updated on trends in prompt engineering Barueri Data Scientist - AI Curation Are you passionate about technology and innovation, and do you want to be part of an inclusive, collaborative, and continuously evolving environment? Then this opportunity is for you! At Capgemini, we value the balance between personal and professional life. Therefore, we offer flexible work models—ranging from remote, hybrid, or on-site—depending on project requirements. Our goal is to deliver the best experience for you, respecting your lifestyle and promoting well-being. We are looking for an **AI Curation** professional to join our team. **Responsibilities**: * Develop and optimize prompts and contexts for LLMs, ensuring coherence and alignment with business objectives. * Conduct conversational journey testing, identifying improvement opportunities and adjusting strategies to enhance user experience quality. * Curate and validate AI-generated responses, ensuring accuracy, relevance, and contextual appropriateness. * Implement and monitor generative AI evaluation metrics, including automated metrics (BLEU, ROUGE) and qualitative metrics (coherence, relevance, accuracy). * Use model monitoring and evaluation tools—such as A/B testing frameworks and metric dashboards—for continuous performance analysis. * Collaborate with technical teams to integrate LLMs into agent pipelines, ensuring proper functionality and alignment with requirements. * Stay updated on trends and best practices in prompt engineering, AI evaluation, and content curation. **Technical Requirements**: * Proficiency in prompt engineering and context construction for LLMs. * Knowledge of generative AI evaluation metrics (accuracy, relevance, coherence, BLEU, ROUGE). * Experience in conversational journey testing and response curation. * Familiarity with A/B testing tools, dashboards, and model monitoring solutions. * Basic understanding of LLM APIs and integration into agent pipelines. * Desired experience with AI evaluation and monitoring frameworks. **Diversity, Inclusion, and Belonging** At Capgemini, you can be who you are. We value diversity in all its forms and foster an inclusive environment through committees such as: * Women@Capgemini – Female empowerment and gender equity. * Capgemini Black – Representation and appreciation of Black culture. * LGBTQIA+@Capgemini, Capgemini Accessibility, among others. Our commitment is ongoing: we are recognized by GPTW, Bloomberg Gender Equality Index, EDGE, and Ethisphere as one of the world’s most ethical and inclusive companies. Our job openings are open to everyone, regardless of color, ethnicity, religion, age, gender identity, sexual orientation, or disability. **Development and Benefits** Here, you are the protagonist of your career! We offer: * Structured career development plans and personalized learning paths. * Corporate University, with access to Harvard, Coursera, Udemy, Pluralsight. * Official certifications with partners such as SAP, AWS, Microsoft, Salesforce. * Language courses with EF Education First (English, Spanish, French, German). **Comprehensive Well-being** * Medical and dental assistance. * Gympass and Equilibrium (physical and mental health). * Private pension plan and life insurance. * Family Care Program: extended maternity and paternity leave, fertility support, personalized health and well-being guidance. * Meal allowance, benefits club, and much more! **Make it Real!** At Capgemini, we unleash human energy through technology to build a more inclusive, sustainable, and innovative future. If you share these values, come transform the world with us! Ref. code 390966-pt_BR Posted on 21 Jan 2026 Experience level Experienced professionals Contract type Permanent Location Barueri Business unit ABL AMERICAS Brand Capgemini Professional communities Software Engineering