**About the Opportunity** ------------------------ We are looking for a Senior Quality Engineer with solid experience in quality assurance, AI, and Python development to drive the evolution of AI-powered products, ensure application quality, and contribute to the reliability of solutions leveraging LLMs, AI agents, and intelligent pipelines. **Responsibilities** --------------------- * Design and evolve test strategies for Artificial Intelligence products. * Develop and maintain automated tests (unit, integration, regression, and end\-to\-end). * Define test strategies for applications using LLMs, AI agents, and AI pipelines. * Establish quality processes, tools, and best practices. * Support the evolution of test architecture and application observability. * Write Python code for automation, validation, and test support. * Validate APIs, integrations, and business rules. * Collaborate closely with development teams to ensure highly reliable deliveries. * Contribute to continuous improvement of engineering and quality processes. **Mandatory Requirements** --------------------------- * Experience with test automation. * Experience with Python development. * Experience with unit, integration, regression, and end\-to\-end testing. * Ability to validate business workflows and integrations. * Genuine interest in Artificial Intelligence and AI-based products. * Experience with REST API testing. * Knowledge of Git. * Knowledge of SQL. **Desirable Requirements** ------------------------- * Experience with LLM observability using Phoenix (Arize), Langfuse, or LangSmith. * Knowledge of LangGraph. * Experience with LLM evaluation frameworks such as RAGAS and DeepEval. * Experience with load testing using k6\. * Experience with monitoring using Datadog. * Experience with GitHub Actions or CircleCI. * Knowledge of distributed application architecture and integrations. **Profile We Are Seeking** ----------------------- We seek an autonomous, proactive individual with strong analytical skills, a collaborative mindset, and a continuous learning attitude toward LLMs, intelligent agents, and emerging technologies. **We aim to provide our team with a welcoming, dynamic, and collaborative environment. To achieve this, we offer several initiatives, including:** * Fully remote opportunities * Remote work allowance * Periodic feedback * Employee referral program Psychological support * ️ * Workplace gymnastics ️ * Knowledge academy * English school partnership * Monthly transparency meetings * Online happy hours * Welcome kit
João Silva
Indeed · HR
João Silva
Indeed · HR
