IT Sr Leader

Description

Job Summary: Technical leadership and team management for Data, Analytics, and Batch Processing, with a focus on pipeline optimization and AI Agents usage. Key Highlights: 1. Manage and develop data and analytics teams. 2. Work with Airflow, AWS EMR, Glue, and Athena. 3. Design and optimize data and analytics pipelines. IT Sr Leader Country: Brazil We have an opening for you to become a **Manager Database**. **In this role, you will:** * Technically and administratively manage the Batch, Scheduling & Informational Capability team * Define the technical roadmap, backlog, and evolution plan for batch processing and analytics capabilities * Assign and monitor tasks, ensuring technical quality, adherence to deadlines, and compliance with defined standards * Act hands-on in creating and maintaining DAGs in Airflow * Design, implement, and optimize data pipelines using EMR, Glue, and Athena * Ensure reliability, performance, and scalability of batch and scheduling processes * Define and monitor SLAs for processing, batch windows, and inter-flow dependencies * Support business areas in building analytical datasets and PowerBI dashboards * Explore and implement use cases involving AI Agents integrated into data and analytics pipelines * Conduct troubleshooting of pipeline failures, identifying performance bottlenecks and data inconsistencies * Establish metrics for data flow quality, observability, and governance * Promote continuous improvement, standardization, and documentation of solutions * Conduct performance evaluations, technical development, and team upskilling **Mandatory Requirements:** * Proven experience in technical leadership and team management for Data, Analytics, and Batch Processing, acting as a hands-on manager * Advanced knowledge of workflow orchestration and scheduling using Apache Airflow, including DAG design, dependency control, retries, SLAs, and troubleshooting * Practical experience with AWS EMR (Spark, Hadoop) for distributed processing of large-scale data volumes * Knowledge of AWS Glue (ETL, Crawlers, Data Catalog) for data ingestion, transformation, and governance * Experience with AWS Athena for analytical queries on data stored in S3 * Solid understanding of batch data architecture, and ingestion, transformation, and loading (ETL/ELT) pipelines * Experience with analytics and data visualization tools such as Quicksight and PowerBI * Familiarity with analytics fundamentals, dimensional modeling, data marts, and data lakes * Knowledge of AI Agents and their integration with data and analytics pipelines for automation and insight generation * Experience with S3 storage, data partitioning, and cost/performance optimization * Ability to define standards for pipeline quality, governance, and observability * Experience defining and tracking quality indicators, SLAs, SLOs, and operational metrics * Technical capability to implement pipelines, conduct architectural reviews, and perform code reviews **Desirable Requirements:** * AWS certifications related to Data Analytics or Big Data * Practical knowledge and usage of market AI tools to boost productivity, such as Devin, Claude, Cursor, ChatGPT Enterprise, GitHub Copilot, etc. * Experience with modern Data Lake and Lakehouse architectures * Advanced Spark knowledge and distributed job optimization * Experience integrating data pipelines into CI/CD pipelines * Experience with DataOps practices and automated pipeline deployment * Knowledge of data governance, data cataloging, and access control * Advanced English and Spanish for collaboration with global teams **Work Location:** Geração Digital – Av Interlagos, 3501 – Interlagos, São Paulo - SP **# BENEFITS:** ➡️ Meal allowance; ➡️ Health insurance; ➡️ Dental insurance: Basic and intermediate plans; ➡️ Transportation allowance; ➡️ Flexible Vacation: 24 business days of vacation, divisible into up to 6 periods; after every 2 months worked, you can already enjoy 4 business days; ➡️ Birthday Day Off; ➡️ Profit Sharing Program (PPR); ➡️ Gym partnerships: Wellhub, Totalpass; ➡️ Flex Working: Hybrid work model — 2 days remote and 3 days onsite; ➡️ Training platforms with over 100,000 courses; ➡️ Career paths for professional development; ➡️ Flex Learning: Exclusive study incentive for High-Performance employees; ➡️ Childcare allowance; ➡️ Nascer Program and Extended Paternity Leave; ➡️ Life insurance; ➡️ Nascer Program; ➡️ Be Healthy — Program encouraging healthier habits; ➡️ PAPE — Specialized personal support program; #LI-Hybrid