[30060] Senior Data Engineer, Brazil

Description

At CI\&T, we help major enterprises transform the potential of AI into real business impact through AI Deployment, AI-native execution, and tech-integrated business solutions. With 30 years of experience in technological transformation, we accelerate innovation with expertise in agentic SDLC, application modernization, Data \& AI, martech, and business strategy. We are 8\.000 CI\&Ters across more than 25 countries, collaborating to build solutions with real impact. AI is already part of how we work, evolve, and innovate every day. **Important**: If you reside in the Metropolitan Region of Campinas, your physical presence at our city offices is mandatory, per our current attendance policy. Job Description: We are seeking a Data Engineer for a data integration project. Key responsibilities involve the following technologies: * Databricks with PySpark * Near-real-time data processing (Kafka) * Productionalization of Machine Learning models on Databricks (MLOps) * CI/CD pipelines (GitHub and GitHub Actions) * Experience with Agile methodologies The professional must possess knowledge of and adhere to software development best practices, optimize data usage, develop applications, and collaborate with business and technical teams to define and review rules. Responsibilities: * Ensure development best practices: Guarantee that all data development practices comply with quality and efficiency standards. * Optimize data usage: Maximize the value derived from available data. * Support refinement activities: Collaborate with teams to refine user stories and requirements, ensuring clarity and feasibility. * Support user story creation: Assist in drafting clear, well-defined user stories to facilitate data engineers’ work. * Support AS\-IS and TO\-BE design: Participate in documenting current and future processes, identifying technical debt and improvement opportunities. * Develop refined stories: Implement approved, refined user stories while ensuring code quality and efficiency. * Build data products: Develop and maintain cloud-based Big Data products using Databricks, ensuring scalability and performance. * Collaborate with data and business stakeholders: Work closely with data and business focal points to ensure developed solutions align with industry best practices and business needs. Required Qualifications: Technical Skills: * Databricks with PySpark * Experience with CI/CD pipelines – GitHub/GitHub Actions * Near-Real-Time (NRT) data processing (Kafka) * Productionalization of models built on Databricks (MLOps) * Experience with Agile methodologies * Strong knowledge of Spark, Python, and programming logic is essential!!! Behavioral Traits: * Proactivity (enhancing team delivery capacity) * Analytical ability (ability to analyze data sets) * Problem-solving (identify and propose solutions) * Consultant mindset (e.g., proactively bring ideas and solutions to project tasks rather than wait for direction) * 360-degree perspective (e.g., understand the project holistically, recognizing how a point solution may impact the broader project) * Assertive communication (clear, confident, and respectful) **Our benefits:** * Health and dental insurance; * Meal and food allowance; * Childcare assistance; * Extended parental leave; * Partnerships with gyms and health/wellness professionals via Wellhub (Gympass) TotalPass; * Profit and Results Sharing Program (PRP); * Life insurance; * Continuous learning platform (CI\&T University); * Discount club; * Free online platform dedicated to promoting physical health, mental well-being, and overall wellness; * Pregnancy and responsible parenting course; * Partnerships with online learning platforms; * Language learning platform; * And many more More details about our benefits here: https://ciandt.com/br/pt\-br/carreiras At CI\&T, inclusion begins at first contact. If you are a person with a disability, it is important to **submit your medical report during the selection process.** *Check which information must be included in the report* *by clicking here.* This ensures we provide the appropriate support and accommodations you deserve. **If you do not yet have an official medical report, don’t worry: we can support you in obtaining one.** We have a dedicated Health and Well-being team, inclusion specialists, and affinity groups ready to support you at every stage. Count on us to walk this journey alongside you.