We are specialists in **technological transformation**, combining human expertise with AI to build scalable tech solutions. With more than 8,000 CI\&Ters worldwide, we have already partnered with over 1,000 clients throughout our 30-year history. Artificial Intelligence is our reality. **Important**: If you reside in the Campinas Metropolitan Region, your presence at our city offices is mandatory, per our current attendance policy. We are looking for a Senior Data Engineer to work on a project focused on data integration, processing, modeling, and optimization, with heavy use of Databricks, PySpark, and MongoDB. The candidate must be hands\-on, technically autonomous, critically minded, and focused on productivity, quality, performance, and continuous improvement. They will work within agile squads, collaborating with technical and business teams to define, refine, develop, and sustain scalable data solutions. Key technologies and competencies involved include: * Databricks with PySpark * Spark and Python * MongoDB * Modeling and manipulation of structured and semi\-structured data * Building and optimizing data pipelines * Integration between relational, non\-relational, and analytical environments * Best practices in engineering, versioning, and data quality * Experience with agile methodologies * Advantage: experience using AI in development, such as GitHub Copilot, prompt engineering, and automated code review The candidate must possess solid knowledge in data engineering, programming logic, development of scalable pipelines, performance optimization, and software development best practices, while also collaborating with business and technology areas to define, review, and implement data rules and solutions. Responsibilities: * Develop, optimize, and maintain data pipelines using Databricks, Spark, and PySpark. * Perform integration, extraction, transformation, and loading (ETL) of data from MongoDB databases. * Work with structured, semi\-structured, and JSON document data, ensuring information organization, quality, and consistency. * Develop ingestion, transformation, and data publication processes for analytical and operational consumption. * Build scalable data products, focusing on performance, reliability, and quality. * Ensure development best practices, guaranteeing that data solutions adhere to standards of quality, efficiency, scalability, and maintainability. * Apply best practices in versioning, testing, code review, and data quality. * Support technical and functional refinements, ensuring clarity, feasibility, and alignment of user stories with project needs. * Support the creation of well\-defined user stories, facilitating development by data engineering teams. * Participate in AS\-IS and TO\-BE design, documenting current and future processes, identifying technical debt, risks, and improvement opportunities. * Develop refined and approved user stories, ensuring quality, efficiency, and adherence to technical standards. * Collaborate with data, business, and technology stakeholders to ensure solutions align with business needs and engineering best practices. * Propose continuous improvements to processes, architecture, performance, and team productivity. * Use AI tools in development where applicable—such as GitHub Copilot, prompt engineering, and automated code review—to enhance productivity and quality. Required Qualifications: Technical Knowledge: * Strong experience with Databricks and PySpark. * Solid knowledge of Spark, Python, and programming logic. * Experience with MongoDB, including queries, document modeling, and JSON data manipulation. * Experience building scalable and high\-performance data pipelines. * Knowledge of data integration between MongoDB and analytical environments. * Ability to work with structured, semi\-structured, and non\-relational data. * Mastery of data engineering best practices, versioning, testing, code review, and data quality. * Experience optimizing pipeline performance and distributed processing. * Experience working in agile squads and applying agile methodologies. * Ability to identify technical debt, improve processes, and evolve existing solutions. * Advantage: experience applying AI to development, such as GitHub Copilot, prompt engineering, and automated code review. Behavioral Attributes: * Proactivity to increase team delivery capacity. * Hands\-on profile with autonomy to lead technical activities. * Analytical ability to interpret databases, business rules, and propose solutions. * Problem\-solving skills to identify root causes, risks, and alternatives. * Consulting mindset—bringing ideas, solutions, and improvements to the project without waiting solely for direction. * 360\-degree vision—understanding the project holistically and assessing technical and business impacts of proposed solutions. * Assertive communication—clear, confident, and respectful. * Critical thinking, focus on productivity, and continuous improvement. * Ability to collaborate with technical teams, business areas, and stakeholders. **Our Benefits:*** Health and dental insurance; * Meal and food allowance; * Childcare assistance; * Extended parental leave; * Partnerships with gyms and health and wellness professionals via Wellhub (Gympass) TotalPass; * Profit and Results Sharing Program (PLR); * Life insurance; * Continuous learning platform (CI\&T University); * Discount club; * Free online platform dedicated to promoting physical health, mental health, and overall well\-being; * Pregnancy and responsible parenting course; * Partnerships with online course platforms; * Language learning platform; * And many more More details about our benefits here: https://ciandt.com/br/pt\-br/carreiras At CI\&T, inclusion begins at first contact. If you are a person with disability, it is important to **submit your medical report during the selection process.** *Check which information must be included in the report* *by clicking here.* This way, we can ensure the support and accommodations you deserve. **If you do not yet have the qualifying medical report, don’t worry—we can support you in obtaining it.** We have a dedicated Health and Wellness team, experts in inclusion and affinity groups, who will support you at every stage. Count on us to walk this journey alongside you.
João Silva
Indeed · HR
João Silva
Indeed · HR
