Description
At CI\&T, we help large enterprises transform the potential of AI into real business impact through AI Deployment, AI-native execution, and tech-integrated business solutions.
With 30 years of experience in technological transformation, we accelerate innovation with expertise in agentic SDLC, application modernization, Data \& AI, martech, and business strategy.
We are 8,000 CI\&Ters across more than 25 countries, collaborating to build solutions with real impact. AI is already part of how we work, evolve, and innovate every day.
**Important**: If you reside in the Metropolitan Region of Campinas, your presence at our city offices is mandatory, per our current attendance policy.
We are seeking a Senior Data Engineer for a strategic project. You will be responsible for building and maintaining data pipelines, developing large-scale data processing routines, and supporting the evolution of the data platform using modern distributed processing technologies and cloud environments.
**Responsibilities:**
* Design, develop, and maintain data pipelines for:
* Ingestion of data from multiple sources.
* Large-scale data processing and transformation.
* Integration between corporate systems and analytical platforms.
* Making data available for consumption by business and technology teams.
* Development in Databricks and PySpark
* Building and maintaining solutions using: Databricks, Python, PySpark, SQL.
* Ensuring performance, quality, and scalability of data processes.
* Performing queries, integrations, and data manipulation in relational and non-relational environments, including: SQL, MongoDB.
* Participating in data modeling, data treatment, and data delivery for various data consumers.
* Monitoring data pipelines and processes.
* Identifying and resolving operational failures.
* Implementing performance improvements.
* Supporting the evolution of data engineering architecture and processes.
**Technical Requirements:**
* Solid experience as a Data Engineer, Senior Data Engineer, or equivalent role.
* Strong knowledge of Python for data engineering, automation, data analysis, and support of AI solutions.
* Solid knowledge of SQL and structured data exploration.
* Solid knowledge of MongoDB.
* Experience with Databricks, PySpark, and Spark.
* Experience building, optimizing, and sustaining scalable data pipelines.
* Experience in cloud environments, preferably Azure Databricks.
* Experience with near real-time data processing, preferably using Kafka.
* Experience productizing Machine Learning models on Databricks and MLOps practices.
* Experience with CI/CD pipelines, especially GitHub and GitHub Actions.
* Proficiency in data engineering best practices, version control, testing, code review, and data quality.
**Nice-to-Have:**
* MongoDB.
* Data Modeling.
* Building ETL/ELT pipelines.
* Concepts of Data Lake and distributed processing.
* Cloud environments.
* Experience in regulated environments.
* Experience using AI in development, such as GitHub Copilot, prompt engineering, and automated code review.
\#LI\-DR3
**Our Benefits:**
* Health and dental insurance;
* Meal and food allowance;
* Childcare assistance;
* Extended parental leave;
* Partnerships with gyms and health and wellness professionals via Wellhub (Gympass) TotalPass;
* Profit Sharing Program (PLR);
* Life insurance;
* Continuous learning platform (CI\&T University);
* Discount club;
* Free online platform dedicated to promoting physical, mental, and overall well-being;
* Pregnancy and responsible parenting course;
* Partnerships with online learning platforms;
* Language learning platform;
* And many more
More details about our benefits here: https://ciandt.com/br/pt\-br/carreiras
At CI\&T, inclusion begins at first contact. If you are a person with a disability, it is important to **submit your medical report during the selection process.** *Check which information must be included in the report* *by clicking here.* This way, we can ensure the support and accommodations you deserve. **If you do not yet have the official medical report, don’t worry: we can support you in obtaining it.**
We have a dedicated Health and Wellness team, inclusion specialists, and affinity groups who will support you at every stage. Count on us to walk this journey alongside you.