Description
We are specialists in **technological transformation**, combining human expertise with AI to create scalable tech solutions. With more than 8,000 CI\&Ters worldwide, we have already formed partnerships with over 1,000 clients throughout our 30-year history. Artificial Intelligence is our reality. **Important**: If you reside in the Metropolitan Region of Campinas, your presence at our city offices is mandatory, in accordance with the current attendance policy.
We are seeking a Data Engineer to join our team and contribute to building scalable and intelligent solutions for large volumes of data.
If you are passionate about data, have solid experience with AWS and data modeling, enjoy solving complex problems, and collaborating with multidisciplinary teams, this opportunity is for you!
**Responsibilities:**
* Develop and evolve data ingestion applications using AWS tools, both in serverless architecture (Glue, Lambda, SNS, SQS, Kafka, etc.) and architectures using ECS;
* Understand technical requirements by participating in inceptions and refinements;
* Write and structure automated tests to ensure deliverable quality;
* Perform code reviews and deploy to production;
* Incident management;
* Optimize data jobs and pipelines, addressing data partitioning, data skew balancing, and performance tuning;
* Design and maintain pipeline orchestrations using AWS Step Functions and AWS EventBridge;
* Configure and monitor observability;
* Focus on FinOps, ensuring efficient cloud resource usage and identifying cost-optimization opportunities in data solutions.
**Requirements for this challenge:**
* Use of generative AI, agents, and skills to accelerate work;
* Solid Python knowledge and hands-on experience with PySpark;
* Cloud experience with AWS (S3, Glue, EC2, Lambda, Athena);
* Automation of unit tests;
* Relational database knowledge;
* Development of automated tests using the test pyramid strategy;
* Technical refinement of user stories and solutions;
* Code quality and programming best practices;
* Communication to ensure alignment with the team and stakeholders;
* Execution capability and proactivity;
* Cloud cost optimization and FinOps best practices applied to data pipelines.
**Nice-to-have:**
* Use of generative AI, agents, and skills to accelerate work;
* LocalStack with AWS resources (infrastructure as code);
* Serverless architecture;
* Datadog;
* Messaging systems (Kafka, SQS, SNS);
\#LI\-DR3
**Our benefits:*** Health and dental insurance;
* Meal and food allowance;
* Childcare assistance;
* Extended parental leave;
* Partnerships with gyms and health and wellness professionals via Wellhub (Gympass) TotalPass;
* Profit and Results Sharing Program (PLR);
* Life insurance;
* Continuous learning platform (CI\&T University);
* Discount club;
* Free online platform dedicated to promoting physical, mental, and overall well-being;
* Pregnancy and responsible parenting course;
* Partnerships with online course platforms;
* Language learning platform;
* And many more
More details about our benefits here: https://ciandt.com/br/pt\-br/carreiras
At CI\&T, inclusion starts from the first contact. If you are a person with disabilities, it is important to **submit your medical report during the selection process.** *Check which information must be included in the report* *by clicking here.* This way, we can guarantee the support and accommodations you deserve. **If you do not yet have the qualifying medical report, don’t worry: we can support you in obtaining it.**
We have a dedicated Health and Wellness team, inclusion specialists, and affinity groups who will support you at every stage. Count on us to walk this journey alongside you.