Browse
···
Log in / Register
Job Summary: We are seeking a Data Engineer passionate about data, with solid experience in Python, AWS, and data modeling, to build scalable and intelligent solutions. Key Highlights: 1. Experience in financial industry projects 2. Focus on building scalable and intelligent solutions 3. Collaboration with multidisciplinary teams We are specialists in **technological transformation**, combining human expertise with AI to create scalable tech solutions. With over 8,000 CI\&Ters worldwide, we have partnered with more than 1,000 clients throughout our 30-year history. Artificial Intelligence is our reality. **Important**: If you reside in the Campinas Metropolitan Region, your physical presence at our city offices is mandatory, per our current attendance policy. Hello, this is Wal from CI\&T! I am part of the Talent Attraction team and am looking for professionals located in Brazil for the position of **Senior Data Developer (Python, AWS)**, who will work on a financial industry project. We are looking for a Data Engineer to join our team and contribute to building scalable and intelligent solutions for large-scale data volumes. If you are passionate about data, have solid experience with Python, AWS, and data modeling, enjoy solving complex problems, and collaborating with multidisciplinary teams, this role is for you! **Responsibilities:*** Understand technical requirements, refine tasks, and estimate timelines for deliverables. * Develop and evolve data ingestion applications within the AWS environment. * Build automated tests to ensure deliverable quality. * Apply software development best practices: design, naming conventions, test coverage, requirement fulfillment, and optimization. * Manage incidents. * Participate in agile ceremonies such as daily stand-ups, planning, demos, and retrospectives. **You must have experience with:*** Version control best practices (Git, GitHub) * SQL experience for query construction, manipulation, and optimization. * Python experience for ETL/ELT using libraries such as NumPy and Pandas. * PySpark experience for ETL/ELT. * Desired knowledge of Partitioning, Lazy Evaluation, Caching, and UDFs using PySpark. * CI/CD tool experience. * Experience with relational and non-relational databases. * Knowledge of dimensional data modeling. * Knowledge of data governance and data quality. * Knowledge and best practices for unit testing using Unittest and Pytest frameworks in Python. * Knowledge of Infrastructure as Code (IaC) using Terraform. * AWS experience and familiarity with the following services: Required:* Access management: IAM. * Storage: S3\. * Compute and processing: Glue. Desirable:* Storage: RDS and DynamoDB. * Data governance: Lake Formation. * Compute and processing: Lambda and EC2\. * Orchestration and scheduling: Step Functions and EventBridge. * Query and analysis: AWS Athena. \#LI\-WC2 **Our Benefits:*** Health and dental insurance; * Meal and food allowance; * Childcare assistance; * Extended parental leave; * Partnerships with gyms and health & wellness professionals via Wellhub (Gympass) TotalPass; * Profit and Results Sharing Program (PLR); * Life insurance; * Continuous learning platform (CI\&T University); * Discount club; * Free online platform dedicated to promoting physical, mental, and overall well-being; * Pregnancy and responsible parenting course; * Partnerships with online course platforms; * Language learning platform; * And many more More details about our benefits here: https://ciandt.com/br/pt\-br/carreiras At CI\&T, inclusion begins at first contact. If you are a person with a disability, it is important to **submit your medical report during the selection process.** *Check which information must be included in the report* *by clicking here.* This way, we can ensure the support and accommodations you deserve. **If you do not yet have the qualifying medical report, don’t worry: we can support you in obtaining it.** We have a dedicated Health and Wellness team, inclusion specialists, and affinity groups that will support you at every stage. Count on us to walk this journey alongside you.
