Description
At CI\&T, we help major enterprises transform the potential of AI into real business impact through AI Deployment, AI-native execution, and tech-integrated business solutions.
With 30 years of experience in technological transformation, we accelerate innovation with expertise in agentic SDLC, application modernization, Data \& AI, martech, and business strategy.
We are 8\.000 CI\&Ters across more than 25 countries, collaborating to build solutions with real impact. AI is already part of how we work, evolve, and innovate every day.
**Important**: If you reside in the Metropolitan Region of Campinas, your physical presence at our city offices is mandatory, per our current attendance policy.
We are seeking a Data Engineer focused on integration and modeling to build and evolve our data lake and analytical layers. This is not a role oriented toward "big data"/massive streaming, but rather toward robust integrations, stable transformation pipelines, and organization of market data (historical and distribution) with strong governance and quality.
Key responsibilities:
Design, implement, and maintain end-to-end data pipelines (ELT/ETL), emphasizing reliability, reprocessing, and cost-efficiency.
Orchestrate data loads and routines using Airflow (AWS) and serverless functions (AWS Lambda); support deployments on EKS when required.
Model data in Snowflake (bronze/silver/gold layers) and develop transformations in dbt (macros, tests, docs).
Build integrations and services in Python using FastAPI to expose/consume data and automate processes.
Ingest, normalize, and version market data, with emphasis on historical and distribution (batch; minimal streaming).
Write high-performance SQL (tuning, partitioning/clustering in Snowflake and Postgres).
Use Pandas for ad-hoc data processing, validation, and prototyping of transformations.
Ensure quality (dbt tests, data checks), observability (logs/metrics/alerts), security (access control, masking), and documentation.
Collaborate with business, analytics, and product teams to define SLAs, data contracts, and governance standards.
Required qualifications:
Solid SQL experience (query optimization, relational and analytical modeling).
Practical experience with Snowflake (warehousing, roles, tasks, performance, costs) and dbt (models, tests, sources, exposures).
Experience building data pipelines in Airflow (DAGs, sensors, retries, SLA) and AWS Lambda.
Knowledge of Postgres (ingestion, basic replication/CDC or maintenance, routines).
Hands-on experience with Python for data (Pandas) and API development with FastAPI.
Practical experience with batch-oriented ELT/ETL, Git versioning, and CI/CD (secure deployment of pipelines/dbt models).
Understanding of data security and governance (access control, lineage, documentation, sensitive data handling).
Technical English for reading documentation.
Nice-to-have differentiators:
Experience with EKS/Kubernetes for data workloads.
Integration of market data sources (providers, formats, rate limits, historical data, calendars).
Monitoring/observability (Prometheus/Grafana/CloudWatch), data quality beyond dbt (Great Expectations, Soda).
Data contract standards (Pydantic/JSONSchema) and data contract practices.
Snowflake performance (micro-partitioning, clustering, warehouses, query profiling).
Cost management and FinOps for data on AWS/Snowflake.
Experience with CDC (Debezium, DMS) and messaging (SQS, SNS; Kafka only if required).
Tech stack and environment
Data platform: Snowflake, dbt
Orchestration and Cloud: Airflow (AWS), AWS Lambda, EKS (when applicable)
Languages and libraries: Python, Pandas, FastAPI
Databases: Postgres, Snowflake
DevOps: Git, CI/CD (GitHub Actions/GitLab CI/CodeBuild), IaC (CloudFormation/Terraform is a plus)
Observability: CloudWatch, (Grafana/Prometheus as a plus)
**Our benefits:**
* Health and dental insurance;
* Meal and food allowance;
* Childcare assistance;
* Extended parental leave;
* Partnerships with gyms and health/wellness professionals via Wellhub (Gympass, TotalPass);
* Profit Sharing Program (PLR);
* Life insurance;
* Continuous learning platform (CI\&T University);
* Discount club;
* Free online platform dedicated to promoting physical health, mental well-being, and overall wellness;
* Pregnancy and responsible parenting course;
* Partnerships with online learning platforms;
* Language learning platform;
* And many more
More details about our benefits here: https://ciandt.com/br/pt\-br/carreiras
At CI\&T, inclusion begins at first contact. If you are a person with a disability, it is important **to submit your medical report during the selection process.** *Check which information must be included in the report* *by clicking here.* This ensures we provide the appropriate support and accommodations you deserve. **If you do not yet have the official characterization report, don’t worry: we can support you in obtaining it.**
We have a dedicated Health and Wellness team, inclusion specialists, and affinity groups that will support you throughout every stage. Count on us to walk this journey alongside you.