Data Engineer (Mid-level)

Description

Job Summary: We are seeking a Data Engineer to join our team responsible for evolving a Data Lakehouse platform on AWS, playing a key role in data integration and pipeline orchestration. Key Highlights: 1. Work on the evolution of the Data Lakehouse platform on AWS 2. Design and implement reliable data pipelines 3. Model data layers and optimize analytical models Description: Technical Requirements: * Solid experience with AWS: S3, Glue Data Catalog, Airflow (preferably MWAA), Python DAGs, Amazon Redshift. * Programming languages: Advanced Python and SQL. * Power BI: semantic modeling, DAX, incremental refresh, gateway, best practices for consuming Redshift. * Knowledge of Data Lakehouse architecture, columnar formats (Parquet), partitioning, and metadata. * Engineering best practices: Git, testing, code reviews, documentation, reliable pipelines. * Security and governance: IAM, encryption, principle of least privilege, LGPD applied to data. We are seeking a Data Engineer to join our team responsible for evolving a Data Lakehouse platform on AWS. This person will play a pivotal role in integrating data from multiple sources, orchestrating reliable pipelines, and delivering high-performance analytical layers for consumption via Amazon Redshift and Power BI. Key Responsibilities * Design and implement data pipelines using Airflow/MWAA with Python and SQL, following best practices for modularity, testing, and versioning. * Model Bronze/Silver/Gold layers (Medallion architecture) in S3 \+ Glue Data Catalog, defining partitions, formats (Parquet/Delta\*), and tables optimized for querying. * Build and optimize analytical models in Amazon Redshift, ensuring performance and cost efficiency. * Publish and maintain reliable datasets for Power BI, including gateways, incremental refresh, aggregations, and efficient use of DirectQuery/Import. * Collaborate with analysts and business teams, translating requirements into consumable datasets, KPIs, and data layers, while documenting data catalogs and data contracts. 2512200202551138868