Data Engineer

Description

Job Summary: You will be responsible for designing, developing, and maintaining high-performance data pipelines, ensuring quality, governance, and scalability to enable advanced analytics and strategic decision-making. Key Highlights: 1. Designing and evolving modern data architectures 2. Ensuring data quality, integrity, and security 3. Collaborating with BI, data science, and engineering teams Description: You will be responsible for designing, developing, and maintaining high-performance data pipelines, ensuring quality, governance, and scalability. You will contribute to building and evolving modern data architectures, integrating multiple data sources, and enabling advanced analytics, artificial intelligence, and strategic decision-making. Responsibilities and Duties * Develop and maintain data ingestion, transformation, and integration pipelines (ETL/ELT). * Implement scalable architectures for Data Lakes, Data Warehouses, and analytical systems. * Optimize queries, models, and storage for large-scale data volumes. * Ensure data quality, integrity, and security in compliance with LGPD. * Automate data collection, processing, and loading processes. * Monitor data flows and resolve any failures. * Collaborate with BI, data science, and engineering teams to integrate solutions. Requirements and Qualifications * Bachelor's degree in Computer Science, Software Engineering, Information Systems, or related fields. * Advanced English proficiency. * Solid experience with Python and SQL. * Knowledge of relational databases (MySQL, PostgreSQL, SQL Server) and non-relational databases (MongoDB, OpenSearch). * Experience with ETL/ELT tools (Apache Airflow, dbt, Talend) and Data Lake / Data Warehouse architectures. * Experience with the AWS ecosystem, including ElastiCache (Redis) and RabbitMQ. * Knowledge of CI/CD for data pipelines. * Experience with distributed processing (Spark, Flink, Kafka). 2512100202181771742