DATA ENGINEERING

Description

Job Summary: We are seeking a Data Engineer to build and evolve our data platform, playing a key role in sustaining a modern, scalable, and governed environment. Key Highlights: 1. Construction and evolution of a modern, scalable data platform 2. Development of data ingestion processes and reusable modules 3. Implementation of security, governance, and observability for the architecture **Job Description:** We are seeking a Data Engineer to build and evolve our data platform, serving as a\-key contributor to sustaining a modern, scalable, and governed environment. This professional will be responsible for ensuring reliable data ingestion, security, governance, and observability across the entire architecture, as well as developing standards, tools, and reusable components to support the Analytics team. **Day-to-day responsibilities include:** Developing and maintaining data ingestion processes (batch and streaming), integrating diverse sources (relational databases, APIs, files, and cloud environments) into the Bronze layer Cataloging and documenting data sources and destinations under their responsibility (Landing Zone and Bronze) Supporting and evolving the data platform (Databricks, ADLS, ADF), proposing continuous improvements and new technologies **Creating reusable modules to scale the team (e.g.:** dbt macros, Python libraries, connectors) Administering and ensuring platform security (Unity Catalog, Entra ID, Key Vault) Configuring and maintaining development and production environments Implementing and evolving CI/CD pipelines and automations Ensuring architecture performance, cost control, and scalability Addressing vulnerabilities and supporting technical audits Providing technical support to the Analytics team, fostering continuous upskilling and growth Contributing to technical documentation, processes, and the team’s knowledge base **Requirements:** Education and Experience Currently pursuing or completed undergraduate degree in fields such as Systems Analysis and Development, Computer Engineering, Information Systems, or related disciplines 1–2 years of experience in Data Engineering or related areas Technical Skills Python and SQL Data processing with Spark dbt for data transformation Shell Script Code versioning (Git) and CI/CD practices Experience with data platforms (Databricks, Snowflake, or BigQuery) Experience with ACID tables (Delta Lake, Iceberg, or Hudi) Experience with data ingestion and streaming (Kafka, RabbitMQ, CDC, Debezium, etc.) Experience in cloud environments (Azure, AWS, or GCP) Knowledge of modern data architectures (Lakehouse, Data Mesh, Data Fabric, etc.) Preferred Qualifications Knowledge of data governance and information security Experience optimizing cloud costs Experience in regulated environments or those with strict governance (LGPD, audits, etc.) Behavioral Competencies Analytical thinking and quality focus Proactivity and ownership mindset Strong communication and teamwork skills Organization and discipline Adaptability and continuous learning ability