Data Engineer - Santana de Parnaíba

Description

Job Summary: We are seeking a Data Engineer to build and optimize solutions that connect information, systems, and strategic decisions at a national scale. Key Highlights: 1. Build, maintain, and optimize data pipelines (ETL/ELT) 2. Ensure data quality, security, and governance 3. Work with Big Data and high-impact digital transformation projects We seek a Data Engineer to join our technology team and contribute to building solutions that connect information, systems, and strategic decisions at a national scale. This role is based in Santana de Parnaíba/SP. **Responsibilities:** * Build, maintain, and optimize data pipelines (ETL/ELT); * Process and transform large volumes of structured and semi-structured data; * Ensure data quality, security, and governance; * Integrate multiple systems and public and private databases; * Automate processes and support Analytics, BI, and Development teams. **Requirements:** * Proficiency in Python (pandas, pySpark, SQLAlchemy) and advanced SQL; * Experience with databases (PostgreSQL, MySQL, SQL Server); * Familiarity with Airflow, dbt, Luigi, or similar tools; * Basic knowledge of Data Lake / Data Warehouse and Docker; * Experience with Git version control and Linux environments. **Preferred Qualifications:** * Experience with system integration (REST APIs, Webhooks, SaaS, etc.); * Knowledge of cloud platforms (AWS, GCP, Azure); * Understanding of the public sector data ecosystem, including fiscal, educational, or socioeconomic data; * Interest in working with Big Data and digital transformation projects impacting millions of citizens.