Data Engineer (Mid-level)

Description

Job Summary: We are seeking a Data Engineer to develop and maintain ELT pipelines, optimize data, and integrate diverse data sources, ensuring data quality and traceability. Key Highlights: 1. Develop and maintain ELT pipelines using Python and Apache Airflow 2. Optimize queries and data structures in BigQuery for performance 3. Integrate data from multiple sources and ensure data quality in production Description: * Bachelor's degree in Computer Engineering/Software Engineering, Computer Science, Information Systems, or related fields; * Prior experience as a Data Engineer or in a similar role; * Solid knowledge of Python for data processing and transformation; * Advanced SQL: complex queries, optimization, and window functions; * Experience with Apache Airflow (or equivalent orchestration tools); * Familiarity with Google Cloud Platform, preferably BigQuery and Cloud Storage; * Understanding of data architecture and Data Lake modeling. Preferred Qualifications * Advanced SQL expertise in query optimization, execution plans, and performance analysis in BigQuery; * Experience with on-premises data extraction — having worked on integrating data from servers installed on the client's technical infrastructure; * Experience with Cloud Composer (GCP orchestration); * Knowledge of Looker Studio or other visualization tools; * Prior experience in consulting projects or projects involving multiple stakeholders. * Develop and maintain data extraction, transformation, and loading (ELT) pipelines using Python and Apache Airflow. * Optimize queries and data structures in BigQuery, ensuring performance and efficiency. * Automate recurring data workflows and reduce repetitive operational effort. * Integrate data from multiple sources, including on-premises environments, into the cloud-based Data Lake. * Ensure data quality, consistency, and traceability in production. * Document architecture, standards, and procedures to support continuous platform evolution. 2512120202501916275