Senior Data Engineer

Description

Job Summary: We are looking for a professional to develop and automate data ingestion and transformation pipelines, ensuring data integration and control in analytical environments. Key Highlights: 1. Development of data ingestion and transformation pipelines 2. Working with transactional and analytical databases 3. Automation and control of data pipelines **We are seeking someone who dares to take the lead with us.** **Responsibilities and duties:** Develop data ingestion pipelines from source systems to the raw/trusted layers of the data lake; Develop data transformation pipelines to meet business requirements; Develop batch and streaming (NRT) pipelines; Automate pipelines for automatic execution according to business requirements; Create controls for pipeline re-execution/resumption in case of errors. **Requirements and qualifications:** Transactional databases (Oracle, Sybase, SQL Server, MySQL); Analytical databases (GCP BigQuery); DBT\-\> Data/systems integration; GCP Dataflow (Apache Beam); GCP Composer (Apache Airflow); Cloud GCP knowledge;\-\> Data storage (Google Cloud Storage). **Desirable:** **Additional information:** * For your health, we offer **medical and dental assistance** with no co-payment for exams and consultations. * Want more well-being? We offer **Gympass** and **Zenklub** (with two free sessions per month) to support your physical and mental health. * When hunger strikes, use our meal benefit **Caju** to shop at any supermarket or restaurant. * Love traveling? Here, we have **Férias \& Co**, a benefit that helps make your dream vacation possible. * Have children? Count on our **childcare allowance**. * Growing family? We offer **MomCare**, a flexible monetary incentive after maternity leave for new Datunian mothers. * To personalize your workspace, rely on our **home office allowance**. * Want to invest in your professional development? We partner with several renowned educational institutions to offer you discounts of up to 70% on **undergraduate**, **postgraduate**, **MBA**, **language**, and many other courses! **To learn about all our benefits, visit the homepage of our careers page.**