Mid-Level Data Engineer

Description

Job Summary: We are seeking a hands-on Senior Data Engineer to modernize our data orchestration from Airflow to Prefect and mature our dbt usage, with a focus on efficiency and scalability of transformations. Key Highlights: 1. Drive the modernization of data orchestration and dbt maturity. 2. Refactor and evolve dbt projects using best practices and data quality principles. 3. Migrate Airflow pipelines to Prefect and optimize BigQuery. **Let’s pursue the extraordinary together?** Our Data Lakehouse on Google Cloud is already a reality. The next step in our evolution is improving the efficiency and scalability of data transformations. We are looking for a Senior Data Engineer with a hands\-on profile to work across two main areas: Modern Orchestration: Migrate our Airflow workflows to Prefect, ensuring modern observability and failure handling. dbt Maturity: Elevate the level of our dbt project. We don’t just want to run SQL—we want to fully leverage the tool’s capabilities (Macros, Jinja, Automated Testing, Documentation, and CI/CD). **Our Principles** * We communicate person-to-person. * We pursue the extraordinary. * We bring innovation to life. * We strengthen ourselves through transparency. **Responsibilities and Duties** **Your Role Will Include:** * Analytics Engineering (dbt): Refactor and evolve the dbt project, implementing best practices such as reusable macros (Jinja), efficient incremental materializations, and lineage documentation. * Data Quality: Implement automated tests (dbt tests / packages) to ensure data reliability at the source, preventing bad data from reaching dashboards. * Modern Orchestration: Technically migrate Airflow pipelines to Prefect, integrating dbt model execution into resilient workflows. * BigQuery Optimization: Tune queries and data models to reduce processing costs (FinOps) and improve delivery performance. * Maintenance and CI/CD: Maintain automated data deployment pipelines, ensuring changes to dbt or Prefect undergo validation before production. **Requirements and Qualifications** **What We Expect From You:** * Proficiency in dbt (Core or Cloud): Proven experience beyond basic usage. You must deeply understand materialization strategies (incremental, view, ephemeral), snapshots, seeds, and testing. * Google Cloud Platform (BigQuery): Proficiency in BigQuery SQL (Partitioning, Clustering, Nested Fields). * Solid Python: Ability to write clean, modular scripts—essential for working with Prefect. * Orchestration: Experience with Airflow (to understand legacy systems) and willingness/experience working with Prefect. * Git and Version Control: Collaborative workflow (Pull Requests, Code Review) is mandatory. **You’ll Stand Out If You Have:** * Experience implementing dbt Slim CI (optimized Continuous Integration). * Advanced knowledge of Jinja templating. * Experience migrating Airflow workflows to Prefect. * Knowledge of "Data Observability" tools. * Knowledge of Big Data and parallelism solutions. * Knowledge of real\-time processing. * Familiarity with cloud infrastructure solutions (Kubernetes, Cloud Run, Cloud Functions). * Experience with GCP-based data stacks. **Additional Information** **At Franq, You Will:** * Work alongside experienced and renowned professionals from the financial services industry; * Develop, evolve, and learn skills using best practices and cutting-edge technologies; * Contribute to an innovative project that impacts customers’ financial lives and creates new ways of doing business. **We Offer:** * CLT employment contract; * Flexible benefits card (Caju) worth R$ 1\.033,50; * Comprehensive medical and dental insurance (Bradesco plan), fully covered by the company, with no co-payment; * Life insurance; * Partnership with Wellhub (Gympass); * Partnerships with Psicologia Viva and Conexa Saúde; * Birthday day off; * Fresh fruit station for Franqers in office-based mode. **Diversity and Inclusion at Franq!** At Franq, you have space to be authentically yourself—you belong here! We value you regardless of race, color, religion, gender identity, nationality, disability, sexual orientation, ancestry, or age. All our job openings are open to candidates with disabilities—if this applies to you, please specify it in your application and include the corresponding CID code. **JOIN US IN PURSUING THE EXTRAORDINARY** Become a Franqer! \#GoFranq