Mid-Level Data Engineer

Description

Job Summary: We are seeking a hands-on Senior Data Engineer to modernize our data orchestration from Airflow to Prefect and mature our dbt usage with industry best practices. Key Highlights: 1. Work on an innovative project with real financial impact 2. Develop and enhance skills using new technologies 3. Team of experienced and renowned professionals **Shall we pursue the extraordinary together?** Our Data Lakehouse on Google Cloud is already a reality. The next step in our evolution is improving the efficiency and scalability of data transformations. We are looking for a Senior Data Engineer with a hands\-on profile to focus on two main areas: Orchestration Modernization: Migrate our Airflow workflows to Prefect, ensuring modern observability and failure handling. dbt Maturity: Elevate the maturity of our dbt project. We don’t just want to run SQL—we want to fully leverage the tool’s capabilities (Macros, Jinja, Automated Testing, Documentation, and CI/CD). **Our Principles** * Communicate person-to-person * Pursue the extraordinary * Bring innovation to life * Strengthen ourselves through transparency **Responsibilities and Duties** **Your Role Will Include:** * Analytics Engineering (dbt): Refactor and evolve the dbt project, implementing best practices such as reusable macros (Jinja), efficient incremental materializations, and lineage documentation. * Data Quality: Implement automated tests (dbt tests / packages) to ensure data reliability at the source, preventing bad data from reaching dashboards. * Modern Orchestration: Technically migrate Airflow pipelines to Prefect, integrating dbt model execution into resilient workflows. * BigQuery Optimization: Tune queries and data models to reduce processing costs (FinOps) and improve delivery performance. * Maintenance and CI/CD: Maintain automated data deployment pipelines, ensuring that changes to dbt or Prefect undergo validation before production. **Requirements and Qualifications** **What We Expect From You:** * Proficiency in dbt (Core or Cloud): Proven experience beyond basic usage. You must deeply understand materialization strategies (incremental, view, ephemeral), snapshots, seeds, and testing. * Google Cloud Platform (BigQuery): Proficiency in BigQuery SQL (Partitioning, Clustering, Nested Fields). * Solid Python: Ability to write clean, modular scripts—essential for working with Prefect. * Orchestration: Experience with Airflow (to understand legacy systems) and desire/experience working with Prefect. * Git and Version Control: Collaborative workflow (Pull Requests, Code Review) is mandatory. **You’ll Stand Out If You Have:** * Experience implementing dbt Slim CI (optimized Continuous Integration). * Advanced knowledge of Jinja Templating. * Experience migrating Airflow workflows to Prefect. * Knowledge of "Data Observability" tools. * Knowledge of Big Data and parallelism solutions. * Knowledge of real\-time processing. * Familiarity with cloud infrastructure solutions (Kubernetes, Cloud Run, Cloud Functions). * Experience with GCP-based data stacks. **Additional Information** **At Franq, You Will:** * Work alongside experienced and renowned professionals from the financial industry; * Develop, evolve, and learn skills using best practices and cutting-edge technologies; * Participate in an innovative project that impacts customers’ financial lives and creates new ways of doing business. **We Offer:** * CLT employment contract; * Flexible benefits card (Caju) worth R$ 1\.033,50; * Comprehensive medical and dental insurance (Bradesco plan), fully covered by the company, with no co-payment; * Life insurance; * Partnership with Wellhub (Gympass); * Partnerships with Psicologia Viva and Conexa Saúde; * Birthday day off; * Fresh fruit station for Franqers working onsite. **Diversity and Inclusion at Franq!** At Franq, you have space to be authentically yourself! We value you regardless of race, color, religion, gender identity, national origin, disability, sexual orientation, ancestry, or age. All our positions are open to candidates with disabilities—if this applies to you, please specify it in your application and include the corresponding CID code. **JOIN US IN PURSUING THE EXTRAORDINARY** Become a Franqer! \#GoFranq