**About the Role:** We are seeking a Senior Data Engineer with a hands-on mindset and infrastructure focus to expand, optimize, and maintain our data platform built on **Microsoft Fabric**. You will work on a lakehouse architecture, data pipelines, integration flows, and actively contribute to the adoption plan for **Databricks**. This is an opportunity for those who wish to deepen their expertise in data platforms, lakehouses, and cutting-edge technologies within the Azure ecosystem. **Key Responsibilities (What You’ll Do):** * Design and maintain the lakehouse architecture following the **Medallion (Bronze / Silver / Gold)** pattern in Microsoft Fabric. * Develop, optimize, and monitor data pipelines and orchestration workflows. * Implement **Dataflows Gen2** for data integration and transformation. * Support real-time analytics and streaming initiatives. * Write and optimize advanced **SQL** queries for transformations, data quality validation, and troubleshooting. * Develop scripts in **Python** for pipeline logic, data processing, and task automation. * Build and maintain semantic models in **Power BI** (datasets, DAX, relationships — excluding visual report creation). * Implement **CI/CD** practices using **Azure DevOps** and **Git/GitHub**. * Contribute to the **Databricks** adoption plan, including proof-of-concept (POC) development and migration strategies. * Ensure data quality, governance, lineage, and documentation across the entire platform. * Collaborate with internal stakeholders (Finance, Sales, Lab, HR) to deliver reliable, business-aligned data solutions. * Document architectural decisions, pipeline designs, and operational procedures. **Required Qualifications:** * **Experience:** 3–8 years in data engineering or related fields. * **Education:** Bachelor’s degree in Computer Science, Data Engineering, Information Systems, or related disciplines. * **Microsoft Fabric (Intermediate/Advanced):** lakehouses, pipelines, Dataflows Gen2, and real\-time analytics. * **SQL (Advanced):** complex queries, performance optimization, and data modeling. * **Python (Intermediate/Advanced):** scripts for data engineering, ETL logic, and automation. * **Azure DevOps:** CI/CD pipelines and release management for data projects. * **Git/GitHub:** branching strategies, version control, and code review workflows. * **Power BI:** semantic modeling (dataset design, DAX fundamentals, optimization). * **Data Architecture:** solid understanding of the medallion pattern, lakehouse design, and governance principles. **Nice-to-Have Qualifications:** * Experience with **Databricks** (notebooks, Unity Catalog, Delta Lake). * Knowledge of **Spark (PySpark / Scala)**. * Integrations with **APIs** and REST endpoints. * Hands-on experience with other **Azure** services (Data Factory, Synapse, Azure SQL). * Familiarity with **Data Mesh** or **Data Products** concepts. **Languages (Required):** * **English:** Fluent or Advanced for technical communication in English and participation in international meetings. **General Engagement Details:** * **Estimated engagement duration:** 6–10 months (with possibility of extension and long-term opportunity) * **Work model:** 100% Remote
João Silva
Indeed · HR
João Silva
Indeed · HR
