### **Role in the Company** Lead the development of end-to-end data pipelines and data models in Azure/Databricks, ensuring quality, performance, security, and predictability of deliverables in a consulting environment ### **Responsibilities** Design and implement domain-oriented Bronze/Silver/Gold ingestion and transformation layers. Define and apply standards: naming conventions, partitioning, Z-Order, optimizations, Liquid Cluster, etc. Orchestrate workflows in ADF/Jobs; parameterization, Key Vault integration, and credential best practices. Implement observability (logs, metrics, alerts). Apply governance (Unity Catalog: catalogs, schemas, grants, RLS/masking where applicable). Conduct code reviews, mentor the team, and serve as the technical interface with the client. Estimate effort, plan sprints, and communicate risks/impediments. Investigate and resolve low-to-medium complexity incidents, such as job failures, connectivity errors, etc. ### **Requirements** AZ-900 and DP-900. Databricks Fundamentals. Advanced SQL (window functions, CTEs, tuning) and solid PySpark (joins, narrow/wide transformations, native functions vs UDFs). Databricks (Jobs/Workflows, Delta Lake, optimizations, managed/external tables, Unity Catalog). Azure Data Factory (Integration Runtimes, triggers, parameters/variables, integrations). Git + CI/CD (GitHub Actions/Azure Pipelines) for notebooks/Jobs/ADF. Security (RBAC, secrets, networking) and basic FinOps. Continuous Data Quality and monitoring of drifts/anomalies. Consultative communication and translation of business requirements. ### **Preferred Qualifications** DP-203 or DP-600 or DP-700. Intermediate to advanced English (B1/B2). Databricks Data Engineer Associate. Databricks Spark Developer Associate. Dimensional/vault modeling; data products/data mesh. Cost optimization (right-sizing, autoscaling, caching) and SLOs. Expected experience: 2–5 years (production projects). **What We Offer:** * **Medical allowance:** Monthly financial support to help you enroll in your health insurance plan. * **Wellhub**, to keep your body and mind active — your way. * **Online therapy**, fully covered by the company, because mental health matters. * **Online nutrition counseling**, up to two sessions per month to support your nutritional health. * ️ **Life insurance**, with a policy value of R$ 125,000, providing greater security for you and your family. * **Birthday day off**, because your day deserves to be special. * **Paid time off**, so you can recharge your energy. * **Internal gamification**, turning achievements into rewards and recognition. * **Educational partnerships** with institutions such as FIAP, Anhanguera, and Instituto Infnet, to support your growth and learning. * **Technical certification bonus**, recognizing and rewarding your effort to learn. ***We value every voice and every individual, because we know diversity makes us more innovative and stronger.***
João Silva
Indeed · HR
João Silva
Indeed · HR
