Senior Consultant (Technical Lead) for Data Engineering

Description

Job Summary: We are seeking a Senior Consultant (Technical Lead) for Data Engineering to lead strategic initiatives, define robust architectures, and ensure excellence in delivering scalable data solutions. Key Highlights: 1. Lead strategic initiatives in mission-critical environments 2. Define robust architectures and guide technical decisions 3. Mentor engineers and promote technical excellence We are looking for a Senior Consultant (Technical Lead) for Data Engineering to lead strategic initiatives in mission-critical environments. This professional will be responsible for defining robust architectures, guiding technical decisions, and ensuring excellence in delivering scalable data solutions, with a focus on Databricks, SAP, and DevOps automation environments. As the team’s technical reference, you will operate at the forefront of data engineering, promoting best practices, mentoring engineers, and ensuring resilience, performance, and governance of implemented solutions.\* Lead the definition of scalable, resilient, and secure data architectures in Databricks and Azure environments. * Guide technical decisions and review solutions developed by team engineers. * Optimize Apache Spark workloads to improve efficiency and reduce costs. * Structure and automate data pipelines and infrastructure using CLI tools and SDKs. * Ensure stability and evolution of highly critical production environments. * Integrate data from SAP systems and other corporate sources efficiently and traceably. * Promote a culture of technical excellence, engineering best practices, and DevOps. * Act as a bridge between technical and business areas, translating requirements into scalable solutions. * Mentor data engineers, fostering technical development and team growth.\* Databricks certification (Data Engineer Professional or equivalent). * Proven experience with Apache Spark and optimization of large-scale workloads. * Proficiency in Databricks (Delta Lake, Workflows, Unity Catalog) and Azure Data Services. * Experience automating infrastructure and pipelines via CLI and SDKs (Databricks CLI, Terraform, Azure CLI). * Hands-on experience in high-availability production environments with critical requirements. * Knowledge of data integration with SAP systems (SAP BW, SAP HANA, SAP Data Services). * Experience with code versioning (Git), CI/CD, and containers (Docker). * Technical leadership profile, with mentoring capability, decision-making skills, and clear communication. * Prior experience working in agile and cross-functional teams. Refer to Job description section for qualification required