Azure & Databricks Data Engineer

Description

**Description:** ---------------- Join Digiage and help scale artificial intelligence with operational excellence. We are looking for an Azure & Databricks Data Engineer to work on strategic Data & Analytics projects, contributing to the building, modernization, and evolution of cloud-based data platforms on Azure. We seek analytical professionals with architectural vision and data engineering experience who wish to work on modern, scalable, data-driven solutions, supporting analytics, artificial intelligence, and digital transformation initiatives. **Responsibilities:** * Develop, maintain, and optimize data pipelines using Azure Data Factory and Azure Databricks; * Perform data ingestion, transformation, and delivery to analytical environments; * Implement scalable solutions in Azure Data Lake Storage; * Process large volumes of structured and unstructured data; * Support data modernization and migration initiatives to the Azure Cloud environment; * Ensure data quality, organization, monitoring, and governance; * Collaborate on implementing best practices in data architecture and engineering; * Manage and govern data using Unity Catalog; * Develop Databricks routines and processes focused on performance and scalability; * Work closely with BI, Analytics, Engineering, and Architecture teams; * Support continuous improvement of data solutions and processes; * Participate in technical discussions and contribute to innovation in data architectures. **Requirements:** ----------------- **Requirements:** * Bachelor's degree in IT, Engineering, Computer Science, Information Systems, or related fields; * Experience developing data pipelines (ETL/ELT); * Solid knowledge of Azure Data Factory and Azure Databricks; * Hands-on experience in production environments on the Azure platform; * Proficiency in SQL for data transformation, manipulation, and analysis; * Understanding of Data Lake concepts and modern data architecture; * Experience with Databricks, including Delta Lake, Workflows, and Notebooks; * Familiarity with data modeling for analytical environments: Star Schema, OBT, and Data Vault; * Knowledge of data ingestion, transformation, and orchestration processes; * Interest and experience in data migration and modernization projects to the Cloud. **Preferred Qualifications:** * Knowledge of Unity Catalog; * Experience with PySpark or Spark SQL; * Experience with CI/CD and pipeline automation; * Knowledge of infrastructure as code; * Microsoft Azure certifications; * Experience with Power BI or other Analytics tools; * Experience in artificial intelligence and machine learning projects; * Knowledge of data governance, security, and quality.