Job Summary: The Data Engineer will be responsible for proposing technological solutions, defining scalable data architecture, designing data pipelines, and leading the data engineering team to ensure the organization’s data strategy. Key Highlights: 1. Lead and mentor a team of data engineers 2. Collaborate with data analysts and business units 3. Define and structure the architecture of a data platform . **Responsibilities and Duties** * Understand business technological needs and propose solutions aligned with best practices for data collection, storage, consumption, and governance; * Conduct technical assessments of the data environment, including analysis of data collection, organization, processing, and interpretation of datasets to support decision-making; * Define and structure a scalable and secure data platform architecture; * Design, develop, and manage batch and streaming data pipelines using Azure Data Factory and Azure Databricks; * Build and optimize complex data processing workflows using ETL/ELT tools; * Collaborate with data analysts and business units to ensure alignment between technical requirements and strategic objectives; * Work directly with stakeholders to define and evolve the organization’s data strategy; * Lead and mentor a team of data engineers, promoting best practices, technical quality, and governance; * Ensure clear communication, structured analytical reasoning, and ethical handling of sensitive data. **Requirements and Qualifications** * Experience with SQL for query manipulation and optimization; * Knowledge of PySpark and/or Python for data transformation and processing; * Solid understanding of data modeling; * Experience building ETL processes and integrating multiple data sources; * Strong experience in data architecture and engineering within Azure environments; * Proficiency in Azure Data Factory for orchestration, data ingestion, and transformation; * Advanced experience with Azure Databricks for distributed data processing; * Experience with data governance, quality, and security practices; * Knowledge of integration with relational and non-relational databases; * Experience with code versioning and CI/CD best practices applied to data pipelines. Compass UOL is a global firm and part of the AI Revolution Company, together transforming organizations using Artificial Intelligence, Generative AI, and other of today’s most advanced technologies. We equip our team with proprietary and external AI\-driven tools to design and build digital\-native platforms, integrating cutting\-edge technologies and enabling companies to innovate, transform their businesses, and drive success in their markets. To achieve this, we attract and develop the best talent, creating opportunities that enhance people’s lives and highlight the positive impact of disruptive technologies. We empower borderless talent and promote knowledge and opportunities in the latest market trends, driving significant personal and professional growth. **Join us and be part of the AI\-driven revolution.**