Data Architect (AWS | Databricks) | Specialist (Remote)

Description

. **Responsibilities and Assignments** * Perform the full migration of the current environment — currently hosted on Databricks on Azure — to AWS, including creation of a new data model and restructuring of legacy pipelines and routines; * Define and evolve the architecture of the Corporate Data Platform (Lakehouse); * Ensure alignment with the target architecture based on AWS \+ Databricks; * Define architectural standards, frameworks, and best practices; * Participate in defining the migration strategy (waves, prioritization, dependencies); * Migration and Modernization: Lead the modernization of the legacy Data Warehouse (Azure/DataStage → AWS/Databricks); * Define migration approaches: Incremental vs. Big Bang; * Ensure operational continuity during the transition; * Governance \& Security: Define and implement standards for: Data Governance / Access Control / Data Quality and Lineage; * Ensure compliance with corporate policies and LGPD; * DataOps \& Standardization: Structure standardized and reusable pipelines; * Implement CI/CD best practices for data; * Reduce reliance on manual processes and low standardization; * Integration and Ecosystem: Design integrations with multiple sources and on-premises systems; **Requirements and Qualifications** * Experience with Cloud \& AWS platform services: S3, Glue, IAM, Lake Formation, CloudWatch, CloudTrail; * Experience with Databricks: Unity Catalog, Delta Lake, notebooks, clusters, and policies; * Knowledge of modern Lakehouse-based architecture; * Experience with data modeling (DW, Lakehouse — Bronze/Silver/Gold); * Experience with data pipelines (ETL/ELT); * Experience with: Advanced SQL, Python, and tools such as Airflow / Control-M / distributed orchestration; * Experience with ADF / DataStage (legacy); * Experience with CI/CD for data (Azure DevOps, Git, pipelines); * Experience with Data Quality, Data Contracts, and Data Lineage; * Experience with Data Catalog and corporate governance; * Experience with Security and Compliance (LGPD, access control, sensitive data); * Knowledge of integration with multiple sources: APIs, relational databases, NoSQL, mainframe; * Experience with distributed and domain-driven architecture; * Migration strategies: Replatform, Refactor, Rewrite; * Knowledge of monitoring tools (Datadog, CloudWatch); * Definition of SLAs/SLOs; * Experience troubleshooting critical pipelines; Compass UOL is a global firm and part of the AI Revolution Company, together transforming organizations using Artificial Intelligence, Generative AI, and other of today’s most advanced technologies. We equip our team with proprietary and external AI\-driven tools to design and build digital\-native platforms, integrating cutting\-edge technologies and enabling companies to innovate, transform their businesses, and drive success in their markets. To achieve this, we attract and develop the best talent, creating opportunities that enhance people’s lives and highlight the positive impact of disruptive technologies. We empower borderless talent and promote knowledge and opportunities in the latest market trends, driving significant personal and professional growth. **Join us and be part of the AI\-driven revolution.**