Data Architect | Senior (Remote)

Description

Job Summary: A professional to design and implement scalable data pipelines, lead Azure-to-AWS migration, and work with Lakehouse architectures, ensuring data governance and supporting ML solutions. Key Highlights: 1. Lead Azure-to-AWS migration 2. Work with Lakehouse architectures (Delta Lake / Iceberg) 3. Support solutions that underpin Machine Learning models . **Responsibilities and Duties** * Design and implement scalable data pipelines (ETL/ELT); * Lead Azure-to-AWS migration; * Work with Lakehouse architectures (Delta Lake / Iceberg); * Integrate tools such as ADF, Synapse, Glue, and Databricks; * Ensure data governance, quality, and orchestration; * Support solutions that underpin Machine Learning models. **Requirements and Qualifications** * Strong experience with Python, Spark (PySpark), and Databricks * Experience with Airflow and/or orchestration (ADF, Step Functions) * Experience with AWS (Glue, EMR, Lake Formation) and Azure * Knowledge of Data Lakes / Lakehouse (Delta, Parquet, Iceberg) * Experience with databases such as Snowflake, Redshift, PostgreSQL, or Synapse * Experience with CI/CD (GitHub Actions, Terraform, CloudFormation) * Solid foundation in SQL and data modeling Desirable: Experience with environment migration (Azure → AWS); Experience with Feature Store and ML pipelines; Knowledge of data governance (catalog, lineage, compliance). Compass UOL is a global firm and part of the AI Revolution Company, together transforming organizations using Artificial Intelligence, Generative AI, and other of today’s most advanced technologies. We equip our team with proprietary and external AI\-driven tools to design and build digital\-native platforms, integrating cutting\-edge technologies and enabling companies to innovate, transform their businesses, and drive success in their markets. To achieve this, we attract and develop the best talent, creating opportunities that enhance people’s lives and highlight the positive impact of disruptive technologies. We empower borderless talent and promote knowledge and opportunities in the latest market trends, driving significant personal and professional growth. **Join us and be part of the AI\-driven revolution.**