AWS Data Engineer | Senior (Remote)

Description

Job Summary: This professional will define and evolve the cloud-native data architecture, design data models optimized for AI, and lead the migration of historical data, ensuring consistency and compliance with LGPD. Key Highlights: 1. Define and evolve cloud-native data architecture on AWS 2. Lead historical data migration and ensure governance 3. Support the construction of semantic layers and monitor pipelines . **Responsibilities and Duties** * Define and evolve cloud\-native data architecture on AWS; * Design data models optimized for APIs and AI consumption; * Lead historical data migration from mainframe; * Ensure data consistency, integrity, and traceability; * Work with large volumes and complex historical data; * Build and maintain ingestion and transformation pipelines; * Integrate systems (PeopleSoft, mainframe, and RDS); * Optimize queries in PostgreSQL; * Implement partitioning, indexing, and caching strategies (Redis); * Reduce latency in frequent queries; * Ensure compliance with LGPD and retention policies; * Implement governance: access control, masking, anonymization, auditing, and lineage; * Structure data for consumption by LLMs and conversational agents; * Support the construction of semantic layers; * Implement data quality validations and pipeline monitoring. **Requirements and Qualifications** * Experience with AWS (S3, Glue, Lambda, RDS); * Experience with PostgreSQL databases; * Hands-on experience with data pipelines (ETL/ELT); * Experience with data modeling and large-scale data; * Knowledge of data governance and data quality; * Nice-to-have: Experience with LLMs or AI-applied data projects. Compass UOL is a global firm and part of the AI Revolution Company, together transforming organizations using Artificial Intelligence, Generative AI, and other of today’s most advanced technologies. We equip our team with proprietary and external AI\-driven tools to design and build digital\-native platforms, integrating cutting\-edge technologies and enabling companies to innovate, transform their businesses, and drive success in their markets. To achieve this, we attract and develop the best talent, creating opportunities that enhance people’s lives and highlight the positive impact of disruptive technologies. We empower borderless talent and promote knowledge and opportunities in the latest market trends, driving significant personal and professional growth. **Join us and be part of the AI\-driven revolution.**