. **Responsibilities and Assignments** * Develop and optimize large-scale data pipelines with a focus on performance and reliability; * Build streaming and batch solutions for data ingestion, transformation, and consumption; * Collaborate with architects and developers to define technical standards and best practices; * Ensure observability, versioning, and data quality in production; * Support modernization and automation initiatives within the tribe; **Requirements and Qualifications** **Requirements:** * Solid experience as a Data Engineer; * Proficiency in Scala, Spark (Streaming), and Python; * Practical knowledge of distributed architectures and microservices; * Hands-on experience with AWS services such as Lambda, SNS, SQS, and Glue; * Strong analytical capability and mindset oriented toward efficiency and scalability; **Preferred Qualifications:** * Experience with ScyllaDB (or Apache Cassandra); * Knowledge of Kafka; * Experience in data environments supporting digital products and teams; Compass UOL is a global firm and part of the AI Revolution Company, together transforming organizations using Artificial Intelligence, Generative AI, and other of today’s most advanced technologies. We equip our team with proprietary and external AI\-driven tools to design and build digital\-native platforms, integrating cutting\-edge technologies and enabling companies to innovate, transform their businesses, and drive success in their markets. To achieve this, we attract and develop the best talent, creating opportunities that enhance people’s lives and highlight the positive impact of disruptive technologies. We empower borderless talent and promote knowledge and opportunities in the latest market trends, driving significant personal and professional growth. **Join us and be part of the AI\-driven revolution.**
João Silva
Indeed · HR
João Silva
Indeed · HR
