Senior DataOps Engineer (AWS)

Description

Job Summary: You will work as a Senior DevOps Engineer, developing and maintaining data pipelines for a Data Lake, implementing improvements, and collaborating within an agile team. Key Highlights: 1. Senior DevOps Engineer with a focus on data pipelines. 2. Development and maintenance of AWS data pipelines and CI/CD pipelines. 3. Work within an agile team, collaborating to resolve challenges. Description: * Minimum 2 years of experience developing and monitoring AWS pipelines; * Proficiency in Terraform for Infrastructure as Code; * Proficiency in EC2 virtualization; * Proficiency in CI/CD pipelines using Git; * Practical knowledge of Kubernetes; * Knowledge of messaging services, especially Kafka; * Big Data | Technologies, Solutions, and Concepts such as Spark, Hadoop, Hive, MapReduce, Kafka; * Workflow | Airflow; * Storage Solutions | S3, Redshift, Parquet, Delta; * Data Modeling | Landing, Cleaning, Processing, Curation, Fact/Dimensional Structures, ETL chaining, Data Marts; * Solid knowledge of AWS data pipelines. * Senior DevOps Engineer + Data Pipelines; * Development of data pipelines for the Data Lake; * Maintenance of processes to fix failures/errors; * Implementation of improvements; * Work within the FastData context, implementing consumers as microservices on EKS, enriching events with platform data, and integrating with Adobe Analytics; * Work as part of an agile team; * Collaborate with other team members, Engineers, Product Owners, QA, Designers, Scrum Masters, Functional and Tech Leads to resolve existing challenges; * Develop, deploy, and operate applications in a DevOps culture; * Relational and Dimensional Data Modeling. 2512150202201641414