AWS Consultant/Data Engineer

Description

Job Summary: We are seeking a Data Engineer with experience in the AWS ecosystem, capable of designing, developing, and maintaining scalable and efficient data pipelines while ensuring performance, security, and governance across the entire data lifecycle. Key Highlights: 1. Proven experience with the AWS ecosystem in data projects. 2. Proficiency in tools such as AWS Glue, Amazon S3, Athena, EMR, Lambda, and Airflow. 3. Strong knowledge of Python and PySpark. Description: Technical Requirements: * Proven experience with the AWS ecosystem in data projects. * Proficiency in tools such as AWS Glue, Amazon S3, Athena, EMR, Lambda, and Airflow. * Strong knowledge of Python and PySpark. * Experience in data modeling (dimensional, relational, and non-relational). * Experience with ETL/ELT, data processing, and transformation. * Application of security and compliance best practices (IAM, KMS, access policies). * Experience integrating data from multiple sources. * Practice in pipeline monitoring and observability (CloudWatch, logs, metrics). * Knowledge of version control and CI/CD. Nice-to-Haves: * Experience in multi-account and multi-region AWS environments. * Familiarity with Infrastructure as Code (Terraform, CloudFormation, or CDK). * Basic/intermediate Spanish language skills. * Experience optimizing costs for cloud-based data workloads. Are you passionate about data, technology, and cloud solutions? We are seeking a Data Engineer with experience in the AWS ecosystem, capable of designing, developing, and maintaining scalable and efficient data pipelines while ensuring performance, security, and governance across the entire data lifecycle. Key Responsibilities: * Design, develop, and maintain data pipelines (ETL/ELT) from ingestion to delivery. * Create and manage jobs, crawlers, and data catalogs in AWS Glue. * Orchestrate workflows using Apache Airflow. * Implement scripts and automations in Python and PySpark. * Perform queries and optimizations in Amazon Athena, integrating with S3 and the Glue Data Catalog. * Model and manage buckets in Amazon S3, applying versioning and access policies. * Create AWS Lambda functions for real-time processing and integrations. * Administer and run Amazon EMR clusters for distributed processing. * Use Git and CI/CD pipelines (GitHub Actions, CodePipeline, or similar) for versioning and deployment. * Monitor pipelines and processes using CloudWatch, metrics, and alerts. * Document technical processes and maintain knowledge repositories. #LI-LV1 #LI-REMOTE 2511080202181794380