Data Engineer – AWS

Description

Job Summary: Design and implement data architectures in AWS environments, develop and maintain ETL/ELT pipelines, ensure data quality, security, and governance, optimize queries, and collaborate with business teams. Key Highlights: 1. Solid experience (4+ years) in data engineering 2. Proficiency in AWS (S3, Glue, Athena, Redshift, EMR, Lambda) 3. Strong knowledge of Python, Spark, and SQL Responsibilities Design and implement data architectures in AWS environments (Data Lake / Data Mesh). Develop and maintain ETL/ELT pipelines using services such as Glue, Lambda, Step Functions, S3, Athena, and Redshift. Ensure data quality, security, and governance. Optimize queries and processes for large-scale data volumes. Collaborate with business teams to deliver data efficiently. Manage multiple concurrent priorities in a constantly changing environment. Recommend AWS services that add value to HDI Group's data environment Requirements: **Technical Requirements** Solid experience (4\+ years) in data engineering. Knowledge of lakehouse / data mesh layers. Proficiency in AWS (S3, Glue, Athena, Redshift, EMR, Lambda). Strong knowledge of Python, Spark, and SQL. Experience with orchestration tools (Step Functions and/or Airflow). Knowledge of data modeling, Data Lake, and Data Warehouse. **Preferred Qualifications** Data Zone Migration of legacy systems to AWS Practical experience consuming and processing JSON-formatted files Data Mesh Insurance domain knowledge **Soft Skills** Proactivity and ability to work autonomously. Clear communication and collaboration with cross-functional teams. Ability to explain technical concepts simply. Focus on problem solving and continuous improvement. Sense of urgency