Clone: Senior Data Engineer

Description

Job Summary: Implement and optimize cloud-based data architectures, ensuring data quality, security, and governance, while automating processes for efficiency and scalability. Key Highlights: 1. Cloud data architecture optimization (GCP and Azure) 2. Solid experience with data pipelines (ETL/ELT) 3. Collaborative work with Engineering and Analytics teams Data Engineer Responsibilities and Duties Implement and optimize data architectures in cloud environments (GCP and Azure); Ensure data quality, security, and governance by adhering to best practices and compliance policies; Collaborate with Engineering and Analytics teams to understand data requirements and propose scalable solutions; Monitor and optimize data system performance, identifying bottlenecks and improvement opportunities; Automate data collection, transformation, and delivery processes to enhance efficiency and scalability; Manage data lakes and data warehouses; Implement observability solutions to ensure the reliability of the data platform. Requirements and Qualifications Solid experience developing data pipelines (ETL/ELT) using tools such as Apache Airflow, Databricks, or similar; Proficiency in programming languages such as Python; Experience with relational and non-relational databases (SQL, NoSQL); Knowledge of data lakes and data warehouses (e.g., BigQuery); Experience with code versioning tools (Git) and CI/CD; Understanding of data governance, security, and best practices in data modeling; Ability to work in agile and collaborative environments. Preferred Qualifications Experience with event-driven architecture (Kafka); Familiarity with observability tools; Experience with distributed processing platforms (Spark); **Requirements:** Data Engineer Responsibilities and Duties Implement and optimize data architectures in cloud environments (GCP and Azure); Ensure data quality, security, and governance by adhering to best practices and compliance policies; Collaborate with Engineering and Analytics teams to understand data requirements and propose scalable solutions; Monitor and optimize data system performance, identifying bottlenecks and improvement opportunities; Automate data collection, transformation, and delivery processes to enhance efficiency and scalability; Manage data lakes and data warehouses; Implement observability solutions to ensure the reliability of the data platform. Requirements and Qualifications Solid experience developing data pipelines (ETL/ELT) using tools such as Apache Airflow, Databricks, or similar; Proficiency in programming languages such as Python; Experience with relational and non-relational databases (SQL, NoSQL); Knowledge of data lakes and data warehouses (e.g., BigQuery); Experience with code versioning tools (Git) and CI/CD; Understanding of data governance, security, and best practices in data modeling; Ability to work in agile and collaborative environments. Preferred Qualifications Experience with event-driven architecture (Kafka); Familiarity with observability tools; Experience with distributed processing platforms (Spark);