Data Engineer

Description

Job Summary: We are seeking a Data Engineer to structure, organize, and make data available for strategic analytics in the automobile insurance sector. Key Highlights: 1. Development and maintenance of robust and scalable data pipelines. 2. Creation and management of data lakes and data warehouses for business analytics. 3. Collaboration with teams to develop decision-making dashboards. We are looking for a Data Engineer with strong capabilities to structure, organize, and make data available for strategic analytics. The professional will be responsible for developing and maintaining robust, highly available, and scalable data pipelines, ensuring data quality and governance in an environment focused on the automobile insurance sector. Responsibilities * Develop, optimize, and maintain data ingestion, transformation, and processing pipelines (batch and streaming). * Create and manage data lakes and data warehouses to support business analytics, pricing, claims frequency, and policy performance. * Integrate data from multiple sources (ERP, inspection systems, telematics, CRM, partners, and external APIs). * Establish and ensure best practices for data governance, quality, traceability, and security. * Collaborate with development teams on decision-making dashboards; * Implement monitoring, observability, and automation solutions to ensure performance and reliability. Technical Requirements * SQL (advanced) * ETL/ELT and orchestration tools (Airflow, Data Factory, Prefect, etc.) * Data modeling (Kimball, Data Vault, analytical models) * Python or Scala for data processing * Knowledge of cloud services (Azure, AWS, Oracle, or GCP) * Streaming tools (Kafka, Event Hub, etc.) * Git * CI/CD * Best practices for security and LGPD compliance * Data Lakehouse, Delta Lake, Iceberg, or similar technologies Nice-to-Have * Containers and orchestration: Docker, Kubernetes, AKS/EKS/GKE * Big Data * Orchestration: Apache Airflow, Prefect, Dagster * Messaging and streaming: Apache Kafka, Redpanda * Data governance and cataloging: Amundsen, DataHub, OpenMetadata * Azure Synapse / Fabric * Power BI for supporting the analytics team ### **Employment Type:** Contractor (PJ) ### **Department:** Technology