Description
**100% REMOTE POSITION**
We are seeking a **Senior Data Engineer** to strengthen our data infrastructure on Google Cloud Platform. You will be responsible for developing and optimizing data pipelines, ensuring governance, security, and efficiency. The challenge involves working with Airflow, PostgreSQL, BigQuery, and modern architectures, enabling the creation of advanced risk and credit intelligence models for real estate lending. We operate in a multidisciplinary team composed of experts in product, engineering, data science, and credit.
**Responsibilities**
* Design, develop, and maintain scalable pipelines using Airflow.
* Build and optimize ETLs and ELTs for ingesting structured data into PostgreSQL and semi-structured data, ensuring quality and reliability.
* Implement and manage modern architectures (Data Lake, Data Warehouse) with a focus on scalability and governance.
* Automate, integrate, and orchestrate internal and third-party data sources.
* Develop data quality, monitoring, and observability processes.
* Collaborate with data scientists to support advanced modeling and analytics.
* Ensure security and compliance with Data Governance and LGPD.
**Requirements**
* Advanced knowledge of Python, Airflow, and SQL.
* Experience with PostgreSQL, Data Warehouse, and Data Lake.
* Familiarity with data security, LGPD, and data governance.
**Preferred Qualifications**
* Experience with GCP.
* Experience with data streaming (RabbitMQ, Pub/Sub, Kafka, or similar).
* Infrastructure as Code (Docker, Cloud Build, CI/CD for data).