Senior Data Engineer – Google Cloud

Description

Job Summary: We are seeking a Senior Data Engineer specialized in GCP to support the design and evolution of our Lakehouse, strengthening governance and architecture. Key Highlights: 1. Participation in the strategic project for Lakehouse design and evolution 2. Technical autonomy and opportunity to influence architecture decisions 3. An environment that accelerates data maturity We are looking for a **Senior Data Engineer specialized in Google Cloud Platform (GCP)** to work on a strategic project for **designing and evolving our Lakehouse**, reinforcing governance, architecture, data pipelines, and engineering best practices. If you wish to work in an environment accelerating its data maturity, with technical autonomy and a real opportunity to influence architecture decisions, this role may be ideal for you. **Responsibilities** * Develop, maintain, and optimize batch and streaming data pipelines using **Dataflow, Pub/Sub, BigQuery, Cloud Storage, and Composer/Airflow**. * Organize and structure data zones (bronze, silver, and gold), supporting the evolution toward **Lakehouse / medallion architecture**. * Support governance initiatives, data cataloging, security, IAM, and best practices using native GCP tools. * Contribute to architecture definitions, model standardization, and improvements in performance and cost efficiency. * Collaborate with Analytics, Business, and Engineering teams to ensure data quality, reliability, and scalability. * Automate processes and support integrations with internal and external systems (APIs). **Technical Requirements** * Solid experience with **GCP**, focusing on: * **BigQuery** (modeling, partitioning, clustering, optimization) * **Dataflow / Apache Beam** * **Cloud Storage** * **Cloud Composer / Airflow** * **Pub/Sub** * Proficiency in **Python** (Pandas, data manipulation, API integration, Parquet). * Experience with **ETL/ELT pipelines**, data governance, metadata management, and security/IAM. * Hands-on experience designing or maintaining **Data Lakes** or **medallion architecture**. * Knowledge of GCP performance best practices and cost optimization. **Nice-to-Have (non-eliminatory)** * Experience with **Dataplex**, Data Catalog, or advanced governance. * Participation in architecture projects or greenfield implementations. * GCP certifications (e.g., Data Engineer, Cloud Architect). * Experience with Databricks / PySpark. Employment Type: Freelance / PJ Compensation: R$14\.000,00 \- R$16\.000,00 per month