Senior Data Engineer (GCP)

Description

**What are we looking for?** We are seeking a Senior Data Engineer to work on strategic data projects in a cloud environment, with a focus on Google Cloud Platform and distributed processing using PySpark. The professional will be responsible for designing, building, and optimizing robust and scalable data pipelines, ensuring data quality and availability for business units and analytics teams. This is a 100% remote position requiring technical autonomy, architectural vision, and the ability to provide technical leadership within multidisciplinary squads. **Key Responsibilities:** * Design and implement data ingestion, transformation, and delivery pipelines using GCP and PySpark * Define and evolve data architecture (Data Lake, Data Warehouse, and Data Lakehouse) within the Google Cloud ecosystem * Ensure data quality, traceability, and governance throughout the entire data lifecycle * Collaborate with Analytics, Data Science, and Software Engineering teams to understand and fulfill data requirements * Optimize distributed processing jobs for performance, cost, and scalability * Document technical solutions, standards, and best practices for the data team * Serve as a technical reference within the team, supporting code reviews and mentoring junior and mid-level professionals **Required Qualifications:** * Solid experience in data engineering using Google Cloud Platform, including hands-on work with services such as BigQuery, Dataflow, Cloud Storage, Pub/Sub, and Dataproc * Proficiency in PySpark and the Apache Spark ecosystem for distributed processing of large-scale data volumes * Advanced knowledge of Python applied to data engineering, including libraries such as pandas, pydantic, and orchestration frameworks * Advanced expertise in SQL and data modeling, including Star Schema and Data Vault * Experience with pipeline orchestration tools such as Apache Airflow or Cloud Composer * Knowledge of modern data architectures, including Data Lake, Data Warehouse, and Lakehouse (Delta Lake and Apache Iceberg) * Ability to operate autonomously and take ownership of end\-to\-end initiatives * Analytical mindset, focused on problem-solving and continuous improvement * Strong communication skills for interacting with technical teams and business stakeholders * Experience working in collaborative and remote environments, with effective organization and prioritization **Preferred Qualifications:** * Experience with dbt (data build tool) for data transformation, versioning, and documentation * Knowledge of infrastructure-as-code using Terraform for provisioning resources on GCP * Familiarity with DataOps practices and CI/CD applied to data pipelines * Experience with real-time data streaming using Kafka, Pub/Sub, or Dataflow Streaming * Experience in on\-premise to cloud migration projects **Work Location: Remote.** **Why build your career at Meta?** We offer autonomy, clear goals, and a dynamic, challenging environment where professionals have the opportunity to interact with diverse technologies, participate in all types of projects, bring new ideas, and work from anywhere in Brazil—and why not, the world. Additionally, we are recognized as one of the best companies to work for in Brazil by Great Place to Work, and among the top 10 fastest-growing companies in the country for three consecutive years, according to the Informática Hoje Annual Report. **What are our values?** * We are people serving people * We think and act like owners * We strive for performance * We grow and learn together * We pursue excellence and simplicity * Innovation and creativity are in our DNA All individuals are welcome regardless of their condition, disability, ethnicity, religious belief, sexual orientation, appearance, age, or related factors. We want you to grow with us in an inclusive environment full of opportunities. Do you identify with this? Then, \#JoinMeta!