Leega is a company focused on delivering efficient and innovative service to its clients. This principle is no different with our primary fuel: people! Our culture is inspiring, and our values are embedded in daily operations: ethics and transparency, quality excellence, teamwork, economic, social and environmental responsibility, human relations, and credibility. We seek innovative professionals who are driven by challenges and focused on results. If you are looking for a dynamic and collaborative company that invests in its employees through continuous training, Leega is the place for you! **\>\> LEEGA IS FOR EVERYONE****, we would be delighted to welcome you to our team. Join us in shaping our story and building our future.** Apply now to our open positions! **Responsibilities and duties** * Perform reverse engineering of complex PySpark logic, translating it into native, optimized SQL for BigQuery; * Use AI tools to accelerate data pipeline conversion and automate testing; * Modernize and build ingestion workflows by replacing legacy tools with native GCP services (Datastream, Dataflow, Cloud Run) orchestrated via Cloud Composer; * Manage and optimize data in Apache Iceberg format integrated via BigLake, ensuring performance and cost control; * Develop and execute automated test frameworks to validate volumetric equivalence, business keys, and aggregations between legacy and new environments; * Row count validation: Verification per table and per partition; * Business key reconciliation: Direct comparison of records between source (Spark) and destination (BigQuery); * Checksum/Hash: Aggregation of relevant columns to ensure data integrity; * Validation of key aggregations: Verification of sums, distinct counts, minimums, and maximums used in business metrics. **Requirements and qualifications** * Strong experience with Google Cloud Platform, especially BigQuery, GCS, and Cloud Composer (Airflow), with a minimum of 6 years of professional experience; * Solid technical expertise in advanced SQL and Python/PySpark, with a minimum of 6 years of professional experience; * Practical experience with open table formats (Open Table Formats), specifically conversion and manipulation of Apache Iceberg and Delta; * Knowledge of data transformation orchestration using Dataform or dbt; * Ability to solve complex performance and schema evolution issues in high-volume scenarios (terabyte-scale). **Additional information** * **Temporary project with an initial duration of up to 4 months, subject to extension.** At Leega, we do not merely deliver lines of code or dashboards. We transform complex technological challenges into tangible impact. With over 15 years of experience, we combine deep human expertise with the speed of Artificial Intelligence to build solutions that transform businesses—and, above all, improve people’s lives. We are a technology consulting firm—agnostic and strategic. With offices in Brazil and Europe, our team of over 580 multidisciplinary talents lives and breathes the Data Analytics, Cloud, and AI ecosystem. We master the full foundation—from Governance to Engineering—to ensure technology is not just a tool, but a sustainable competitive advantage for the world’s leading enterprises.
João Silva
Indeed · HR
João Silva
Indeed · HR
