Description: Mentorship and Cost Reduction in BigQuery BigQuery Consulting: You will guide us on best practices for using BigQuery, with a special focus on reducing costs to ensure our database maintenance is financially viable and intelligent. Desirable: * Familiarity with code documentation. * Experience with agile methodologies. * Skills in developing and optimizing APIs for data consumption. * Familiarity with developing monitoring and alerts for processes built on GCP. * Experience creating dashboards using Power BI or Looker Studio. * Experience with real-time data processing on GCP. Soft Skills * Ability to communicate technical solutions simply and pragmatically. * Proactivity in supporting the team. Fully remote. Scope of work: 1. Database Organization and Structuring * Perform data modeling by analyzing and structuring datasets to ensure appropriate relationships and adherence to industry best practices. * Handle special data by creating and managing equivalence tables (FROM-TO), including specific cases such as verticals, aiming for greater standardization and efficiency. 2. Development of Data Pipelines and Data Flows * Build pipelines ensuring full traceability, from file availability provided by clients (Excel, CSV, Google Sheets) through to loading into the Gold layer on Google Cloud Platform (GCP). * Implement automations that optimize the upload, transformation, and consolidation of data, ensuring operational robustness and reliability. * Identify opportunities for direct automation at the source, reducing dependence on manual files and increasing efficiency. 3. Migration and Optimization of the Primary Database * Support the analysis, planning, and execution of migrating the PortoSDM database (currently in SQL) to BigQuery. * Propose and implement efficient migration strategies, such as incremental loads, avoiding high costs associated with daily full loads. 2512220202491879539