···
Log in / Register
GCP Data Engineer | Senior (Remote)
Indeed
Full-time
Onsite
No experience limit
No degree limit
79Q22222+22
Favourites
Share
Some content was automatically translatedView Original
Description

Job Summary: Design and implement data pipelines on Google Cloud, ensuring quality and scalability while collaborating with data scientists. Key Highlights: 1. Advanced SQL and Python experience for data pipelines. 2. Proficiency in BigQuery and Cloud Storage as a Data Lake. 3. Hands-on experience with technologies such as Dataflow, Pub/Sub, and Cloud Composer. . **Responsibilities and Duties** * Design and implement data ingestion, transformation, and orchestration pipelines on Google Cloud; * Ensure data flow quality, reliability, and scalability (batch and streaming); * Optimize storage and processing costs (BigQuery, Dataflow, Dataproc, Pub/Sub); * Collaborate with data scientists and analysts by providing ready-to-consume data. **Requirements and Qualifications** * Advanced SQL experience; * Python experience for pipelines, automation, and ETL; * Dataflow (Apache Beam) experience for batch and streaming ETL/ELT pipelines; * Real-time ingestion experience via Pub/Sub; * Experience integrating with Oracle, SQL Server, and MySQL databases (JDBC, templates, or custom extractions); * Experience using Storage Transfer for batch ingestion (GCS and S3); * Proficiency in BigQuery (modeling, query optimization, partitioning, and clustering); * Experience using Cloud Storage as a Data Lake (raw, bronze, silver, gold); * Hands-on experience with Dataproc, Bigtable, and Firestore (specific use cases); * Knowledge of dimensional modeling; * Experience with Cloud Composer (Airflow) or Workflows; * Experience integrating with serverless solutions (Cloud Functions, Cloud Run); * Experience with Git and CI/CD practices. * Preferred: Healthcare domain knowledge: Electronic Health Records (EHR/EMR/PEP), diagnostic systems (RIS and LIS), hospital scheduling and regulation systems. Compass UOL is a global firm and part of the AI Revolution Company, together transforming organizations using Artificial Intelligence, Generative AI, and other of today’s most advanced technologies. We equip our team with proprietary and external AI-driven tools to design and build digital-native platforms, integrating cutting-edge technologies and enabling companies to innovate, transform their businesses, and drive success in their markets. To achieve this, we attract and develop the best talent, creating opportunities that enhance people’s lives and highlight the positive impact of disruptive technologies. We empower borderless talent and promote knowledge and opportunities in the latest market trends, driving significant personal and professional growth. **Join us and be part of the AI-driven revolution.**

Source:  indeed View original post
João Silva
Indeed · HR

Company

Indeed
João Silva
Indeed · HR
Similar jobs

Cookie
Cookie Settings
Our Apps
Download
Download on the
APP Store
Download
Get it on
Google Play
© 2025 Servanan International Pte. Ltd.