Senior Data Engineer

Description

Are you driven by technology, data, and innovation? At Triggo.ai, we transform complex challenges into intelligent solutions. We are a Brazilian company focused on Analytics, AI, and digital transformation, helping organizations make more strategic decisions and generate real business impact. We work across various market sectors, always combining cutting-edge technology, business insight, and agile execution. If you want to build solutions that make a difference and grow alongside a high-performance team, this could be your place. Join Triggo.ai and build the future with us. **Responsibilities and Assignments** * Design and implement data ingestion, transformation, and orchestration pipelines on Google Cloud; * Ensure data flow quality, reliability, and scalability (batch and streaming); * Optimize storage and processing costs (BigQuery, Dataflow, Dataproc, Pub/Sub); * Collaborate with data scientists and analysts, providing ready-to-consume data. **Requirements and Qualifications** **Data Ingestion** Dataflow (Apache Beam)* scalable ETL/ELT pipelines; extraction from external sources such as Oracle databases on OCI and on-premise SQL Server; Pub/Sub* real-time ingestion; Storage Transfer* batch data ingestion originating from GCS itself or external sources such as AWS S3 buckets; * Integration with external databases (Oracle, SQL Server, MySQL) via JDBC / Dataflow templates or custom extraction. **Storage and Processing** BigQuery* modeling, query optimization, partitioning, and clustering; Cloud Storage* Data Lake (raw, bronze, silver, gold); * Dataproc when required; * Bigtable and Firestore for NoSQL use cases. **Transformation and Modeling** * Dataform or dbt for SQL orchestration in BigQuery; * Best practices in dimensional modeling; * Batch and streaming processing (Beam, SQL streaming). **Orchestration and Automation** * Cloud Composer (Airflow) or Workflows for complex scheduling; * Integration with Cloud Functions / Cloud Run for serverless tasks; * Languages and Tools; * Advanced SQL (BigQuery SQL); * Python (for Dataflow, automation, ETL); * Git (CI/CD in repositories). We are the **SysMap Group**, comprising the brands **SysMap Solutions, TriggoLabs, and triggo.ai**, an ecosystem of high-impact companies in the market, delivering innovative technology solutions that transform businesses and develop people. Our essence is driven by **a passion for innovation, collaboration, and continuous growth**. For over **25 years**, we have exceeded expectations by solving complex business challenges, operating across diverse sectors and actively tracking technological evolution. Here, we believe that **technology only creates value when built by people**. Therefore, we cultivate an ethical, collaborative, and diverse environment where learning is constant and excellence in our work is part of who we are. **The only way to participate in SysMap Group selection processes is through the company pages on the Gupy platform; there is no participation or hiring fee.**