Faster chat, better deals — Get the App

Senior Data Engineer (Redshift, Airflow, and DBT)

Indeed

Company

Job typeFull-time
Workplace typeRemote
Experience levelMore than 10 years
Education levelNo degree limit

Description

Leega is a company focused on efficient and innovative service to its clients. This could not be different with our main fuel: people! Our culture is inspiring, and our values are present in daily life: ethics and transparency, quality excellence, teamwork, economic, social, and environmental responsibility, human relations, and credibility. We seek innovative professionals who are driven by challenges and focused on results. If you are looking for a dynamic and partner-oriented company that invests in its employees through constant training, Leega is the place for you! **\>\> LEEGA IS FOR EVERYONE****, we would be very happy to have you on our team. Come be part of our history and the building of our future.** Register now for our job openings! **Responsibilities and attributes** We are looking for a Senior Data Engineer who, in addition to building and operating pipelines, takes architectural responsibility for the data platform: data warehouse modeling, ingestion patterns, layer governance, and performance and cost decisions. This is a position with heavy technical execution — the person writes code, performs database tuning, reviews third-party modeling, and is responsible for the reliability of the data that feeds executive dashboards, client reports, and regulatory obligations. The environment is regulated, in the financial and investment market, where traceability, reproducibility, and auditable correction of numbers are first-order requirements. Interaction occurs with areas such as Wealth Management, Commercial, Risk, Compliance, and Operations, in addition to acting as a technical reference for mid-level and junior engineers. **Main responsibilities** * Design, build, and maintain ingestion and transformation pipelines orchestrated in Apache Airflow, with consistent patterns for retry, idempotency, alerting, and SLA. * Develop and evolve transformation models in dbt on the data warehouse, organizing the layers (staging, intermediate, and marts) with tests and documentation. * Implement ingestion from heterogeneous sources, such as transactional databases, third-party APIs (custodians, distributors, market providers), regulatory files, and operational spreadsheets. * Define and defend the warehouse data model (dimensional, Data Vault, or hybrid, with justification), including keys, granularity, history (SCD), and handling of retroactive corrections. * Establish and monitor distribution, sorting, and partitioning patterns in MPP (DISTKEY, SORTKEY, and compression in Redshift, or equivalents in other engines). * Lead performance and cost tuning, with analysis of plans, queues/WLM, concurrency, maintenance (VACUUM/ANALYZE), query rewriting, and materializations. * Instrument observability and automated data quality controls, covering freshness, volume, contract breaks, and reconciliation between source and destination. * Design data layers and contracts between teams, defining the source of truth, who writes where, and what is exposed for BI. * Ensure end-to-end lineage and traceability, from a number on the dashboard to the source and the version of the code that produced it, applying access controls, segregation by sensitivity, and compliance with LGPD and sector regulations. * Document architectural decisions (ADRs), keep the data dictionary alive, and act in code review, pairing, and pattern definition with the team. **Requirements and qualifications** **Mandatory requirements** * 6\+ years of experience in data engineering, with at least 2 years of architectural responsibility (having designed the model, not just implemented someone else's design). * Proven track record of putting an analytical data platform into production and operating it, with incidents, on-call, and real consequences. * Advanced SQL: window functions, recursive CTEs, reading execution plans, diagnosing skew and disk spill. * Python applied to data engineering, with modular, testable, and versioned code (not just notebooks), including pandas or polars, typing, and automated tests. * Apache Airflow in production: authoring DAGs, sensors, backfill, and management of dependencies and failures. * Cloud MPP data warehouse, preferably Redshift (Snowflake, BigQuery, or Databricks are accepted, with willingness to deepen knowledge in Redshift). * dbt or equivalent versioned transformation tool, with tests. * Dimensional modeling (Kimball) with real domain: fact and dimension, granularity, SCD types 1 and 2, bridge tables, and snapshots. * Git and code review culture, with CI/CD applied to data. * Performance diagnosis, knowing how to explain why a query is slow and proving the correction with before-and-after numbers. **Differentiators** * Experience in the financial market: investments, wealth management, custody, fixed and variable income, funds, return calculation (IRR/TWR), position, and movement. * Experience with regulatory data from CVM, BACEN, BSM, and ANBIMA, including deadlines and delivery formats. * Infrastructure as code (Terraform) and AWS services (S3, Glue, Lambda, IAM, Step Functions). * Open table formats (Iceberg, Delta), lakehouse architecture, and streaming/CDC (Kafka, Debezium, Kinesis). * Quality and catalog tools (Great Expectations, Soda, DataHub, OpenMetadata) and experience with semantic layer and BI (Power BI, Metabase, Looker). * Having led a relevant migration (legacy to modern, on\-premises to cloud, or spreadsheet/VBA to versioned pipeline) with parity validation. **Behavioral competencies** * Rigor with numerical correctness: in a regulated environment, "almost right" is wrong. * Clear written communication, capable of documenting the architecture in a document that survives the author's departure. * Autonomy to investigate from the dashboard to the data source without depending on approval at each step. * Technical reference posture, with code review, pairing, and mentoring of mid-level and junior professionals. * Ability to translate business demands into sustainable data design, including refusing shortcuts that generate technical debt. * Honesty in estimating scope, risk, and deadline in technical planning. **ESSENTIAL Knowledge/Experience in:** * Advanced SQL, with reading of execution plans and performance diagnosis * Apache Airflow in production * Cloud MPP data warehouse (preferably Redshift) * dbt or equivalent versioned transformation tool * Dimensional modeling (Kimball), with SCD and granularity definition **Additional information** **Work mode: 100% Remote.** At Leega, we do not just deliver lines of code or dashboards. We transform complex technological challenges into real impact. With more than 15 years of experience, we combine the depth of human experience with the speed of Artificial Intelligence to create solutions that change businesses and, above all, improve people's lives. We are an agnostic and strategic technology consultancy. With offices in Brazil and Europe, our team of more than 580 multidisciplinary talents lives and breathes the Data Analytics, Cloud, and AI ecosystem. We master the foundation, from Governance to Engineering, to ensure that technology is not just a tool, but a sustainable competitive advantage for the largest players in the market.

Some content was automatically translated

Posted by

João Silva

Indeed · HR

Location

João Silva

Indeed · HR

Similar jobs

Senior Data Engineer (Redshift, Airflow, and DBT) job by Indeed in 2026 | ok.com