Senior Databricks Data Engineer

Description

Are you passionate about technology and innovation? At Grupo SysMap — which brings together SysMap Solutions, TriggoLabs, and triggo.ai — we believe outstanding results stem from extraordinary people. We are a Brazilian technology company that, since 1999, has helped organizations overcome complex challenges and accelerate their digital transformation. Our operations span multiple sectors, including Telecom, Retail, Education, Financial Services, Industry/Cosmetics, and Energy — always focused on innovative, high-impact solutions. Apply now and build the future of technology with us! **Responsibilities and duties** * Design, evolve, and maintain scalable data pipelines for ingestion, transformation, and delivery of information in Databricks environments, using Python, SQL, Spark, and DBT; * Design, implement, and optimize ETL/ELT processes, ensuring high performance, reliability, data governance, and data quality throughout the solution lifecycle; * Build, maintain, and monitor workflows and DAGs in Apache Airflow, ensuring correct orchestration, automation, and observability of data loads; * Work on modeling and implementing Bronze, Silver, and Gold layers following the Lakehouse architecture and industry best practices in Data Engineering; * Integrate data from multiple sources, including APIs, relational and non-relational databases, enterprise systems, and cloud services; * Support defining technical standards, development best practices, versioning, testing, and documentation of data pipelines; * Collaborate closely with Analytics, BI, Data Science, and business teams to understand requirements and translate them into scalable data solutions; * Investigate and resolve incidents, performance issues, and failures in data processes, ensuring platform stability and availability. **Requirements and qualifications** * Proven experience as a Senior Data Engineer in enterprise data projects and large-scale data environments; * Proficiency in Databricks, Apache Spark, Delta Lake, Python, and SQL for developing, maintaining, and optimizing data pipelines; * Hands-on experience with DBT for data transformation, modeling, and management of data assets; * Advanced knowledge of Apache Airflow for orchestrating, monitoring, and automating data workflows; * Experience with Lakehouse architecture and data modeling across Bronze, Silver, and Gold layers; * Practical experience integrating data via REST APIs, relational databases, and other enterprise data sources; * Familiarity with Git-based code versioning and experience with Azure DevOps or similar CI/CD tools; * Experience with data quality, monitoring, observability, and data governance practices; * Knowledge of performance tuning and optimization of queries and data processing pipelines; * Databricks certifications, Azure Data Engineer Associate, or equivalent; * Experience with Azure Data Lake Storage (ADLS), Azure Data Factory (ADF), and other Azure cloud data services; * Understanding of DataOps, CI/CD for data pipelines, and Infrastructure as Code (IaC); * Experience with Data Quality, Data Governance, and Data Observability tools. We are the **Grupo SysMap**, composed of the brands **SysMap Solutions, TriggoLabs, and triggo.ai** — an ecosystem of high-impact companies in the market, delivering innovative technology solutions that transform businesses and develop people. Our essence is driven by **a passion for innovation, collaboration, and continuous growth**. For over **25 years**, we have exceeded expectations by solving complex business challenges across diverse sectors while actively keeping pace with technological evolution. Here, we believe that **technology only delivers value when built by people**. That’s why we foster an ethical, collaborative, and diverse environment where learning is constant and excellence in what we do defines who we are. **The only way to participate in Grupo SysMap’s selection processes is through the company’s pages on the Gupy platform; there is no participation or hiring fee.**