Databricks Data Engineer

Description

**About Us:** Since 2001, INDT has been a technology institute that inspires innovation and breathes technology! Development is in our DNA, and we offer a collaborative environment full of challenges for learning and growth. We originated in Manaus (AM) through Nokia and today operate across Brazil, aiming to present our services and Culture to all Brazilian regions. Currently, we have over 200 active employees. For us, eliminating geographical and cultural barriers was merely a consequence of our belief that nothing is impossible. Therefore, today more than ever, we can look in the mirror and think: we work for a company that lives and grows every day! Do you want the opportunity to develop your talents? Do you want to work in an excellent work environment alongside colleagues who will support you on your journey? Do you want an incredible experience of feeling valued? Do you want to enhance your daily deliverables and projects with inspiring leaders? Do you want the freedom to propose and develop innovative projects, with autonomy and ownership? Then join us in making a difference! **\#VEMSERINDT** We are seeking Data Engineers to work with the client’s Analytics team, primarily supporting data ingestion processes and maintaining/evolving the team’s requirements. Requirements: **Scope of Work:** * Develop and maintain data ingestion pipelines; * Implement batch/full and incremental data loads; * Integrate data from legacy systems and SAP Datasphere; * Develop data loading processes in the Raw/Bronze layer of Databricks; * Support maintenance, monitoring, and evolution of team requirements; * Perform integration, technical data processing, and data publishing; * Build and maintain pipelines using PySpark and SQL; * Ensure traceability, governance, and technical quality of data loads. **Mandatory Requirements:** * Experience in data engineering; * Experience with Databricks; * Experience with PySpark and Spark SQL; * Hands-on experience with ETL/ELT pipelines and data ingestion; * Knowledge of incremental loads and data integrations; * Knowledge of Delta Lake; * Experience with Git/version control; * Autonomous profile with ability to handle ongoing team requirements. **Preferred Qualifications:** * Experience with SAP Datasphere; * Experience with SAP S/4HANA; * Knowledge of DLT (Delta Live Tables); * Experience in large-scale corporate environments.