Job Summary: Senior Data Engineer with experience in cloud architecture, Databricks, Spark job development, and ETL processes. Key Highlights: 1. Solid experience in cloud architecture and Databricks. 2. Advanced knowledge of Data Engineering and ETL. 3. Proficiency in developing Spark jobs in Python. **Position:** Senior Data Engineer**Employment Type:** CLT **Work Model:** Remote **Work Location:** Remote **Education Requirement:** Completed Bachelor's degree in IT **Mandatory Requirements / Technologies / Required Knowledge** **Main Responsibilities** * Strong expertise in cloud architecture technologies, with emphasis on Databricks and its tools (Unity Catalog, Delta Lake, Databricks Workflows, SQL Editor, Jobs, DLT, etc.); * Experience in cloud-based projects, preferably on AWS, integrating with Databricks for scalable data pipelines; * Experience developing batch-mode Spark jobs and Spark Streaming jobs using Databricks Notebooks in Python for data manipulation and transformation; * Advanced knowledge of Data Engineering, with experience in ETL (Extract, Transform, Load) processes and their variants within the Databricks environment; * Experience in relational and dimensional data modeling; * Knowledge of relational databases such as Db2 and SQL Server; * Integration between relational databases and Databricks using JDBC. **DESIRABLE TECHNICAL KNOWLEDGE (PREFERRED QUALIFICATIONS):** * Knowledge of data replication solutions, especially in environments leveraging \*Databricks \* for real-time management of large-scale data volumes; * Participation in Data Lake implementation and governance projects; * Proficiency in Scala for development and programming in distributed environments; * Familiarity with data analytics and machine learning tools such as R and SAS; * Knowledge of MPP databases such as Netezza \* or \*Redshift