Description
Job Summary:
The candidate will develop and maintain data pipelines, collaborate on automation of data processes, and actively participate in the technical team.
Key Highlights:
1. Develop and maintain data pipelines using Databricks and Apache Spark.
2. Collaborate on automating data processes and continuous integration.
3. Support the development of scalable solutions with a focus on data quality.
Description:
* Bachelor's degree in IT or related field, completed or in progress;
* Strong knowledge of data modeling and best practices in data engineering;
* Strong proficiency in SQL;
* Basic to intermediate knowledge of Databricks and Apache Spark;
* Basic to intermediate knowledge of Python for data applications (PySpark, etc.);
Preferred Qualifications:
* Experience with cloud environments, especially Azure;
* Develop and maintain data pipelines using Databricks and Apache Spark;
* Write clean and efficient Python code for data manipulation and transformation;
* Collaborate on automating data processes and continuous integration using Azure DevOps;
* Work with code versioning using Git;
* Support the development of scalable solutions focused on data quality;
* Participate in code reviews, daily stand-ups, and technical meetings with the team.
2512180202551811399