Description
Job Summary:
We are seeking Senior Data Engineers to build and maintain data pipelines in cloud environments, ensuring the integrity and efficiency of analytical workflows.
Key Highlights:
1. Building and maintaining data pipelines in cloud environments
2. Working with large volumes of data and optimizing analytical workflows
3. Collaborating with multidisciplinary teams on innovation
**Positively impacting billions of lives is our purpose—and it can be yours too!**
Founded in 2010 in Brazil, Semantix is a reference in Big Data, Analytics, and Artificial Intelligence.
We are a team of innovation enthusiasts from diverse backgrounds and experience levels. What unites us is our shared motivation to transform our customers' experiences through a data-driven culture.
If this resonates with you, Semantix is your place.
We’re excited to welcome you to our team. After all, **the future is built together**.
Requirements:
We are looking for Senior Data Engineers to work on data projects focused on building and maintaining data pipelines in cloud environments. The ideal candidate must have hands-on experience with SAS, Python (with PySpark), Databricks, and ETL processes. They will work with large volumes of data and be responsible for ensuring end-to-end integrity and efficiency of analytical workflows.
**Responsibilities and Duties:**
* Develop, maintain, and optimize data pipelines (ETL) using SAS Guide and SASQL.
* Create and automate transformation and processing routines in Python, with emphasis on PySpark.
* Work in cloud environments using Databricks and relational databases.
* Ensure the quality of processed data and perform unit testing on critical pipelines.
* Collaborate with multidisciplinary engineering and analytics teams to integrate data from multiple sources.
* Use code versioning (GitHub) and follow best practices for documentation and delivery.
**Requirements and Qualifications:**
* SAS Guide and SASQL
* Python with PySpark
* SQL
* Databricks
* Building and maintaining data pipelines (ETL)
**Desirable:**
* Knowledge of MongoDB
* Experience with GitHub (code versioning)
* Application of unit tests in pipelines
Benefits
Competitive salary;
Caju (flexible card) with R$ 1\.060/month loaded;
Bradesco Health Plan;
Bradesco Dental Plan;
* ️ Preventive medicine with Dr. Alper;
Life Insurance;
* ️ WellHub;
️ SESC;
Childcare allowance for mothers and fathers;
Learning – an area dedicated to developing hard and soft skills;
Partnerships with educational institutions for technical training, MBAs, postgraduate degrees, certifications, English, and Spanish;
Discounts on products via a partner portal.
Please note that all our job openings are open to people of all profiles and backgrounds, valuing diversity and promoting an inclusive and welcoming environment for everyone.