Description
Job Summary:
Design, develop, and maintain robust and scalable data pipelines in a cloud environment (Azure), implementing distributed processing solutions using Databricks and Apache Spark.
Key Highlights:
1. Data engineering work focused on Microsoft Azure cloud platforms.
2. Development of robust and scalable data pipelines.
3. Dynamic environment focused on emerging technologies and best practices.
### **General Information**
Brasília \- DF
### **Description**
### **Requirements:**
* Experience with cloud-based data platforms, especially **Microsoft Azure**.
* Practical experience with **Azure Databricks**.
* Solid knowledge of **Python** for data engineering.
* Experience with **Apache Spark** (DataFrames, job optimization, etc.).
* Knowledge of data modeling:
+ **Dimensional (Star Schema, Snowflake)**
+ **Relational**
* Experience with layered data architecture (Medallion).
* Hands-on experience automating pipelines (e.g., Azure Data Factory, Databricks workflows, or similar).
* Familiarity with code versioning (Git).
### **Preferred Qualifications:**
* Experience with **Delta Lake**.
* Knowledge of **DataOps** practices.
* Experience with CI/CD for data pipelines.
* Azure certifications (e.g., DP\-203\).
Familiarity with observability and monitoring tools.
* ### **Desired Profile:**
+ Analytical thinking and problem-solving focus.
+ Strong communication and teamwork skills.
+ Proactivity and ownership mindset.
+ Interest in emerging technologies and best practices in data engineering.
Responsibilities
* ### **Responsibilities:**
+ Design, develop, and maintain robust and scalable data pipelines in a cloud environment (Azure).
+ Implement distributed processing solutions using Databricks and Apache Spark.
+ Develop
Environment
The National Telecommunications Agency (Anatel), established by the General Telecommunications Law (Law No. 9\.472, dated July 16, 1997\), was the first regulatory agency created in Brazil, on November 5, 1997.
The National Telecommunications Agency (Anatel) regulates the telecommunications sector in Brazil, aiming to contribute to the country's development.
To this end, Anatel:
* Establishes standards and regulations so that service pr
### **Requirements**
Mandatory Education
Postgraduate degree
**Databases**
Bachelor's degree
**Information Technology or related fields**
### **Additional Information**
Employment Contract
CLT
Travel
Never
Working Hours
Business hours \| 09:00 \- 18:00
Work Modality
Remote work
### **Benefits**
Others
*Note:* Oriente\-me platform; Wellhub; Viver bem pró saúde; Pluxee cuida digital; SESC agreement; IESB partnership
Meal Allowance
Food Allowance
Wellness and Health Program
Dental Plan