SENIOR DATA ENGINEER - SAO PAULO

Description

Job Summary: We are seeking a Data Engineer to join an innovative team focused on decision engines, predictive analytics, and NLP, leveraging large volumes of data to generate positive impact. Key Highlights: 1. Working with decision engines, predictive analytics, and NLP 2. Positive impact on financial empowerment 3. Dynamic and collaborative team tackling significant challenges We are looking for a Data Engineer (female or male) interested in working with the most modern technologies in decision engines, predictive analytics, and NLP, while simultaneously driving positive impact on financial empowerment in people's lives and in SMEs. Your Mission? Join our exceptional data team, which daily explores the uses and capabilities enabled by 239 million judicial processes already loaded into our data lake. You will be part of a dynamic, collaborative team committed to solving major internal company challenges. Key responsibilities include: * Developing and maintaining data pipelines; * Designing, developing, and maintaining a data lake responsible for delivering processed data to business systems and departments; * Monitoring data loading execution processes; * Monitoring data quality metrics delivered to end consumers; * Generating reports for business teams; * Focusing on proposing solutions that deliver value and resolve major data-related pain points faced by business teams. REQUIREMENTS * Experience with ETL, Data Modeling, and Data Architecture; * Proficiency in Python programming language (advanced); * Experience with Big Data technologies such as Spark (mandatory); * Experience with Airflow; * Experience with Data Lake architectures; * Experience with the following AWS services: SNS, SQS, Lambda, EMR, Redshift, S3, Glue, and Athena; * Experience working with Agile methodologies (SCRUM); * Proactivity and strong teamwork skills.. Position: SENIOR DATA ENGINEER \- SAO PAULO \| Salary: R$ 10\.000,00\. \| Education: Bachelor's Degree \- Bachelor's \| Teaching License \| Technology. \| Shift: Morning and Afternoon. \| Area: Information Technology. \| Experience: 6 months. \| City: São Paulo / SP