SENIOR DATA ENGINEER - SAO PAULO

Description

Job Summary: We are seeking a Data Engineer to join an innovative team, working with decision engines, predictive analytics, and NLP, positively impacting the financial empowerment of individuals and SMEs. Key Highlights: 1. Working with decision engines, predictive analytics, and NLP 2. Positively impacting financial empowerment 3. Developing and maintaining data pipelines and data lake We are looking for a Data Engineer (female or male) interested in working with the most modern technologies in decision engines, predictive analytics, and NLP, while simultaneously driving positive impact on the financial empowerment of individuals and SMEs. Your Mission? Join our outstanding data team, which explores daily the uses and capabilities enabled by 239 million judicial processes already loaded into our data lake. You will be part of a dynamic, collaborative team committed to solving major internal company challenges. Key responsibilities include: * Developing and maintaining data pipelines; * Designing, developing, and maintaining a data lake responsible for delivering processed data to business systems and departments; * Monitoring data loading execution processes; * Monitoring data quality metrics delivered to end consumers; * Generating reports for business teams; * Focusing on proposing solutions that deliver value and resolve major business team pain points related to data. REQUIREMENTS * Experience with ETL, Data Modeling, and Data Architecture; * Python programming language (advanced); * Experience with Big Data technologies such as Spark (mandatory); * Experience with AirFlow; * Experience with Data Lake architectures; * Experience with the following AWS services: SNS, SQS, Lambda, EMR, Redshift, S3, Glue, and Athena; * Experience working with Agile methodologies (SCRUM); * Proactivity and teamwork orientation.. Position: SENIOR DATA ENGINEER \- SAO PAULO \| Salary: R$ 10\.000,00\. \| Education: Bachelor's degree \- Bachelor \| Teaching license \| Technology. \| Shift: Morning and Afternoon. \| Area: Information Technology. \| Experience: 6 months. \| City: São Paulo / SP