SENIOR DATA ENGINEER - SAO PAULO

Description

Job Summary: We are seeking a Data Engineer to work with decision engines, predictive analytics, and NLP, driving positive impact on financial empowerment, and joining a dynamic and collaborative team. Key Highlights: 1. Positive impact on financial empowerment of individuals and SMEs 2. Work with decision engines, predictive analytics, and NLP 3. Development and maintenance of data pipelines and data lake We are looking for a Data Engineer (female or male) interested in working with cutting-edge technologies in decision engines, predictive analytics, and NLP, while simultaneously delivering positive impact on the financial empowerment of individuals and SMEs. Your Mission? Join our outstanding data team, which explores daily the uses and capabilities enabled by 239 million judicial processes already loaded into our data lake. You will be part of a dynamic, collaborative team committed to solving major company-wide challenges. Key responsibilities include: * Development and maintenance of data pipelines; * Design, development, and maintenance of a data lake, responsible for providing processed data for use by internal systems and business areas; * Monitoring of data loading execution processes; * Monitoring data quality metrics delivered to end consumers; * Generating reports for business teams; * Focusing on proposing solutions that deliver value and resolve major data-related pain points faced by business teams. REQUIREMENTS * Experience with ETL, Data Modeling, and Data Architecture; * Python programming language (advanced); * Experience with Big Data technologies such as Spark (mandatory); * Experience with Airflow; * Experience with Data Lake architectures; * Experience with the following AWS services: SNS, SQS, Lambda, EMR, Redshift, S3, Glue, and Athena; * Experience working with Agile methodologies (SCRUM); * Proactivity and teamwork orientation.. Position: SENIOR DATA ENGINEER \- SAO PAULO \| Salary: R$ 10\.000,00\. \| Education: Bachelor\'s degree \- Bachelor\'s \| Teaching License \| Technology. \| Shift: Morning and Afternoon. \| Area: Information Technology. \| Experience: 6 months. \| City: São Paulo / SP