IT Developer II

Description

Job Summary: The Data Engineer will work on building Data Pipelines for ingesting and delivering card-domain data into Santander Brasil's Corporate Data Lake, as part of an agile and strategic team. Key Highlights: 1. Working with Apache Spark and Databricks to optimize data pipelines 2. Developing and maintaining data transformation code using PySpark and Python 3. Familiarity with DevOps, Jenkins, Git, and agile methodologies IT Developer II Country: Brazil \# WHO WE ARE F1RST is the future—and your career starts here! Our culture is built upon "People, Innovation, and Results". We are part of the largest international bank in Brazil and one of the world’s largest banks, delivering services and experiences to over 60 million customers across the entire Santander ecosystem. Join the team whose purpose is to support people and help businesses thrive. We are passionate about technology. We are F1RST Digital Services. Follow us on LinkedIn to stay updated on all news: https://www.linkedin.com/company/f1rstdigitalservices We have an opening for you to become an **IT Developer II** **In this role, you will:** As a Data Engineer, you will collaborate with the Cards Domain Data Engineering team to build Data Pipelines for ingesting and delivering card-domain data into Santander Brasil’s Corporate Data Lake. You will work within an agile team on a strategic initiative and must possess expertise in Databricks and PySpark. **Required Skills** Databricks Proficiency: Experience working with Apache Spark on Databricks, including designing and optimizing data pipelines. PySpark, Python, and Kedro Experience: Strong programming skills in PySpark, Python, and Kedro for developing, debugging, and maintaining data transformation code. Batch and Streaming Data Processing: Knowledge of batch and streaming (messaging) data processing, with the ability to design, implement, and maintain data processing pipelines. DevOps Knowledge: Familiarity with Jenkins for continuous integration and delivery (CI/CD), as well as automation of deployment tasks and pipeline management. Git: Proficiency in Git for source code version control and effective collaboration within development teams. Agile Methodologies: Understanding of agile principles and practices—such as Kanban and Scrum—for effective collaboration and project management. Orchestration Tools (e.g., Control-M or others): Knowledge of process orchestration tools, important for scheduling and managing workflows. Microsoft Azure Knowledge: Experience with key Microsoft Azure data services, including Azure Databricks, Azure Data Factory, and Azure Storage Accounts. **Preferred Skills** AWS Knowledge: Experience with core AWS services such as Aurora PostgreSQL, CloudWatch, Lambda, and S3. On-Premises Environment Experience (Cloudera): Prior experience with Cloudera or other on-premises big data platforms—including Hadoop, HBase, and Hive—is desirable. Object-Oriented Development Knowledge: Familiarity with JAVA is highly beneficial (coding not required; reading and interpreting code is). Optional Certifications: AZ-900 (Microsoft Azure Fundamentals) and DP-900 (Microsoft Azure Data Fundamentals) certifications are preferred and demonstrate solid knowledge of the Azure platform and data concepts. **Work Location:** Geração Digital – Av Interlagos, 3501 – Interlagos, São Paulo \- SP \# BENEFITS: Meal Allowance; Health Insurance; Dental Insurance: Basic and Intermediate Plans; Transportation Voucher; Flexible Vacation: 24 business days of vacation, divisible into up to 6 periods; after every 2 months worked, you can enjoy 4 business days off; Birthday Day Off; Gym Partnerships: Wellhub, Totalpass; Flexible Working: Hybrid work model—2 days remote and 3 days onsite; Training Platforms with over 100,000 courses; Career Paths for professional development; Flexible Learning: Exclusive study incentive program for High-Performance employees; Childcare Allowance; Maternity and Extended Paternity Leave Programs. Life Insurance; Nascer Program; Be Healthy — A program encouraging healthier habits; PAPE — Specialized Personal Support Program; \#LI\-DNI