Job Summary: We are seeking a Data Engineer to work with large volumes of data, developing and optimizing pipelines in a scalable environment using Apache Spark/Python and Databricks. Key Highlights: 1. Working with large volumes of data in a highly scalable environment. 2. Developing and optimizing data ingestion pipelines. 3. Using Apache Spark/Python on Databricks. Senior Data Engineer Full-time Employee Status: Regular Role Type: Hybrid Department: Technology Schedule: Full Time **Company Description** ----------------------- Serasa Experian is the first and largest Datatech company in Brazil. A leader in risk and opportunity intelligence solutions, focused on credit, authentication, and fraud prevention journeys. With cutting-edge technology, innovation, and top talent, it transforms risk uncertainty into the best decision—helping individuals achieve their dreams and businesses of all sizes and sectors thrive. We have 22,000 people operating across 32 countries, and every day we invest in new technologies, talented professionals, and innovation to help all our clients maximize every opportunity. Headquartered in Dublin, Ireland, Experian is listed on the London Stock Exchange (EXPN) and is a constituent of the FTSE 100. **Job Description** ------------------- We are looking for a Data Engineer to work with **large volumes of data** in a highly scalable environment, primarily using **Apache Spark/Python** on **Databricks**. This professional will be responsible for developing, optimizing, and maintaining data ingestion pipelines, with a focus on modern and efficient architectures. Key responsibilities include: * Building and maintaining data ingestion pipelines using **Autoloader** (incremental, schema evolution, throughput optimization). * Processing large-scale data using **Spark Structured Streaming** and **Spark SQL**. * Implementing data engineering best practices, such as partitioning and Delta Lake optimization. * Version control using Git and managing pull requests. * Analyzing, improving, and optimizing costs and performance on Databricks. * Implementing Data Quality. * Creating clear documentation for requirements. * Collaborating with business and analytics teams to ensure data is structured and securely available. **Qualifications** ------------------ * Degree in Computer Science, Information Systems, or Engineering. * Knowledge of AWS and Databricks. **Additional Information** -------------------------- Serasa Experian is much more than you imagine. With the purpose of creating a better future by expanding opportunities for individuals and businesses, in Brazil we are over 4,000 people working across diverse teams and specialties. Here, every skill and diversity complements each other—you can work on what you love most. We are committed to building an inclusive culture and an environment where people can balance their careers with personal commitments and interests, prioritizing well-being. We dedicate ourselves to becoming one of the best and most innovative companies to work for in the country, enabling incredible experiences and careers for our people. Our strong people-first approach is externally recognized through multiple market certifications: we’ve been awarded by Great Place To Work™ in 24 countries and certified internationally as a Top Employer, recognized as one of the best companies for young professionals, and hold a 4.6 rating on Glassdoor. Each recognition confirms we’re on the right path—providing an increasingly better workplace for our talents. Experian Careers \- Creating a better tomorrow together **Job Location** ---------------- I'm interested Privacy Policy Cookies Settings