Browse
···
Log in / Register
Job Summary: We are seeking a Senior Data Engineer to develop and optimize robust data pipelines, ensuring scalability, quality, and governance in large-volume data environments. Key Highlights: 1. Leader in intelligence solutions for risk and opportunity analysis 2. Develop and maintain scalable and high-performance data pipelines 3. Participate in architectural decisions and the evolution of the data platform **Company Description** The Serasa Experian is Brazil's first and largest Datatech company. As a leader in intelligence solutions for risk and opportunity analysis, it focuses on credit journeys, authentication, and fraud prevention. Leveraging cutting-edge technology, innovation, and top-tier talent, it transforms risk uncertainty into the best decision—helping individuals achieve their dreams and enabling businesses of all sizes and sectors to thrive. We have 22,000 people operating across 32 countries, and every day we invest in new technologies, talented professionals, and innovation to help all our customers maximize every opportunity. With corporate headquarters in Dublin, Ireland, Experian is listed on the London Stock Exchange (EXPN) and is a constituent of the FTSE 100. **Job Description** We are looking for a Senior Data Engineer to work with large volumes of data. You will be responsible for developing, optimizing, and maintaining robust data pipelines, ensuring scalability, quality, and governance of the environment, while actively contributing to architectural evolution. **Key Responsibilities:** * Develop and maintain scalable and high-performance data pipelines. * Build solutions on Databricks (Spark/Delta Lake). * Ensure data quality, reliability, and observability. * Work with large volumes of structured and unstructured data. * Implement engineering best practices (testing, versioning, CI/CD). * Collaborate with Product, Analytics, Data Science, and Governance teams. * Participate in architectural decisions and the evolution of the data platform. **Technical Requirements:** * Solid experience as a Data Engineer in AWS/Databricks environments. * Strong knowledge of Python and PySpark. * Experience with Apache Spark Structured Streaming and Spark SQL for large-scale data processing. * Building and maintaining ingestion pipelines using **Autoloader** (incremental, schema evolution, throughput optimization). * Knowledge of Lakehouse / Data Lake architecture. * Create clear documentation of processes. * Version control with Git, version management, and Pull Requests. * Pipeline monitoring and troubleshooting. **Preferred Qualifications:** * Experience in the financial, credit, or anti-fraud sectors. * Knowledge of Delta Lake and performance optimization. * Experience with Data Quality and Data Governance. * Experience with event-driven architecture. * AWS certifications. * Knowledge of LGPD and regulated environments. **Behavioral Profile:** * Proactivity and ownership mindset. * Analytical capability and systemic vision. * Strong communication skills for interaction with technical and business areas. * Autonomy to propose architectural improvements. * Product-oriented mindset and value generation through data. **Qualifications** * Knowledge of Databricks * Knowledge of Python/PySpark * + Solid experience as a Data Engineer in AWS/Databricks environments * Bachelor’s degree in Engineering, Computer Science, Systems, or related fields **Additional Information** Serasa Experian is much more than you imagine. With the purpose of creating a better future by expanding opportunities for individuals and businesses, in Brazil we are over 4,000 people working across diverse teams and specialties. Here, every skill and diversity complements each other—you can work on what you love most. We are committed to building an inclusive culture and an environment where people can balance their careers with personal commitments and interests, prioritizing well-being. We dedicate ourselves to being one of the best and most innovative companies to work for in the country, offering incredible experiences and careers for our people. Our strong people-first approach is externally recognized through numerous market certifications: we were awarded Great Place To Work™ in 24 countries and received the international Top Employers certification, in addition to being recognized as one of the best companies for young professionals and holding a 4.6 rating on Glassdoor. Each recognition confirms we’re on the right path—providing an ever-better workplace for our talents. Experian Careers \- Creating a better tomorrow together Find out what it's like to work for Experian by clicking here
