Data Engineering Specialist II – Tech Lead

Description

Job Summary: We are seeking a Data Engineering Specialist with experience as a Tech Lead and Architect to lead the evolution of our Lakehouse platform and support the development of scalable data products. Key Highlights: 1. Technical leadership in Lakehouse evolution and dissemination of best practices. 2. Work with Lakehouse architecture, Databricks + AWS, and the Data Mesh model. 3. Development of robust pipelines in Python, Scala, SQL, or Java. **Company Description** Serasa Experian is Brazil’s first and largest Datatech company. A leader in risk and opportunity intelligence solutions, focused on credit journeys, authentication, and fraud prevention. Leveraging cutting-edge technology, innovation, and top talent, we transform risk uncertainty into the best decision—helping individuals achieve their dreams and enabling businesses of all sizes and sectors to thrive. We have 22\.000 people operating across 32 countries, and every day we invest in new technologies, talented professionals, and innovation to help all our customers maximize every opportunity. With corporate headquarters in Dublin, Ireland, Experian is listed on the London Stock Exchange (EXPN) and is a constituent of the FTSE 100\. **Job Description** The Data Platform & MLOps Directorate at Serasa Experian is responsible for building and evolving the platform that supports large-scale data products and solutions, delivering modern, secure, and highly reliable infrastructure. We work with Lakehouse architecture powered by Databricks \+ AWS, operating under a Data Mesh model that enables autonomy and distributed governance for data products. We are looking for a Data Engineering Specialist with strong experience as a Tech Lead and Architect, capable of technically leading our Lakehouse evolution, disseminating engineering best practices, and supporting multiple business units in building scalable and resilient data products. Responsibilities Platform Architecture and Evolution * Define and evolve the enterprise Lakehouse architecture, ensuring scalability, security, governance, and high performance. * Develop standards, templates, and best practices for Data Mesh, supporting domains in building data products. * Promote sound technical decisions involving Databricks, Delta Lake, Spark, AWS, and modern data ecosystems. * Define architectural references for batch and streaming pipelines, including best practices for orchestration, versioning, monitoring, resilience, and optimization. Technical Leadership * Guide and mentor data engineers, influencing critical decisions and elevating the organization’s technical maturity. * Conduct technical reviews (architecture, code, standards, pipeline design). * Serve as an internal consultant to business units, ensuring optimal understanding of solutions and promoting technological consistency across teams. Development and Maintenance * Design and develop robust and scalable pipelines in Python, Scala, SQL, or Java within the Databricks and/or AWS ecosystem. * Build real-time ingestion solutions using Spark Structured Streaming, Delta Live Tables, Kafka/Kinesis, or similar tools. * Ensure observability (monitoring, alerts, metrics) and data quality across all stages of the data chain. * Work with governance and security tools such as AWS Lake Formation, **Unity Catalog**, and corporate IAM standards. Multidisciplinary Collaboration * Engage with business units, partners, vendors, and third parties to ensure technical alignment, architectural clarity, and effective execution. * Facilitate discovery, design, and implementation support for data products aligned with the Data Mesh strategy. * Translate business needs into scalable and sustainable technical solutions. Evangelism and Dissemination * Promote knowledge about Lakehouse, Data Mesh, and batch/streaming pipelines. * Lead workshops, reference guides, mentoring, and internal technical communities. * Foster a modern data culture and engineering best practices across the organization. **Qualifications** Required Qualifications * Advanced English proficiency for collaboration with Experian teams in other countries; * Solid experience as a data engineer, architect, or tech lead in large-scale environments. * Proficiency in Databricks (Spark, Delta Lake, workflows, cluster management). * Practical experience with AWS (S3, IAM, Glue, Lambda, Lake Formation, among others). * Strong knowledge of Python, **SQL**, Scala, and/or Java. * Experience building batch and streaming pipelines. * Hands-on experience with Data Mesh, Lakehouse, distributed governance, and data products. * Technical leadership ability, influence, and clear communication skills. * Experience with CI/CD, versioning, data architecture, and engineering best practices. Preferred Qualifications * Databricks or AWS certifications. * Knowledge of Unity Catalog, **Lake** Formation, or other data governance tools. * Experience with event-driven architectures (Kafka, Kinesis). * Experience with Spark optimization and performance frameworks. Behavioral Profile * Proactive, solution-oriented mindset. * Ability to lead and influence multiple teams in complex environments. * Collaborative approach and strong communication with both technical and business areas. * Curiosity, autonomy, and commitment to sharing best practices. * Strategic vision with focus on delivery and innovation. **Additional Information** Serasa Experian is much more than you imagine. With a mission to create a better future by expanding opportunities for individuals and businesses, in Brazil we are over 4,000 people working across diverse teams and specialties. Here, each skill and perspective complements the others—you can work on what you love most. We are committed to building an inclusive culture and an environment where people can balance their careers with personal commitments and interests, prioritizing well-being. We strive to be one of the best and most innovative companies to work for in the country, offering incredible experiences and careers for our people. Our strong people-first approach is externally recognized through numerous market certifications: we were awarded Great Place To Work™ in 24 countries and received the international Top Employers certification, in addition to being recognized as one of the best companies for young professionals and maintaining a 4.6 rating on Glassdoor. Each recognition confirms we’re on the right path—providing an ever-better workplace for our talents. Experian Careers \- Creating a better tomorrow together Find out what it's like to work for Experian by clicking here