Data Engineering Specialist II – Tech Lead

Description

Job Summary: We are seeking a Data Engineering Specialist with strong experience as a Tech Lead and Architect, capable of leading the technical evolution of our Lakehouse. Key Highlights: 1. Lead the technical evolution of the Lakehouse 2. Disseminate engineering practices and support business units 3. Promote sound technical choices in Databricks, Delta Lake, Spark, and AWS Data Engineering Specialist II – Tech Lead Full\-time Employee Status: Regular Role Type: Home Department: Technology Schedule: Full Time **Company Description** ----------------------- Serasa Experian is Brazil's first and largest Datatech company. A leader in intelligence solutions for risk and opportunity analysis, focused on credit journeys, authentication, and fraud prevention. With cutting-edge technology, innovation, and top talent, we transform risk uncertainty into the best decision—helping individuals achieve their dreams and businesses of all sizes and sectors thrive. We have 22\.000 people operating across 32 countries, and every day we invest in new technologies, talented professionals, and innovation to help all customers maximize every opportunity. Headquartered in Dublin, Ireland, Experian is listed on the London Stock Exchange (EXPN) and is a constituent of the FTSE 100\. **Job Description** ------------------- The Data Platform & MLOps Directorate at Serasa Experian is responsible for building and evolving the platform that supports large-scale data products and solutions, delivering modern, secure, and highly reliable infrastructure. We work with Lakehouse architecture, powered by Databricks \+ AWS, operating under a Data Mesh model enabling autonomy and distributed governance for data products. We are seeking a Data Engineering Specialist with strong experience as a Tech Lead and Architect, capable of leading the technical evolution of our Lakehouse, disseminating engineering practices, and supporting multiple business units in building scalable and resilient data products. Responsibilities Platform Architecture and Evolution * Define and evolve the enterprise Lakehouse architecture, ensuring scalability, security, governance, and high performance. * Establish standards, templates, and best practices for Data Mesh, supporting domains in building data products. * Promote sound technical choices involving Databricks, Delta Lake, Spark, AWS, and modern data ecosystems. * Define architectural references for batch and streaming pipelines, including best practices for orchestration, versioning, monitoring, resilience, and optimization. Technical Leadership * Guide and mentor data engineers, influencing critical decisions and elevating the organization’s technical capability. * Conduct technical reviews (architecture, code, standards, pipeline design). * Serve as an internal consultant to business units, ensuring optimal understanding of solutions and promoting technological consistency across teams. Development and Maintenance * Design and develop robust, scalable pipelines in Python, Scala, SQL, or Java within the Databricks and/or AWS ecosystem. * Build real-time ingestion solutions using Spark Structured Streaming, Delta Live Tables, Kafka/Kinesis, or similar tools. * Ensure observability (monitoring, alerts, metrics) and data quality across all stages of the data chain. * Work with governance and security tools such as AWS Lake Formation, **Unity Catalog**, and corporate IAM standards. Multidisciplinary Collaboration * Collaborate with business units, partners, vendors, and third parties to ensure technical alignment, architectural clarity, and effective execution. * Facilitate discovery, design, and implementation support for data products aligned with the Data Mesh strategy. * Translate business needs into scalable, sustainable technical solutions. Evangelism and Knowledge Sharing * Disseminate knowledge about Lakehouse, Data Mesh, and batch/streaming pipelines. * Lead workshops, reference guides, mentoring, and internal technical communities. * Promote a modern data culture and engineering best practices across the organization. **Qualifications** ------------------ Required Qualifications * Advanced English proficiency for collaboration with Experian teams in other countries; * Solid experience as a data engineer, architect, or tech lead in large-scale environments. * Proficiency in Databricks (Spark, Delta Lake, workflows, cluster management). * Hands-on experience with AWS (S3, IAM, Glue, Lambda, Lake Formation, etc.). * Strong knowledge of Python, **SQL**, Scala, and/or Java. * Experience building batch and streaming pipelines. * Experience with Data Mesh, Lakehouse, distributed governance, and data products. * Technical leadership ability, influence, and clear communication skills. * Experience with CI/CD, versioning, data architecture, and engineering best practices. Preferred Qualifications * Databricks or AWS certifications. * Familiarity with Unity Catalog, **Lake** Formation, or other data governance tools. * Experience with event-driven architectures (Kafka, Kinesis). * Experience with Spark optimization and performance frameworks. Behavioral Profile * Proactive, solution-oriented mindset. * Ability to lead and influence multiple teams in complex environments. * Collaborative approach and strong communication with both technical and business areas. * Curiosity, autonomy, and commitment to sharing best practices. * Strategic vision with focus on delivery and innovation. **Additional Information** -------------------------- Serasa Experian is much more than you imagine. With the purpose of creating a better future by expanding opportunities for individuals and businesses, in Brazil we are over 4,000 people working across diverse teams and specialties. Here, every skill and form of diversity complements one another, and you can work on what you love most. We are committed to building an inclusive culture and an environment where people can balance their careers with personal commitments and interests—prioritizing well-being. We dedicate ourselves to being one of the best and most innovative companies to work for in the country, enabling incredible experiences and careers for our people. Our strong people-first approach is externally recognized through numerous market certifications: we’ve been awarded by Great Place To Work™ in 24 countries and received the international Top Employers certification, in addition to being recognized as one of the best companies for young professionals and holding a 4.6 rating on Glassdoor. Each recognition confirms we’re on the right path—providing an ever-better workplace for our talent. Experian Careers \- Creating a better tomorrow together **Job Location** ---------------- I'm interested Privacy Notice Cookies Settings