Job Summary: We are seeking a Data Engineering Specialist II to lead the evolution of the DataLab’s data infrastructure, building scalable architectures and transforming data into competitive advantage. Key Highlights: 1. Lead the evolution of data infrastructure 2. Build scalable and resilient Data Lake architectures 3. Serve as a technical reference and mentor for the team Data Engineering Specialist II Full-time Contract Type: Regular Work Model: Hybrid Department: Information Technology & Systems Working Period: Full Time **Company Description** ------------------------ Experian is a global data and technology company, powering opportunities for people and businesses around the world. We help to redefine lending practices, uncover and prevent fraud, simplify healthcare, create marketing solutions, and gain deeper insights into the automotive market, all using our unique combination of data, analytics and software. We also assist millions of people to realize their financial goals and help them save time and money. We operate across a range of markets, from financial services to healthcare, automotive, agribusiness, insurance, and many more industry segments. We invest in people and new advanced technologies to unlock the power of data. As a FTSE 100 Index company listed on the London Stock Exchange (EXPN), we have a team of 22,500 people across 32 countries. Our corporate headquarters are in Dublin, Ireland. Learn more at experianplc.com. **Job Description** ------------------------ The DataLab is Experian Group’s research and innovation unit in Latin America, operating alongside Serasa Experian in Brazil. Our goal is to be proactive—anticipating the future—and consultative—identifying market evolution opportunities—through Artificial Intelligence and Machine Learning techniques combined with new data sources. We develop advanced, innovative solutions that help clients and the market prepare today for tomorrow’s more accurate decisions. In addition, we adopt a 360-degree perspective, collaborating with the best global practices, considering the whole picture, and delivering solutions capable of achieving high scalability. We are looking for an analytical and experienced professional to lead the evolution of our data infrastructure. You will be the key player in building scalable architectures, ensuring our data is not only stored but transformed into competitive advantage. **Key Responsibilities** * Data Lake Architecture: Design, implement, and maintain modern Data Lake and Lakehouse architectures, ensuring scalability, resilience, and cost-effectiveness. * Data Pipelines (ETL/ELT): Build and optimize real-time (streaming) and batch data ingestion workflows, ensuring data integrity and low-latency information delivery. * Governance and Quality: Establish Data Quality standards, data lineage, and security/privacy policies (LGPD) across the entire ecosystem. * Technical Mentorship: Serve as a technical reference for the team, promoting best development practices (Clean Code, CI/CD) and supporting resolution of complex problems. * Performance Optimization: Identify bottlenecks in large-volume data processing and propose structural improvements to enhance query and job performance. **Requirements and Qualifications** * Proven Experience: Minimum of 7 years of direct experience in Data Engineering, with a track record in highly complex, large-scale cloud environments (preferably AWS). * Tool Proficiency: Advanced experience with Apache Spark (PySpark/Scala) and workflow orchestrators (e.g., Airflow, Prefect, or Dagster). * Programming Languages: Fluency in Python or Scala, plus strong SQL proficiency for data manipulation and analysis. * Data Modeling: Knowledge of dimensional modeling techniques. * Infrastructure as Code (IaC): Familiarity with Terraform or similar tools for provisioning data infrastructure resources. * Agile Mindset: Familiarity with agile methodologies and DevOps culture applied to data (DataOps). **Qualifications** ----------------- * Robust experience in Data Engineering * Apache Spark * Python or Scala **Additional Information** -------------------------- Our uniqueness is that we celebrate yours. Experian's culture and people are important differentiators. We take our people agenda very seriously and focus on what matters; DEI, work/life balance, development, authenticity, collaboration, wellness, reward & recognition, volunteering... the list goes on. Experian's people first approach is award-winning; World's Best Workplaces™ 2024 (Fortune Top 25), Great Place To Work™ in 24 countries, and Glassdoor Best Places to Work 2024 to name a few. Check out Experian Life on social or our Careers Site to understand why. Experian is proud to be an Equal Opportunity and Affirmative Action employer. Innovation is an important part of Experian's DNA and practices, and our diverse workforce drives our success. Everyone can succeed at Experian and bring their whole self to work, irrespective of their gender, ethnicity, religion, colour, sexuality, physical ability or age. If you have a disability or special need that requires accommodation, please let us know at the earliest opportunity. Experian Careers - Creating a better tomorrow together **Job Location** -----------------