Senior Data Engineer | Data Platform

Description

**About Us** XP Inc. is one of Brazil's largest independent financial institutions, owning brands such as XP, Rico, Clear, XP Educação, InfoMoney, among others. With over 4.6 million active clients and assets under custody exceeding R$ 1.1 trillion, XP Inc. has been transforming the financial market for 24 years to improve people's lives. Guided by a distinctive culture anchored in four core values \- **Big Dreams, Entrepreneurial Spirit, Customer Focus, and Open Mind** \- XP Inc. continuously seeks top-tier talent driven by ambition to achieve the impossible. **About the Opportunity** ------------------------ This opportunity is for the Data Platform team, whose mission is to provide capabilities enabling scalability, efficiency, and quality across data discovery, processing, and usage stages. This is a team passionate about challenges, implementing cross-functional solutions designed to enable and maximize intelligent, continuous value delivery — to the business and to our customers — through data. **What We’re Looking For** -------------------- **Essential Requirements:** * Programming Languages: Experience with programming languages relevant to data engineering, such as Apache Spark, Python, PySpark, or SQL, for data manipulation, analysis, and transformation. * ETL and Data Pipelines: Knowledge of extraction, transformation, and loading (ETL) processes, and experience building and maintaining efficient, scalable batch and streaming data pipelines. * Databases and Data Storage: Familiarity with various database types (relational and non-relational) and data storage solutions (e.g., Data Lakes), including best practices and techniques for data management and access. * Azure Cloud Knowledge: Familiarity with Microsoft Azure cloud platform, including services and features related to data management and analytics. * Databricks Experience: Proficiency working with Databricks’ unified analytics environment, leveraging its capabilities for processing and analyzing large-scale data volumes. * CI/CD concepts and practices; * Residency in São Paulo and availability to work in a hybrid model (2 days per week onsite) **Nice-to-Haves:** * Knowledge of data governance and data quality principles and practices, including metadata management and data security; * Experience with Data Mesh; * Experience using Delta Lake; * In-depth knowledge of Azure data analytics solutions; * Experience with Apache Airflow; * Experience designing and implementing CI/CD pipelines in Azure DevOps; **Challenges and Impact** ---------------------- * Implement policies, processes, and tools for data definition, accountability, and democratization; * Actively participate in key architectural decisions across the organization, ensuring clear communication with architects and other software and data engineers; * Lead and facilitate discussions on data architecture and tooling adoption via ADRs and RFCs, aiming for optimal solutions within the XP ecosystem; * Promote a data quality culture by providing technical capabilities, defining problem-resolution processes, and guiding implementation of controls across current data assets; * Enhance data capture and ingestion capabilities, ensuring security, governance, scalability, and process monitoring; * Evolve the data platform’s capabilities so applications can orchestrate and process data safely, scalably, and monitorably — both in batch and streaming modes; * Enable secure, scalable, and monitored consumption of information by other technology applications and end users; * Collaborate with engineering and architecture teams to ensure and advance the company’s Data Mesh strategy; * Participate in enterprise-wide data governance best practices alongside other departments; * **Process Steps** * **Initial Screening**: Resume review to assess alignment with role qualifications and requirements. * **General Assessments**: Evaluation of cultural fit via Mindsight assessment and logical reasoning test from Predictive Index. * **Video Interview**: An opportunity to get to know each other better and understand your motivations and experiences. * **Recruitment Team Interview**: Discussion regarding expectations for the role and professional objectives. * **Technical Assessment**: Interview focused on specific skills required for the position. * **Leadership Interview**: A conversation to explore your vision and how you can contribute to the team and company. * **Peer Interview**: Interaction with future colleagues to evaluate synergy and teamwork. * **Culture-Focused Interview**: Exploration of company values and principles to ensure strong cultural alignment. * **Offer**: Presentation of the employment proposal, including details on compensation and benefits. **Benefits:** Health and Well-being: * Health insurance * Dental insurance * Wellhub (Gympass) * Zenklub * Life insurance * iFood Benefits (flexible VA and VR) * Transportation allowance * New Value (benefits club) * Parental leave: 6-month maternity leave and 20-day paternity leave * Childcare assistance Financial Life * Exclusive investment funds * Investment advisory services * Annual-fee-free XP Visa Infinite card * Credit solutions (payroll-deductible loans, home equity loans, real estate CCB, etc.) **Flexible Onsite Work Model** Our work model varies by function — fully onsite for business-facing roles and more flexible for other teams. We follow a model with higher onsite frequency, always guided by flexibility and autonomy, aligned with our entrepreneurial culture. At XP Inc., we value face-to-face interactions and believe the office serves as a tool to strengthen workplace relationships. * *By proceeding with your application, you declare that you have read, understood, and agree to the Privacy Policy of XP Inc. Group and its vendors and partners supporting the selection process. XP Inc. Group may use artificial intelligence solutions to assist the recruitment team throughout the process, which may involve processing your personal data for this purpose, in accordance with the General Data Protection Law and XP Inc. Group’s Privacy Policy.*