Job Summary: We are seeking a Databricks Specialist Data Engineer to design, develop, and maintain distributed data pipelines, driving innovation in data solutions. Key Highlights: 1. Collaborate in cross-functional teams and support professionals. 2. Design and optimize ETL/ELT processes with a focus on performance. 3. Participate in the architecture of data solutions built on Azure. ### **Join South System and take off!** We are looking for a Databricks Specialist Data Engineer to board our spaceship and together drive people and businesses forward through innovation. #### **Location: Remote** **Responsibilities:** * Design, develop, and maintain distributed data pipelines using Databricks (Spark). * Work with structured and semi-structured data in ADLS Gen2, Delta Lake, APIs, and relational databases. * Build and optimize ETL/ELT processes with a focus on performance and reusability. * Participate in the architecture of data solutions based on the Azure Data Platform (Databricks, Data Factory, Event Hubs). * Implement security policies, governance, and versioning (Unity Catalog, Purview, RBAC). * Automate deployments and orchestrations using Azure DevOps or similar tools. * Ensure observability — logs, alerts, metrics, and pipeline traceability. Collaborate with cross-functional teams and support less experienced professionals. * **Required Qualifications:** * Experience with Databricks and Apache Spark for distributed processing. * Proficiency in Python, SQL, and/or Scala for pipeline development. * Experience building and maintaining high-performance ETL/ELT processes. * Solid knowledge of data modeling and data structures. * Familiarity with the Azure Data Platform (Databricks, Data Factory, Event Hubs, ADLS). * Experience with security, governance, and compliance practices (Unity Catalog, RBAC, Purview). * Ability to work in agile teams, participating in ceremonies and managing work via Azure/Jira. **Nice-to-Have:** Experience in **mission-critical**, large-scale, or high-volume environments. Experience in the **financial sector** (banks, payment acquirers, payments). Additional knowledge of **Java** or other backend languages. Experience with **Power BI** and reconciliation solutions featuring automated alerts. Relevant certifications: **Azure Data Engineer**, **Databricks Professional Data Engineer**, etc. Experience with **Grafana** or other monitoring tools. **Benefits That Make a Difference:** * Courses and certifications on **Udemy**, curated and guided by the Business Partner team based on team recommendations. * **Remote work allowance** to make your daily routine more comfortable. * **Financial education** to support your economic well-being. * **Flash Card.** Interested in this opportunity? Now we want to continue showing why joining South is so special: * We are recognized by our people: we have been named **twice one of the best companies to work for in Brazil (GPTW)**, and hold a **4.9 rating** on **Glassdoor and Indeed**. * We were awarded at the **LinkedIn Talent Awards**. * We are committed to the future: we are **carbon neutral**, offsetting 100% of our carbon emissions. * We operate with **remote and hybrid work models**, depending on the role and project. Our Culture: * We value **continuous growth and development.** * We foster a culture rooted in **respect, collaboration, and loyalty.** * We are **diverse, inclusive, and believe in the power of pluralism across our teams.** * We deliver technology solutions with **innovation and real impact.**