Data Engineer – Azure Databricks

Description

**We are looking for a Data Engineer – Azure Databricks to join the Vetta Team!** You will be part of a team focused on developing and maintaining systems, always connected with your peers and colleagues. You will align work and requirements with managers and support the development team. **DO YOU ALREADY KNOW VETTA?** At Vetta, we believe technology and innovation are essential to building a more sustainable and efficient future for everyone. As a leader in industrial digitalization, our solutions help customers worldwide reduce energy consumption, improve operational efficiency, and support the energy transition through decarbonization. By joining our team, you will have the opportunity to work on **exciting and challenging projects alongside some of the industry’s top experts**. Additionally, you will become part of a dedicated team striving to generate a positive global impact and help our clients achieve their business goals. The Vetta Team understands the importance of teamwork and collaboration to deliver results that reach across the globe — while simultaneously **transforming each individual’s career.** **If you want to share your perspective toward a more sustainable world, join the Vetta Team!** **Responsibilities and Duties** **In this team, you will have the opportunity to:** * Develop, maintain, and optimize data pipelines in Azure Databricks environments. * Work with data ingestion, transformation, processing, and delivery for analytical or operational consumption. * Support data modeling and organization within Data Lake and Lakehouse-based architectures. * Develop notebooks, jobs, and processing routines using Databricks. * Integrate various data sources into the Azure environment, as required by the project. * Collaborate with technical and business teams to understand requirements and translate them into data solutions. * Support best practices in performance, governance, versioning, and technical documentation. **Requirements and Qualifications** **What we expect from you for this position:** * Practical experience with Azure Databricks. * Knowledge of Apache Spark / PySpark. * Experience with Python and/or SQL for data manipulation and transformation. * Familiarity with Azure data-related services, such as: Azure Data Lake Storage; Azure Data Factory; Azure Synapse Analytics; Azure SQL Database; Azure DevOps. * Understanding of Data Lake, Lakehouse, ETL/ELT, and data pipeline concepts. * Experience with code versioning, preferably Git. * Basic knowledge of security, access control, and cloud data governance. * Intermediate English proficiency. * Willingness to travel. **Nice-to-Have (Differentiators):** * Experience with Medallion Architecture: Bronze, Silver, and Gold layers. * Knowledge of Delta Lake. * Experience with automation, orchestration, and monitoring of pipelines. * Experience in industrial, manufacturing, energy, or highly operationally complex environments. * Knowledge of integration with enterprise systems, industrial historians, relational databases, or APIs. * Experience with CI/CD in data environments. **Additional Information** **OUR BENEFITS:** As a people-focused company, we constantly strive to value our team. When you join the Vetta Team, we offer: * **Flash Card** with **meal allowance/food voucher** of **R$ 32.00 per day**, accepted at numerous establishments for your convenience. * **Remote work allowance** of **R$ 100.00/month**, plus **flexible working hours**. * For your health and well-being, we provide **SulAmérica Health Insurance** and **Bradesco Dental Insurance**, with the option to include dependents. * **WellHub, TotalPass**, and **UniCamente**, to comprehensively support your health — including access to physical activities and professionals across various health fields. * **Onhappy**, a corporate and leisure travel platform offering exclusive discounts on accommodations, flights, and experiences — so you can enjoy rest and leisure moments more conveniently and economically. * **Guapeco Pet Health Plan**, to care for your best friend’s health and well-being, including access to consultations, exams, and other veterinary services. * **Discount and Rewards Club**, providing discounts across multiple product and service networks. * **Extended maternity and paternity leave**, enabling parents to experience this phase with peace of mind. * **Profit Sharing (PLR)** — according to union regulations. **AND MORE...** * **Birthday Day-Off.** * **No Dress Code.** Dress comfortably! * **Continuous Learning and Development Incentive Program**, supporting your ongoing learning and sharing of experiences. * Want to refer someone to Vetta? We have a **Talent Referral Program.** **Interested in joining our team? Apply now! We’d be thrilled to welcome you aboard.** **We are a global industrial digitalization company**, with two decades of experience in the sector, contributing to operational efficiency and **reducing energy and gas consumption through decarbonization**. We believe that, through **innovation and action**, we can make the world more sustainable and industrial processes more efficient. We operate jointly with SMS group, the global leader in the metals industry, and are responsible for developing digital solutions for our customers across more than 14 countries worldwide. Our solutions combine process expertise, artificial intelligence (AI) know-how, and software development capabilities to deliver cutting-edge optimization technologies. We aim to bring innovative solutions, seeking better ways to make industry and the future more sustainable through decarbonization. **Want to be part of this journey?** **\#VemSerVetta** *All our job openings are inclusive and open to everyone without distinction based on disability (PCD), race, color, religion, gender, nationality, or any other form of diversity.*