Senior Databricks Data Engineer

Description

We are looking for a **Senior Data Engineer** with solid experience in **Databricks**, to work on the construction, evolution, and maintenance of modern data solutions in high-volume and complex environments. We are seeking a professional with strong technical knowledge, architectural vision, and a focus on quality, performance, and scalability. The professional will work with multidisciplinary teams to create pipelines, process data, and make data available for analytical consumption and other business solutions. If you have experience with modern data ecosystems, enjoy technical challenges, and have mastery of **Databricks**, this opportunity may be for you! **Responsibilities and attributes** * Develop, maintain, and optimize **data pipelines (ETL/ELT)** using Databricks; * Build data processing solutions using **Apache Spark and PySpark**; * Work with large volumes of data, ensuring **performance, scalability, and reliability**; * Develop and maintain data ingestion, transformation, and availability processes; * Act in the construction and evolution of **Data Lake and Lakehouse** architectures; * Develop and optimize queries using **SQL**; * Implement best practices for **data quality, governance, and security**; * Perform performance analysis and optimization of jobs, pipelines, and queries; * Support technical and architectural definitions related to the data platform; * Implement monitoring and failure handling processes in pipelines; * Work with code versioning and **CI/CD** processes; * Participate in agile ceremonies and work collaboratively with Data Engineering, Analytics, Architecture, and business areas; * Technically support team members, contributing to best practices and the evolution of solutions. **Requirements and qualifications** * Solid experience as a **Data Engineer**, preferably at the Senior level; * Proven experience with **Databricks**; * Mastery of **Apache Spark and PySpark**; * Advanced experience with **SQL**; * Knowledge of **Delta Lake**; * Experience in building and maintaining **ETL/ELT** pipelines; * Knowledge of **Data Lake, Lakehouse, and/or Data Warehouse** architectures; * Experience with large-volume data processing; * Knowledge of data modeling and transformation; * Experience with **Git and CI/CD practices**; * Knowledge of security, governance, and data quality best practices; * Ability to perform performance analysis and pipeline troubleshooting; * Analytical, collaborative profile with autonomy to lead technical demands **Desirable:** --------------- * Experience with **Databricks Unity Catalog**; * Knowledge of **Databricks Workflows/Jobs**; * Experience with **Medallion Architecture (Bronze, Silver, and Gold)**; * Knowledge of **Python** for Data Engineering; * Experience with data services on **AWS, Azure, or GCP**; * Knowledge of orchestration tools, such as **Apache Airflow or Azure Data Factory**; * Experience with infrastructure as code, such as **Terraform**; * Certifications related to **Databricks** or Cloud platforms; * Experience in high-volume environments and critical data solutions. **Additional information** * Food allowance and/or Meal voucher; * Sesi and Sesc partnership, offering access to health, well\-being, and leisure services; * Partnership with Educational Institutions, with exclusive discounts on courses and educational programs; * Possibility of growth within the company and participation in strategic projects; * Opportunity to work for a company in the market in full expansion. Extractta was born with the purpose of transforming technology into real results for companies in various segments. Throughout our journey, we have consolidated ourselves as an innovation and technology consultancy that unites strategy, people, and digital solutions to support organizations in their growth and transformation challenges. We operate in different fronts, from innovation and digital transformation to project and operations management, supporting companies to achieve exceptional results through efficiency, process intelligence, and continuous adaptation. We also stand out for our specialized consultancy that helps our partners evolve in digital culture, communication, data, and new technologies, in addition to establishing global partnerships that allow us to bring the best solutions to our clients' ecosystem, all with a specialized team! At Extractta, we believe the differentiator lies in people. Therefore, we invest in a collaborative, innovative, and open environment where every talent has space to learn, grow, and be part of challenging projects that truly transform businesses. If you are looking for a company in constant evolution, passionate about technology, and that values the development of its employees, your place may be here. Join Extractta and come build the future with us.