Senior Data Engineering Developer | Databricks

Description

Job Summary: We are seeking a Senior Data Engineering Developer to transform data challenges into scalable solutions, contributing to data architecture and digital innovation. Key Highlights: 1. Collaborative environment focused on continuous learning 2. Opportunity to make a real impact on meaningful projects 3. Work side by side with experts across different domains Job Description At Avanade, we seek a **Senior Data Engineering Developer** with solid experience in the **Databricks Platform**, capable of transforming complex data challenges into scalable, high-impact solutions. This person will operate strategically and hands\-on, directly contributing to the evolution of our clients’ data architecture and supporting digital innovation and transformation initiatives. Their work will strengthen our ability to deliver intelligent, secure, and results-oriented solutions. Here, you’ll find a collaborative, diverse, and continuously learning environment. It’s an opportunity to make a real impact on meaningful projects, grow professionally, and work side by side with experts across different domains. **Together we do what matters.** **Learn more about some of our benefits:** * Meal or food allowance * Multibenefit Card (up to Senior Consultant) * Medical and dental insurance * Certifications and training * Life insurance * Private pension plan * **Avababy:** pregnancy support and welcome kit for new parents * Company profit-sharing program * Wellhub * Childcare assistance * Career mentoring * **Birthday Off Policy** (for you and children up to age 12) * Well-being sessions * **For managerial roles:** company vehicle, parking allowance, and fuel assistance **Responsibilities:** ---------------------- * Design, develop, and maintain ETL/ELT data pipelines using Databricks * Process large volumes of data with Apache Spark (PySpark) * Create, manage, and optimize tables using Delta Lake * Implement data engineering best practices with focus on performance, scalability, and cost-efficiency * Automate and orchestrate jobs and workflows in Databricks * Analyze and optimize Spark queries and pipelines * Ensure data quality, integrity, and governance * Participate in data platform architecture decisions and evolution * Collaborate with BI, Analytics, Data Science, and Cloud teams * Perform troubleshooting and resolve complex incidents * Document technical solutions and share best practices with the team. Qualification **Skills and Experience:** * Solid experience as a **Data Engineer** or **Data Engineering Developer** * Strong expertise in the **Databricks Platform** * Advanced experience with **Apache Spark (** **PySpark** **)** * Excellent knowledge of **SQL** * Practical experience with **Delta Lake** * Experience in **Cloud environments (Azure, AWS, or GCP)** * Experience with Data Lakes (ADLS, S3 or