SRE Databricks Senior

Description

Leega is a company focused on delivering efficient and innovative service to its clients. This could not be any different with our primary fuel: people! Our culture is inspiring, and our values are present in everyday life: ethics and transparency, quality excellence, teamwork, economic, social and environmental responsibility, human relationships, and credibility. We seek innovative professionals who are driven by challenges and results-oriented. If you are looking for a dynamic, collaborative company that invests in its employees through continuous training, Leega is the place for you! **>> LEEGA IS FOR EVERYONE — we would be thrilled to welcome you to our team. Join us in shaping our story and building our future.** Apply now to our open positions! **Responsibilities and Duties** We are seeking a Senior professional to work as a Data Infrastructure Engineer, focusing on building, automating, and governing the company’s data platform on Google Cloud Platform (GCP) and Databricks. This role is central to ensuring secure, scalable, and reproducible environments, with a strong culture of Infrastructure as Code (IaC), DevOps, and GitOps. The professional will be responsible for provisioning and maintaining all infrastructure supporting the data platform — from networks and IAM on GCP to workspaces and clusters on Databricks — ensuring automation, security, and operational efficiency. **Responsibilities** Infrastructure as Code (IaC) * Create, maintain, and evolve Terraform modules for data infrastructure provisioning. * Manage state management, workspaces, and infrastructure versioning best practices. * Ensure infrastructure is reproducible, auditable, and traceable via code. **Google Cloud Platform (GCP)** * Provision and manage networks (VPC, subnets, firewall rules) following security best practices. * Configure IAM: roles, policies, and service accounts adhering to the principle of least privilege. * Manage Google Cloud Storage (GCS) as the data platform’s storage layer. * Ensure compliance with cloud security and governance policies. **Databricks** * Provision and configure Databricks workspaces via Terraform/IaC. * Manage clusters, jobs, notebooks, and permissions on the platform. * Integrate Databricks with GCP infrastructure (service accounts, VPC, GCS, IAM). **CI/CD & GitOps** * Build and maintain CI/CD pipelines for infrastructure (e.g., GitHub Actions or similar). * Apply GitOps practices: all infrastructure changes via Pull Request with review and automated validation. * Ensure secure and auditable deployments across multiple environments (dev/staging/prod). **Security & Automation** * Implement secret and credential management following best practices (Secret Manager, Vault, etc.). * Automate and standardize environments to ensure consistency and eliminate manual configurations. * Support the data team with reliable, self-service infrastructure. **Requirements and Qualifications** **Mandatory** * Infrastructure as Code (IaC): Terraform with modules, state management, and best practices. * Google Cloud Platform (GCP): VPC, subnets, firewall rules, IAM (roles, policies, service accounts), GCS. * Databricks: workspace provisioning, cluster, job, and notebook management. * Version control with Git and GitOps practices. * CI/CD pipelines (GitHub Actions, GitLab CI, Azure DevOps, or similar). * Cloud security: IAM, secrets, access policies, and compliance. * Automation and standardization of data environments. **Desirable / Differentiators** * BigQuery: modeling, optimization, and integration with the data platform. \[**DIFFERENTIATOR**] * Apache Spark / PySpark for distributed processing. \[**DIFFERENTIATOR**] * Delta Lake and Lakehouse architecture. \[**DIFFERENTIATOR**] * Knowledge of Data Engineering and data pipelines (ETL/ELT). \[**PLUS**] * Kubernetes (GKE) for workload orchestration. \[**PLUS**] * FinOps: cloud cost optimization, rightsizing, reservations. \[**PLUS**] * Other IaC tools: Pulumi, Cloud Deployment Manager. \[**PLUS**] * Observability: monitoring, logging, and alerting (Cloud Monitoring, Datadog, etc.). \[**PLUS**] **Additional Information** **At our company, you’ll find a collaborative environment and a benefits package designed to support your growth, health, and quality of life. Below are the benefits we offer:** **Porto Seguro Health Insurance** Comprehensive care for you and your family, with the option to include spouse and children. **Porto Seguro Dental Insurance** Dental protection for you and your dependents. **Profit and Results Sharing (PLR)** Recognition for your work and contribution to the company’s success. **Childcare Allowance** Financial support enabling parents to care for their children with peace of mind. **Alelo Meal and Food Vouchers** Ensuring practical and comfortable meals throughout your day. **Home Office Allowance** Financial incentive to help you set up a comfortable remote workspace. **Partnerships with Educational Institutions** Accessible education, with discounts and incentives for courses and degree programs. **Certification Incentive, including Cloud Certifications** Advance your career with certifications in leading technologies such as GCP, Azure, AWS, and others. **Livelo Points** Accumulate points and redeem them freely, according to your preference. **TotalPass** Health incentive offering discounted gym memberships for employees and family members. **Mindself** Incentive to improve quality of life through meditation and mindfulness. **Temporary project until December, with potential extension into 2027.** At Leega, we don’t just deliver lines of code or dashboards. We transform complex technological challenges into real impact. With over 15 years of experience, we combine deep human insight with the speed of Artificial Intelligence to build solutions that transform businesses — and, above all, improve people’s lives. We are a strategic, technology-agnostic consulting firm. With offices in Brazil and Europe, our team of over 580 multidisciplinary talents lives and breathes the Data Analytics, Cloud, and AI ecosystem. We master the full foundation — from Governance to Engineering — to ensure technology is not merely a tool, but a sustainable competitive advantage for the market’s top players.