Data Services - Databricks Solution Architect

Description

**Job Description**: **Job Description** We are seeking a Solutions Architect with strong experience in Databricks to define, configure, and optimize our analytics platform—ensuring best practices, governance, cost efficiency, and scalable architecture. This person will collaborate directly with Infrastructure, Data, FinOps, and Security teams, supporting technical decisions and helping shape the platform’s operational model. **Responsibilities** * Lead the configuration, organization, and governance of the Databricks Workspace, with emphasis on cost optimization, security, and architectural best practices. * Guide and support internal teams on billing, resource consumption, and cost-reduction strategies (FinOps applied to Databricks). * Define and implement architectural standards for data pipelines, notebooks, clusters, jobs, and catalogs. * Collaborate with Infrastructure and Security teams to design hybrid and multicloud architectures (AWS and OCI). * Support technical decisions related to storage, processing, workload optimization, and cluster tuning. * Evaluate, design, and implement integrations between Databricks and enterprise systems (databases, APIs, Data Lake, CRM, etc.). * Ensure data engineering best practices—including data quality, versioning, governance, and pipeline monitoring. * Support engineering and analytics squads in adopting the platform and its advanced capabilities. **Technical Requirements** * Solid hands-on experience with Databricks (clusters, jobs, Unity Catalog, Lakehouse, billing, optimization). * Practical knowledge of AWS (S3, EC2, IAM, Glue, policies, security) and Terraform. * Experience with OCI (a relevant plus). * Strong proficiency in SQL, PySpark, and best practices for distributed modeling and processing. * Knowledge of data architectures (Data Lake, Data Warehouse, Lakehouse). * Experience with version control tools (Git), CI/CD, and monitoring. * Understanding of FinOps practices and cloud resource optimization. * Experience in enterprise environments and data platform migration or modernization projects. **Nice-to-Haves** * Databricks, AWS, or similar certifications. * Experience integrating across multiple cloud providers. * Knowledge of information security applied to data (IAM, PIM, governance). Experience in SAS-to-Databricks or similar migration projects. **Desired Profile** * Proactive, systems-thinking mindset with focus on efficiency. * Strong communication skills to guide both technical and executive teams. * Ability to collaborate effectively across multiple company departments. * Analytical, solution-oriented profile. **Location** São Paulo, SP, BR