Senior Data Architect

Description

Job Summary: We are looking for an AI Data Engineer to join a team in constant growth and development to architect and implement Lakehouse solutions on Azure Databricks. Key Highlights: 1. Team in constant growth and development 2. Environment where you can be yourself 3. Direct contact with leadership of major companies At BIX, we are driven by passion for people and the conviction that the quality of our relationships and care for each individual are fundamental. We seek to onboard a professional who joins a team in constant growth and development. We believe in and encourage our team to collaborate, valuing teamwork and continuous improvement. **BIX is for everyone:** We believe innovation only emerges where plurality exists. Therefore, our job openings are open to all individuals. If you have a strong desire to learn and want an environment where you can be yourself, this is the place for you! **Required Technical Competencies** * **Fluent English** (direct contact with international clients); * **Lakehouse Architecture on Azure Databricks:** Experience designing Bronze/Silver/Gold layers, Delta Lake, table optimization, and data governance; * **Data Engineering:** Building pipelines with **PySpark and SparkSQL** (large-scale ingestion, transformation, and orchestration); * **AI/BI Genie Spaces (Databricks):** Best practices for building, configuring, and deploying Genie Spaces for *self\-service analytics*; * **Databricks Apps:** Developing applications incorporating Genie Spaces components and dashboard widgets; * **Metric Views:** Defining and maintaining business metric layers in Databricks; * **Unity Catalog:** Managing security, permissions, comments, and tagging of data assets; * **CI/CD:** Experience with Azure DevOps or GitHub Actions for deploying Genie Spaces and Databricks applications; * **LLM Ecosystem:** Solid knowledge of **LangChain, LangGraph, and LangSmith** for orchestrating agents and observing AI pipelines; * **RAG (Retrieval\-Augmented Generation) Implementation:** Designing pipelines with Vector Search and embeddings; * **Mosaic AI (Databricks):** Using native tools for fine\-tuning, model serving, and MLflow; * Minimum of **2 years of solid Python experience**. **Desirable Qualifications** * Databricks certifications (Data Engineer Associate/Professional or Generative AI Engineer); * Azure certifications (DP\-203, DP\-600, AI\-102 or similar); * Prior experience working with international clients; * Knowledge of probability, statistics, and traditional Machine Learning; * Bachelor's degree (completed or in progress) in Engineering, Computer Science, or related fields. **Your Day-to-Day Responsibilities** * **Architect and implement Lakehouse solutions** on Azure Databricks, defining ingestion and data-serving standards for *AI Readiness* initiatives; * **Build and maintain scalable data pipelines**, ensuring data quality, performance, and strict governance; * **Design and deploy AI/BI Genie Spaces, Databricks Apps, and Agents**, creating analytics interfaces and AI agents for end users; * **Implement Generative AI pipelines** using LangChain and Mosaic AI, including complex RAG solutions; * **Manage Unity Catalog**, focusing on compliance, security, and documentation of assets; * **Establish CI/CD workflows** to ensure continuous delivery of models and applications; * **Act in a consultative capacity:** Lead stakeholder meetings, gather requirements, challenge assumptions, and propose optimal technical architecture; * **Develop Proof of Concepts (PoCs)** and support preparation of technical commercial proposals. **What BIX Offers You** * 100% remote work; * Online therapy platform and nutritionist services; * Wellness platform (Gympass/TotalPass); * Accelerated career development path; * Direct contact with leadership of major companies; * Unique environment (BIX Hour, team events, Happy Hours, Mentoring Program, 1-on-1s); * Online English classes (Cambly).