AI Data Engineer

Description

Job Summary: We are seeking a professional to design and evolve a governed, scalable, self-service data ingestion platform leveraging automation and AI agents. Key Highlights: 1. Leadership in evolving an AI-powered data ingestion platform 2. Development of intelligent and scalable ingestion pipelines 3. Collaboration with engineering, analytics, and data science teams We are Grupo Casas Bahia, with over 70 years of history, fulfilling the dreams of \+100 million Brazilians. Here, we are always leaders — consistently acting with integrity and ethics in everything we do. Our passion for our people drives us forward, and our total dedication to customers is our daily commitment. We deliver results and constantly strive for simplicity in all that we do! We are looking for a candidate to work fully remotely as part of our Technology team. This person will play a pivotal role in designing and evolving a governed, scalable, self-service data ingestion platform powered by automation and AI agents, as well as orchestrating and optimizing large-scale data capture. **Responsibilities and Duties** * Design and develop the next-generation data ingestion platform. * Integrate AI agents for automation and orchestration. * Build and maintain intelligent ingestion pipelines (ETL/ELT). * Ensure pipelines are scalable, reusable, and resilient. * Research, prototype, and implement new AI technologies. * Continuously optimize ingestion processes. * Integrate diverse data sources (APIs, databases, events, SaaS, files). * Automate data integration processes. * Ensure data quality, reliability, and observability. * Apply anomaly detection techniques. * Implement intelligent data validation. * Define an AI-driven data ingestion architecture. * Establish best practices for data ingestion. * Collaborate with engineering, analytics, data science, and product teams. * Develop high-impact business solutions. **Requirements and Qualifications** * Experience with Databricks (Jobs, Clusters, Unity Catalog). * Strong experience building data ingestion pipelines (ETL/ELT). * Knowledge of batch and streaming data processing (e.g., Kafka, Spark Streaming). * Experience with distributed processing tools such as Spark. * Experience with cloud platforms (AWS, Azure, or GCP). * Familiarity with workflow orchestrators (e.g., Airflow, Dagster). * Knowledge of databases (SQL and NoSQL) and data modeling. * Familiarity with data governance practices (catalog, lineage, security). * Critical thinking and ability to creatively solve complex problems. * Excellent communication skills and ability to influence technical decisions. * Curiosity, innovation, and continuous learning. * Leadership, autonomy, and strong sense of responsibility. **It would be great if you had:** * Prior experience building internal data platforms focused on automation and self-service. * Experience developing AI agents or RAG (Retrieval-Augmented Generation)-based systems. * Knowledge of LLMs (Large Language Models) and related frameworks (e.g., LangChain, LlamaIndex). * Experience with event-driven architecture and large-scale streaming tools (Kafka, Kinesis, etc.). * Experience with DataOps and data observability practices. * Knowledge of Infrastructure as Code (e.g., Terraform). **Additional Information** **Work Location:** Brazil \- Remote. **Check out some amazing benefits we've prepared to ensure your well-being and quality of life:** * **PLR/Bonus**: Extra recognition to value your effort and dedication! * **Medical and Dental Assistance**: So you have full security and care for your health and your family's. * **Meal Voucher**: Because we know quality nutrition is essential for your daily routine! * **Life Insurance**: Peace of mind and protection for you and your loved ones. * **Extended Maternity Leave**: 180 days for our moms to enjoy this special moment with their baby! * **Extended Paternity Leave**: 20 days so fathers can also be present during their child's early days. * **Incentive for Physical Activity**: Access Wellhub (Gympass) and Total Pass to take care of your health and keep your body moving. * **Transportation Allowance**: To ensure your commute to work is stress-free and worry-free. * **SESC Partnership**: Enjoy incredible benefits in culture, leisure, health, and more! * **Discount Club**: Enjoy discounts of up to 70% on products and services with over 2\.000 partners across Brazil and Latin America! * **Birthday Day-Off**: Celebrate your special day with peace and joy — you're entitled to a day off on your birthday! * **Pharmacy Discounts**: Exclusive discounts on medications to help you save on healthcare! Our commitment is to provide not just a workplace, but an experience that values and cares for you as a person! We’re here to support your personal and professional growth. \#VEMPROGRUPOCASASBAHIA. All our opportunities are open to both **internal and external applicants**. **Employees**, please don’t forget to review our internal recruitment policy on **Service Now** to check program requirements and principles. *Grupo Casas Bahia is one of Brazil’s most iconic companies, with a rich history spanning decades. Its journey is marked by resilience, innovation, and unwavering dedication to you! Our commitment is tireless; our drive to deliver solutions and engage face-to-face makes us human.* *We are over 30,000 employees, operating Brazil’s largest and most digital logistics network — connected to over 1,000 physical stores and 29 distribution centers and delivery hubs — all designed for our 200+ million customers.* *If you’re driven by passion, simplicity, transformation, and the same dedication we have to you and all Brazilians, welcome — feel at home and explore career opportunities at Grupo Casas Bahia.*