Data Engineer

Description

We are **Credsystem**. For over 20 years, we have created opportunities for you to achieve more and more. Side by side with those who make retail happen every day, we have become experts in your business. We cultivate relationships and pave the way for success. Everything to help you get closer to your customers — in a straightforward, open, and authentic way. We are constantly **innovating** to explore diverse solutions and offer new possibilities for retail. With agility, technology, and renewal — both internally and externally. Who said you can’t solve simple problems by thinking big? Innovate by leveraging what you already know? Grow toward the future while valuing the present? **Join us to make new achievements possible!** **Responsibilities and Duties** **What will your day-to-day look like?** We are seeking a senior Data Engineering professional experienced in implementing complex projects using Databricks. **Key Responsibilities and Scope:** * Data Pipeline Development: Design and maintain ETL (Extract, Transform, Load) processes to move data from various sources into data warehouses/data lakes. * Infrastructure and Database Management: Design and implement scalable databases (relational and NoSQL), ensuring security, performance, and data integrity. * Big Data and Distributed Processing: Manage large volumes of data using distributed processing tools — essential for enterprises handling high volumes of information. * Cloud Computing and Automation: Implement cloud-based solutions (AWS, Azure, GCP) and automate workflows (IaC/DevOps). * Collaboration and Structuring: Work with analytics teams to understand business needs, ensuring data is ready for dashboards and AI models. **Requirements and Qualifications** **What do we expect from you?** High proficiency in Spark, Delta Tables, Python, SQL, and Git, with solid hands-on experience in Databricks. Databricks Professional certification; knowledge of DABs, DLT, Spark Structured Streaming, Delta Sharing, and MLFlow; experience configuring agents using LangChain or similar Python frameworks; plus experience in the financial sector. **Additional Information** Company located in Alphaville \- Barueri **Remote Work Model** We are always focused on delivering the best experience for our Credsysters: **Learn more:** Meal and food allowance. Health insurance (for you and your dependents). Dental insurance (for you and your dependents). Two monthly psychological counseling sessions (at no cost). Nutritionist consultation (fully covered by Credsystem). Gympass (to support your health and well-being). Well-being Moment (weekly massage sessions to help you stay relaxed). Life insurance. Variable compensation, based on your position and goal achievement. University tuition discounts (to advance your career further). Language school partnership (to develop and enhance your second language). Birthday day off. Payroll-deductible loan. Transportation allowance, shuttle service, or parking. Childcare assistance. SESC benefits. Who said you can’t solve simple problems by thinking big? Innovate by leveraging what you already know? Grow toward the future while valuing the present? We are **Credsystem**. For over 20 years, we have created opportunities for you to achieve more and more. We cultivate relationships and pave the way for success — in a straightforward, open, and authentic way. We work every day to make new achievements possible. And we want you by our side on this journey! **Ready to explore our opportunities?**