Senior Data Engineer (Databricks | ADF | AI) | SR (Remote)

Description

. **Responsibilities and Assignments** * Perform data modeling using technologies such as Databricks, SAP Datasphere, Data Factory, Azure Data Lake Storage (ADLS), Python, and databases (SQL Server, Oracle); * Work on extracting data from monthly received files; design and build a data lake containing data and tables; * Structure RAG for customer debt contracts and other documents related to loan agreements; * Perform ETL from CXL APIs and transform and process them into a database in Databricks to feed CXL quotations; * Structure data tables in Databricks for Judicial Deposits, Financial Guarantees, and Real Guarantees; * Develop ETL for analysis of structured and unstructured data, using the client’s chat API to analyze files and validate data; * Structure the Position Manager data product and create reports to replace CXL’s Crystal Reports; **Requirements and Qualifications** **Requirements:** * Experience with Databricks, SAP Datasphere, Data Factory, Azure Data Lake Storage (ADLS), and databases (SQL Server, Oracle) * Ability to analyze business requirements to assist Architects in structuring and detailing requirements; * Knowledge of ETL tools and data modeling; * Ability to assist in defining requirements; * Proven experience with Python; * Creation and publication of APIs; * Knowledge of DevOps; * Minimum of 4 years of documented professional experience, with an academic degree in IT or a postgraduate degree in IT with 360 recognized hours; **Preferred Qualifications:** * Knowledge of SAP Datasphere; * Knowledge of TIBCO Datasphere; * Knowledge of KNIME; * Knowledge of PowerCenter; * Knowledge of SAP PowerDesigner; Compass UOL is a global firm and part of the AI Revolution Company, together transforming organizations using Artificial Intelligence, Generative AI, and other of today’s most advanced technologies. We equip our team with proprietary and external AI\-driven tools to design and build digital\-native platforms, integrating cutting\-edge technologies and enabling companies to innovate, transform their businesses, and drive success in their markets. To achieve this, we attract and develop the best talent, creating opportunities that enhance people’s lives and highlight the positive impact of disruptive technologies. We empower borderless talent and promote knowledge and opportunities in the latest market trends, driving significant personal and professional growth. **Join us and be part of the AI\-driven revolution.**