···
Log in / Register
Senior Data Engineer
Indeed
Full-time
Onsite
No experience limit
No degree limit
Praça do Patriarca, 62 - Centro Histórico de São Paulo, São Paulo - SP, 01002-010, Brazil
Favourites
Share
Some content was automatically translatedView Original
Description

Job Summary: Work as a Senior Data Engineer, responsible for creating and maintaining data infrastructure, ensuring the collection, storage, organization, and security of large volumes of information. Key Highlights: 1. Creation and management of data infrastructure for large volumes. 2. Development and maintenance of efficient data pipelines. 3. Collaboration with analytics and data science teams. **Job Description:** **About the Company:** A Brazilian electricity market operator focused on enabling a competitive, sustainable, and secure trading environment. It promotes discussions and proposes solutions for the development of the national electricity sector, acting as an intermediary between market participants and policy-making and regulatory bodies. The institution’s primary focus is the evolution of the electricity trading segment, guided by neutrality, liquidity, and information symmetry. **Requirements:** **Profile:** Senior Data Engineer **Professional Experience:** Work within the team as a Data Engineer—i.e., responsible for building the pipeline that transforms raw data from various sources—including transactional databases and text files—into a format suitable for data scientists to begin their work. The Data Engineer must ensure this pipeline remains operational to collect data at the right time and with the required level of enterprise security. Minimum of 4 years’ proven experience as a Data Engineer. What We Expect: As a Data Engineer, create and manage the infrastructure required to collect, store, organize, and deliver large volumes of data. The professional is responsible for designing and managing data collection systems, ensuring data integration and accessibility, optimizing analytical workflows, decision-making processes, and development. In addition to structuring data infrastructure, the professional integrates information to optimize access and utilization of datasets. This process involves applying relational and non-relational methodologies, programming languages (e.g., Python, SQL, etc.), and big data tools. Candidates must be available for travel to attend occasional in-person project meetings. Hard Skills We Seek... Map requirements through interaction with key users and other organizational analysts; Identify and record metadata in a dedicated tool for data governance; Develop and maintain efficient data pipelines; design data flows that extract, transform, and load data from diverse sources; Ensure data security and integrity; implement security measures to protect sensitive data and guarantee compliance with regulations such as LGPD; Identify trends and patterns within datasets; Identify new opportunities for process improvement; Collaborate with analytics and data science teams; work closely with analysts and data scientists to understand data needs and implement effective solutions; build tools to facilitate data manipulation and analysis; Optimize database queries and performance; improve query efficiency and ensure data systems operate optimally; guarantee data system efficiency and scalability; Monitor and resolve data infrastructure issues; ensure data systems remain continuously available and fully functional; maintain and monitor data pipelines to guarantee reliability; identify and correct failures and bottlenecks in data systems; Proficiency in Python for scripting, ETL, and data integration. SQL essential for data manipulation and querying. Knowledge of NiFi and Airflow technologies; familiarity with Data Lake concepts. Experience with database management systems; ability to design and maintain efficient databases. Organizational skills to manage large volumes of data and critical processes. Understanding of data security practices; knowledge of how to protect data against unauthorized access and ensure compliance with regulations. Teamwork capability; ability to collaborate with other professionals and communicate ideas clearly. Critical thinking and curiosity to explore data. Organization and time management; And the Soft Skills We Observe... Dynamic and agile; Team-oriented; Time management; Analytical ability; Attention to detail; **Education:** Technical courses in relevant technologies or platforms; or Computer Science, Computer Engineering, Data Engineering, or related fields: A solid educational foundation in Information Technology. **Languages:** Fluent Portuguese and technical English for reading

Source:  indeed View original post
João Silva
Indeed · HR

Company

Indeed
Cookie
Cookie Settings
Our Apps
Download
Download on the
APP Store
Download
Get it on
Google Play
© 2025 Servanan International Pte. Ltd.