···
Log in / Register
8EE2: Senior Data Engineer
Indeed
Full-time
Onsite
No experience limit
No degree limit
Praça do Patriarca, 62 - Centro Histórico de São Paulo, São Paulo - SP, 01002-010, Brazil
Favourites
Share
Some content was automatically translatedView Original
Description

**1\.****SUMMARY DESCRIPTION:** * Responsible for designing, implementing, and optimizing data pipelines for collecting, ingesting, transforming, and storing large volumes of data, ensuring solutions are secure, scalable, and oriented toward generating strategic insights. Works on building a robust infrastructure to support complex analytics and data-driven decision-making. **2\.****DETAILED DESCRIPTION:** * **Data Integration and Collection:** Aggregates structured, semi-structured, and unstructured data from diverse sources (databases, APIs, files); * **Real-Time and Batch Data Ingestion:** Implements pipelines for real-time (streaming) and batch ingestion, ensuring efficient and secure transfer to the Data Lake; * **Data Processing and Transformation:** Builds pipelines to transform raw data through standardization, deduplication, filtering, and enrichment processes; * **Pipeline Orchestration and Automation:** Defines and manages pipeline orchestration to ensure automated executions according to schedules; * **Monitoring and Alerts:** Creates and monitors alerts and logs for process continuity, enabling rapid response to failures; * **Performance Optimization:** Adjusts pipelines to reduce costs and improve operational efficiency; * **Documentation:** Documents processes and solutions, facilitating understanding and ongoing maintenance of solutions. **3\.****JOB SPECIFICATIONS:** **3\.1\.****EDUCATION:** * Bachelor’s degree in Information Technology fields, such as Information Systems, Computer Science, or Computer Engineering. **3\.2\.****EXPERIENCE:** * 5 to 8 years of experience in Data Engineering or similar roles; * Proficiency in SQL and at least one programming language, such as Python, Scala, or Java; * Experience with ETL/ELT (including tools such as Apache NiFi, PowerCenter, among others) and workflow orchestration (e.g., Apache Airflow); * Knowledge of Cloud Computing environments (AWS, Azure, GCP), with focus on data storage and processing solutions; * Experience with Data Lake and Data Warehouse architectures, including data modeling and data pipeline optimization; * Ability to monitor and troubleshoot production environment processes; * Knowledge of CI/CD and DevOps practices; * Microsoft Office suite. **4\.****REQUIRED INSTITUTIONAL PROFESSIONAL COMPETENCIES:** * **Proactivity:** Anticipate issues to achieve results**;** * **Flexibility:** Adapt quickly to new technologies and processes**;** * **Teamwork:** Collaborate effectively with multidisciplinary teams**;** * **Commitment:** Assume responsibility and commitment to assigned tasks**.** **4\.1****REQUIRED SPECIFIC COMPETENCIES – BEHAVIORAL** * **Analytical Thinking:** Analyze complex problems and identify strategic solutions; * **Curiosity:** Continuously seek improvement and ongoing learning. **4\.2****REQUIRED SPECIFIC COMPETENCIES – TECHNICAL** **Organization and Planning \-** Plan and prioritize actions to ensure efficiency in task execution. **5\.****RESULT ACCOUNTABILITY** * Executes and maintains data pipelines with quality and efficiency, ensuring compliance with organizational standards and objectives, performing process maintenance and upholding performance standards. **6\.****AUTONOMY** * Operates with a high degree of autonomy to optimize and adjust processes, receiving periodic supervision and feedback from leadership.

Source:  indeed View original post
João Silva
Indeed · HR

Company

Indeed
Cookie
Cookie Settings
Our Apps
Download
Download on the
APP Store
Download
Get it on
Google Play
© 2025 Servanan International Pte. Ltd.