···
Log in / Register
Senior Data Engineer
Indeed
Full-time
Onsite
No experience limit
No degree limit
Fairy Lake - Estr. Dom Pedro Augusto - Alto da Boa Vista, Rio de Janeiro - RJ, 20531, Brazil
Favourites
Share
Some content was automatically translatedView Original
Description

Description: * Bachelor's degree required; * Knowledge of technologies, solutions, and concepts related to Big Data; * Proficiency in at least one programming language; * Familiarity with Git code versioning; * Understanding of the data lifecycle and concepts such as data lineage, governance, privacy, retention, anonymization, etc.; * Collaborative mindset with Data Science and Analytics teams, and business teams to understand and meet data needs; * Excellent communication skills, proactive sharing, and contextual inquiry to collaborate effectively across different teams. Differentiators: * Experience developing and maintaining ETL pipelines to process large volumes of data, ensuring data quality and integrity; * Proficiency in Python; * Knowledge of GCP cloud services: Storage Transfer Service, Cloud Storage, Cloud Functions, Pub/Sub, DataFlow, BigQuery, Dataplex, Cloud Computer; * Experience with Apache Airflow or other data workflow tools; * Experience with columnar storage solutions and/or data lakehouse concepts; * Knowledge of CI/CD strategies, infrastructure as code (Terraform), observability, and related practices; * Understanding of how optimization works across various scenarios and how it can be improved, including query performance, service scalability, and cluster management; * Curiosity about rapidly evolving technologies in the data engineering domain and eagerness to learn and master them, bringing significant impact to our team. * Develop systems and processes to collect data from diverse sources such as databases, applications, sensors, and devices; * Design and maintain databases and data storage systems, including relational and non-relational databases; * Prepare and clean collected data to ensure readiness for analysis, involving transformation, aggregation, and standardization; * Integrate data from multiple sources into a unified data environment, ensuring data consistency and integrity; * Build and maintain data pipelines that automate data transfer and transformation efficiently; * Implement security measures to protect data against unauthorized access and leaks; * Collaborate to provide datasets ready for analysis; * Monitor data system performance and optimize scalability and efficiency; * Maintain comprehensive and up-to-date documentation of processes, data flows, and system architecture. 2511180202461113370

Source:  indeed View original post
João Silva
Indeed · HR

Company

Indeed
Cookie
Cookie Settings
Our Apps
Download
Download on the
APP Store
Download
Get it on
Google Play
© 2025 Servanan International Pte. Ltd.