Senior Data Engineer

Description

Job Summary: A Data Engineering professional to design, build, and maintain robust data pipelines, ensuring data quality and governance for strategic insights. Key Highlights: 1. Build a scalable and resilient platform, democratizing access to data. 2. Design, build, and maintain efficient and secure data pipelines. 3. Collaborate with multidisciplinary teams and promote best practices. The data engineering team ensures the organization has access to reliable and well-organized data, enabling the generation of insights and strategic and operational decision-making. As an agent of transformation, you will build a scalable and resilient platform, democratize access to data, and drive a data-driven culture. Job Mission: Design, build, and maintain data pipelines, ensuring information flows efficiently and securely. Guarantee data availability, quality, and governance. Work closely with stakeholders and teams to promote best practices in handling, analyzing large volumes of data, and optimizing processes. **Responsibilities and Duties** * Design, build, and maintain robust and scalable data pipelines for ingestion, processing, and transformation of large volumes of data; * Develop and optimize data models for analytical systems; * Implement and manage storage solutions, including data lakes and data warehouses, in cloud environments; * Ensure data integrity, quality, and governance by applying sound management, security, and FinOps practices; * Collaborate with multidisciplinary teams to understand business requirements and deliver data-driven solutions; * Monitor and optimize pipeline, database, and integration solution performance; * Lead data architecture modernization initiatives using cutting-edge technologies and modern frameworks. **Requirements and Qualifications** * Bachelor’s degree in Computer Science, Software Engineering, Information Systems, or related fields; or Master’s degree in related areas; * Proven experience with data visualization platforms (Tableau, Power BI, and/or Looker); * Experience with GCP and its services: BigQuery, Cloud Composer, Apache Airflow, Dataflow, Pub/Sub, Cloud Run, Cloud Functions, KMS, Secret Manager; * Databases: Knowledge of data modeling, relational databases (e.g., Oracle, SQL Server, PostgreSQL), and non-relational databases (e.g., MongoDB, Cassandra); * ETL/ELT: Experience building ETL/ELT pipelines for data ingestion and transformation. **Desirable Knowledge** * Cloud Computing; * Experience with Azure and its services, such as Azure Data Factory, Azure Synapse Analytics, and Azure Data Lake Storage; * Programming Languages: Proficiency in Python and PySpark (used for scripting and automation) and SQL (for data manipulation and querying); * Data Lakes: Knowledge of Data Lake architectures, data storage, and optimization (e.g., Delta Lake); * DevOps: Experience with CI/CD pipelines and DataOps practices for automating deployments and monitoring data flows; * Security and Governance: Understanding of cloud security practices, data encryption, and implementation of governance policies; * Data Orchestration: Use of tools such as Azure Data Factory and/or Synapse and/or Airflow/Composer for data integration and movement; * Performance and Optimization: Experience with techniques to improve data pipeline and query performance in distributed and non-distributed environments; * APIs: Knowledge of extracting data via RESTful APIs. **Technical Competencies** * Ability to design scalable and resilient data pipelines. * Mastery of Agile and DevOps methodologies for continuous integration and delivery. * Strong ability to efficiently and creatively solve complex data problems. **Behavioral Competencies** * Analytical and results-oriented thinking. * Excellent communication skills to translate technical and business needs. * Proactivity and sense of urgency to address critical demands. * Teamwork and collaborative leadership capabilities. * Commitment to continuous learning and technological updating. **Additional Information** **And more — check out our benefits package:** * Health and Dental Insurance – Bradesco – extendable to dependents * PAE – Financial assistance provided for dependent children and/or stepchildren with intellectual disabilities * Pharmacy Benefits Program – Discounts up to 85% * Supplementary Pension Plan – FlexPrev Plan – ranging from 1% to 11%, depending on salary * Life Insurance – coverage for all employees starting on their hire date, at no cost * Extended Leave – Maternity Leave (total of 180 days) and Paternity Leave (total of 20 days) * Meal and/or Food Allowance – Caju Benefits * Educational Assistance – For dependents up to high school level * TotalPass * Solar Subscription – Opportunity to obtain special discounts on electricity bills through enrollment in a distributed generation plan * Smiles Corporate Club – Up to 50% discount on available plans for your travel planning. Also available for spouse and children aged 18+. * Service Length Bonus – We offer employees a salary bonus (based on tenure) paid during vacation time. **And for our teams’ development...** * Learning Platform: Value-based learning path and renowned curation featuring over 200 courses available anytime. * Internal Recruitment: Posting of open positions across Brazil, encouraging internal mobility. **Who We Are?** We are Vibra, a young company that was born large — **one of the five largest companies in Brazil**, with a diversified and global investor base. **With over 50 years of experience** and a competent, committed team, we serve more than **30 million people** who visit our **8,000+ service stations**, nationwide, through our distributors; and **26,000 corporate clients.** Here, we value **pace** in delivering **results**, and **respect** in relationships. We **listen** empathetically and **deliver** with agility. We act with **ownership** and **collaborate** to make things happen. We speak with **transparency**, act with **integrity**, and **honor our commitments.**