Senior Data Engineer

Description

Job Summary: We are seeking a Data Engineer to design, build, and maintain robust and scalable data pipelines, ensuring reliable and efficient access to information for data-driven decision-making. Key Highlights: 1. Brivia's partner in digital transformation, technology, and marketing 2. Data Engineer responsible for robust and scalable data pipelines 3. Collaborate with business and data science teams **We seek a professional to act as a partner to Brivia.** A Data Engineer responsible for designing, building, and maintaining robust and scalable data pipelines that support analytical initiatives. You will handle data integration, transformation, and delivery of high-quality data, ensuring that business and data science teams have reliable and efficient access to the information needed for evidence-based decision-making. We are an ecosystem specialized in brand transformation, helping our clients overcome challenges in digital transformation, technology, and marketing. To achieve this, we continuously expand our capabilities by bringing together top specialists across diverse fields. Brivia_Group wants your talent to further strengthen our digital transformation ecosystem! **Key Responsibilities** * Design, develop, and maintain data ingestion, transformation, and loading (ETL) pipelines, ensuring high availability and reliability; * Build and evolve the team's data architecture, including data lakes, data warehouses, and analytical data structures; * Implement data monitoring, alerting, and quality control processes to ensure data consistency and integrity; * Collaborate with data scientists and analysts to develop datasets and features for machine learning models and exploratory analyses; * Develop and optimize complex SQL queries and large-scale processing routines; * Support integration of internal and external data sources, including APIs, legacy systems, and third-party platforms; * Document processes, data flows, and technical architectures to promote traceability and governance; * Identify and implement improvements in Business Intelligence and Big Data processes, ensuring engineering best practices; * Collaborate with technology teams on defining and standardizing data infrastructure; * Support the data team in building reports by providing structured and reliable data layers; * Actively participate in agile ceremonies and processes, contributing technical estimates and planning. **Academic Qualifications** * Completed or ongoing undergraduate degree in Computer Science, Software Engineering, Information Systems, Statistics, or related fields with a strong technical and quantitative foundation. **Technical Skills** * Proficiency in Python for data engineering (pandas, PySpark, SQLAlchemy, Airflow, etc.); * Advanced SQL and experience with relational and analytical databases (PostgreSQL, BigQuery, Redshift, Snowflake, or similar); * Experience with pipeline orchestration tools (Apache Airflow, Prefect, Luigi, or equivalents); * Knowledge of data lake and data warehouse architectures (dimensional modeling, bronze/silver/gold layers); * Familiarity with cloud computing platforms (AWS, GCP, or Azure) and associated data services; * Knowledge of data quality practices, version control (dbt, Git), and CI/CD applied to pipelines; * Familiarity with streaming and real-time processing (Kafka, Spark Streaming, or similar) is a plus. **Additional Information:** * Contract type: PJ (active CNPJ required). * Personal equipment required. * **Availability for in-person meetings in Porto Alegre/RS.** Join a dynamic ecosystem and be part of the market revolution!