Senior Data Engineer

Description

Job Summary: Tegra is seeking a Senior Data Engineer to build and evolve our data infrastructure, creating scalable pipelines and collaborating with data scientists and product teams. Key Highlights: 1. Build and maintain scalable data pipelines using Apache Airflow and Spark 2. Collaboraborate with data scientists to prepare data for ML models 3. Collaborative environment with autonomy and space for ideas ABOUT THE ROLE Do you enjoy building bridges between raw data and intelligent decisions? Are you energized by working with large volumes of data, complex pipelines, and diverse data sources? Tegra is looking for a Senior Data Engineer to build and evolve our data infrastructure. You will design scalable pipelines, ingest data from public and private APIs, and collaborate directly with data scientists and product teams. ABOUT TEGRA We are a technology company specializing in custom digital solutions for enterprises seeking efficiency, innovation, and sustainable growth. We work closely with clients, foster a collaborative culture, and focus on high-quality delivery. We value autonomy, continuous learning, and career development in an environment that encourages knowledge sharing, responsibility, and proactive ownership. YOUR KEY RESPONSIBILITIES Build and maintain scalable data pipelines using Apache Airflow and Spark; Ingest, transform, and enrich data from public APIs (e.g., IBGE, IPEA) and internal sources; Develop indexing and search solutions using ElasticSearch for large-scale analysis; Collaborate with data scientists to prepare data for Machine Learning models; Ensure data quality, traceability, and governance across the pipeline; Monitor and optimize Spark job performance in distributed environments; Document data architectures and ingestion flows for the technical team. WHAT WE LOOK FOR IN YOU Proficiency in Python for data processing and manipulation; Experience with Apache Airflow for orchestrating data pipelines; Knowledge of Apache Spark (PySpark) for distributed processing; **Familiarity with ElasticSearch:** indexing, DSL queries, and log analysis; Experience consuming REST APIs, especially IBGE and IPEA; Basic understanding of Machine Learning and feature set preparation for predictive models. ADDITIONAL ASSETS Experience with Delta Lake or Apache Iceberg; Knowledge of cloud platforms (e.g., AWS Glue, EMR, S3 or equivalents); Familiarity with dbt for analytical transformations; Experience with Kafka or other data streaming systems; Contributions to or projects involving open government data from Brazil. WHAT WE OFFER Competitive compensation aligned with market standards; Structured onboarding and close mentorship during your initial period; Collaborative environment with autonomy and space for ideas; Performance bonuses and internal development initiatives; Meal reimbursement for in-office days; Opportunity to contribute to impactful projects with real business impact; PJ or Cooperative contracts; Hybrid model — 50% of time onsite in Votorantim/SP.