Job Summary: We are seeking a proactive Data Engineer to design, develop, and maintain data pipelines, model storage layers, and ensure data quality across exciting projects. Key Highlights: 1. Company recognized as the best place to work in MG and IT in Brazil by GPTW. 2. Opportunity to collaborate on amazing projects and grow alongside BHS. 3. Culture of continuous feedback, with IDP (Individual Development Plan) and a focus on diversity inclusion. **We are BHS!** With 31 years of experience in the market, we deliver modern IT solutions. We are recognized as the **BEST** company to work for in **MG and IT in BRAZIL** by GPTW — Great Place to Work, and ranked as the 4th best company to work for in the **LATAM** category. **What do we expect from you?** * Ability to build relationships with people from diverse departments and hierarchical levels; * Self-management; * Collaboration; * Proactivity and willingness to work outside your comfort zone; * Someone eager to be part of amazing projects and highly motivated to learn, teach, and grow alongside BHS. **Responsibilities and Duties****Your activities will include:** * Designing, developing, and maintaining data ingestion and transformation pipelines via Spark jobs (batch and, where applicable, streaming) for the data lake / data warehouse. * Modeling and optimizing storage layers (bronze/silver/gold), ensuring partitioning, schema evolution, and governance. * Building connectors and integrations with internal/external data sources using internal libraries and institutional standards. * Administering and tuning Spark clusters (executor configuration, memory, shuffle, autoscaling), as well as managing catalogs/metadatas. * Implementing data quality controls (profiling, validations, deduplication) and observability (logs, metrics, alerts) across pipelines. * Collaborating with data scientists/analysts to deliver reliable data in accessible formats (Parquet/Delta/Iceberg, catalog Views, etc.). * Ensuring security and compliance: access controls, masking/encryption, and traceability (lineage). **Requirements and Qualifications** **We are looking for someone who has:** * Currently pursuing or completed a Bachelor’s degree in Computer Science, Systems Analysis and Development, or related fields; * Strong hands-on experience with Apache Spark (PySpark preferred): job optimization, partitioning, broadcast joins, skew handling, checkpointing/caching, and configuration tuning; * Experience with cloud-based data lakes (S3/ADLS/GCS) and columnar formats (Parquet, Delta Lake, or Iceberg); * Proficiency in Python for data engineering (ETL packages, testing, logging) and familiarity with mpmg_utils to standardize ingestions; * Experience with orchestration tools (Airflow, Prefect or similar) and version control for data/code (Git); * Observability and reliability expertise: structured logging, metrics (Prometheus/Grafana or equivalent), alerting, and pipeline testing practices (unit/integration using sample data); * Advanced SQL skills for data validation and delivery; foundational knowledge of analytical modeling. **PREFERRED QUALIFICATIONS:** * Experience using MongoDB as source/target: collection modeling, change streams/CDC, Spark-Mongo connectors (a strong plus); * Knowledge of governance and security: IAM/ACLs, data masking, PII handling, and retention policies; **Additional Information** **What can you expect from us?** At BHS, your well-being is our top priority. We’re here to ensure your experience is outstanding, with all the support you need. Here’s what you’ll find with us: Health insurance and dental care; Meal/food allowance via Flash card; Remote work allowance; Gympass / Wellhub; Life insurance; Extended maternity/paternity leave; Diverse partnerships and benefits in education, health, and leisure (universities, language schools, gyms, healthcare clinics, etc.); Culture of continuous feedback, including: biannual feedback sessions, 1:1 meetings, IDP (Individual Development Plan), and BHS Experience. We champion diversity inclusion in our daily operations and believe that plural teams perform better. Everyone is welcome. **Join us as a B.Techer** Check our Glassdoor rating (4.5 stars and 93% recommended to others). #vempraBHS #somosBHS #LI-Remote **31 years of history: building relationships with people, innovation, and clients.**