Job Summary: Join us in developing and maintaining large-scale data pipelines using distributed technologies and batch/streaming processing. Key Highlights: 1. Develop and maintain data pipelines using Java and PySpark. 2. Work with Apache Spark / Databricks for distributed processing. 3. Collaborative environment focused on technical excellence and learning. **At Premiersoft, we turn challenges into real solutions!** With over a decade of experience in development, we are driven by a clear purpose: **to create technological experiences that accelerate business growth** and drive our clients’ digital transformation. Our team—comprising over 200 **\#Heroes**—combines technical excellence with our core DNA: **Team Player, Growth Driven, and Problem Solver**. We thrive on challenges, are guided by innovation, and remain committed to delivering **high-impact solutions**, every single day. **About the opportunity:** You will develop and sustain large-scale data pipelines using distributed technologies and batch/streaming processing, with a focus on analytical environments, data products, BI, and artificial intelligence. This role is strategic in supporting initiatives related to credit, risk, anti-fraud, and analytics. **Your responsibilities will include:** * Developing and maintaining data pipelines using Java and PySpark. * Performing distributed processing with Apache Spark / Databricks. * Integrating data from multiple sources (APIs, databases, internal and external systems). * Building solutions within Data Lake, Lakehouse, and Data Warehouse environments. * Implementing large-scale ETL/ELT routines. * Ensuring data quality, governance, and traceability. * Optimizing performance and cloud infrastructure costs. * Collaborating closely with BI, Analytics, Product, and AI teams. * Automating validations, monitoring, and failure handling. * Supporting Machine Learning projects and analytical models. **What you need to have:** * Solid experience as a Data Engineer. * Strong proficiency in Java and PySpark. * Proven experience with Apache Spark / Databricks. * Advanced SQL skills for data analysis and transformation. * Knowledge of Cloud environments (AWS, Azure, or GCP). * Experience with pipeline orchestration (Airflow, Azure Data Factory, etc.). * Experience with version control (Git) and CI/CD. * Knowledge of analytical data modeling. * Familiarity with security practices, LGPD, and Data Governance. **Nice-to-have qualifications:** * Experience in data projects within the financial sector. * Experience with streaming technologies (Kafka, Spark Streaming). * Knowledge of Delta Lake. * Experience with Power BI, Tableau, or similar tools. * Knowledge of MLOps. * Cloud/Data certifications. Hybrid hiring model. **What we offer:** * A **collaborative** environment with **continuous knowledge sharing**; * An open culture embracing **innovation, ideas, and ownership**; * Use of **cutting-edge technologies** and industry best practices; * Focus on **technical excellence** and **real-world impact** in deliverables; * Ongoing encouragement of **learning and professional development**. **Our benefits:** * **Flexible benefits card** via Flash — covering meals, mobility, wellness, and more; * **Health insurance plan** (Unimed); * Partnership with a **mental health clinic**; * **TotalPass:** access to gyms, studios, and wellness activities; * Gifts via Flash — **birthday gift** and **time-in-company gift**; * Referral bonus — **R$ 2.000,00 per hire**; * Continuous development through **IDPs (Individual Development Plans), feedback sessions, and certification support**; * **Free English classes:** preparing you for international opportunities. See what it’s like to join the Premiersoft team Learn more about us Visit our headquarters Communication throughout the selection process occurs via email or WhatsApp. To avoid missing any updates, please add the domain **@premiersoft.net** to your list of trusted senders and monitor your inbox and spam folder.