Mid-Level Data Engineer

Description

Job Summary: We are seeking a challenge-driven professional who transforms data into strategic assets for a data-driven culture, building and optimizing data pipelines. Key Highlights: 1. Build and optimize robust and efficient data pipelines. 2. Deliver structured and reliable data repositories for analysis and decision-making. 3. Participate in the evolution of data architecture with a focus on performance. **Who Are We Looking For?** A challenge-driven individual who enjoys working collaboratively to transform data into strategic assets and build a data-driven culture. Does this sound like you? Then this opportunity is for you! Responsibilities and Duties **Key Challenges:** * Build and maintain data ingestion, processing, transformation, and preparation workflows; * Develop and maintain robust, scalable, and efficient data pipelines; * Design and optimize ETL/ELT processes; * Monitor and oversee daily data processing activities, proactively troubleshooting failures; * Automate data ingestion and transformation routines; * Participate in defining and evolving data architecture, focusing on performance and scalability; * Deliver structured and reliable data repositories for analysis, reporting, and decision-making; * Develop analytical solutions aligned with business needs. Requirements and Qualifications **What You Must Know:** * Experience with PySpark and SQL; * Knowledge of Big Data architecture (AWS); * Experience with services such as Redshift, S3, and Athena; * Hands-on experience building, maintaining, and evolving data ingestion and integration pipelines; * Ability to monitor, diagnose, and optimize transformation scripts and processes. **What Could Boost Your Application:** * Knowledge of Delta Lake architecture; * Familiarity with Power BI and Amazon QuickSight; * Experience with code versioning tools (e.g., Git); * Knowledge of IaC tools such as Terraform; * Strong communication skills for collaboration with data, product, and business teams. Additional Information **What You’ll Find at iugu** **Hybrid Work Model:** Our work model is hybrid—3 days onsite and 2 days remote—with flexible working hours, respecting each team’s specific requirements. **Flexible Benefits:** Swile card credit of R$ 1.689,59, distributed as follows: **Meal and Food Allowance:** R$ 772,99. **Mobility Allowance:** R$ 408,60 for your commute, usable across all related services (Uber, 99, public transport card top-up, parking, etc.). Additionally, an extra R$ 508,00, usable flexibly across meal, food, or mobility categories, based on your preference. **Bradesco Health and Dental Insurance:** We offer pathways to help you manage your health more conveniently. **TotalPass:** A platform offering over 250 workout modalities across thousands of affiliated gyms. **Vittude:** Book psychological counseling sessions with your preferred professional, with a 40% discount on all sessions. **Life Insurance:** We provide solutions to help you better handle everyday challenges. **Breakfast:** Served daily for our iuguers to start the day right. **Fresh Fruit:** Available daily in the office. **Mini-Market:** Daily convenience options—including snacks, lunch boxes, and beverages—to suit all tastes. **Childcare Assistance:** For mothers and fathers. **Extended Maternity Leave:** 180 days. **Extended Parental Leave:** 30 days. **Short-Term Incentive:** Based on goal achievement and individual performance evaluation. **Birthday Day Off:** A paid day off during your birth month. **iu+go:** A biannual performance management program, including ongoing PDI tracking. **iugu Academy:** A learning environment created by iugu itself—providing access to regulatory content and role-specific learning paths. **Partnerships:** Collaborations with outstanding educational institutions—such as language schools and universities (exclusive discounts for iuguers and dependents). **Other Differentiators:** * A relaxed workplace environment, fostering teamwork and talent; * Autonomy to work, develop, and implement ideas; * A feedback-oriented culture featuring regular 1:1 meetings. *Diversity matters here! We value differences and pluralism across race, color, religion, gender and gender identity, nationality, sexual orientation, age, and other dimensions—because we believe diverse perspectives and ideas drive innovation.* **#Joiniugu** Employment Type: Full-time CLT Selection Questions: * Please specify your salary expectation (do not respond “negotiable”). * Are you available to work in the hybrid format—3 days/week onsite (Brooklin/SP) and 2 days/week remote? * Where was your most extensive experience with AWS Big Data architecture? Work Location: Hybrid remote for Brooklin, SP