Data Engineer

Description

Job Summary: We are seeking a Senior Data Engineer / Technical Lead to oversee the data ecosystem, lead scalable architecture initiatives, and ensure data quality at Omie. Key Highlights: 1. Be part of the story of one of the fastest-growing technology companies. 2. Lead the design and implementation of scalable data architectures. 3. Serve as a technical and strategic reference, supporting decision-making. Omie’s purpose is to bring prosperity to the Brazilian entrepreneurial ecosystem. Therefore, we seek individuals with a growth mindset—valuing adaptability, collaboration, and motivation by innovation and continuous learning. Join the story of one of the country’s fastest-growing technology companies! **\#JoinOmie** **Responsibilities and Duties** * Oversee the **corporate data ecosystem**, including solutions built on **AWS Glue, Amazon Redshift**, and the **Databricks Lakehouse Platform**, ensuring high availability, governance, and performance. * Lead the **design and implementation of scalable, distributed data architectures**, supporting large-scale ingestion, transformation, and consumption processes. * Coordinate the development and maintenance of **data pipelines** in **PySpark, Python, and SQL**, ensuring efficiency, quality, and traceability. * Define and disseminate **technical standards, best practices, and data engineering frameworks**, promoting consistency and operational excellence. * Collaborate with technology, product, and business teams to ensure **efficient integration between systems and analytical layers**. * **Manage and optimize analytical workloads**, applying advanced **tuning and monitoring techniques** on **Redshift, Databricks SQL, and Spark**. * Ensure **data quality, integrity, and security**, in compliance with **LGPD** and other corporate guidelines. * Implement and oversee **observability, monitoring, and automation mechanisms** for data pipelines and analytical workloads. * Document **architectures, data flows, and technical processes**, ensuring traceability and continuous evolution of the data environment. * Serve as a **technical and strategic reference**, supporting architectural, performance, and scalability decisions. **Requirements and Qualifications** * Bachelor’s degree in **Computer Science, Data Engineering, Information Systems**, or related fields. * Proven experience as a **Senior Data Engineer** or **Technical Lead/Supervisor** within data engineering teams. * Solid hands-on experience with **AWS data services**, including **Glue, Redshift, and S3**. * Practical experience with the **Databricks Lakehouse Platform**, including **Delta Lake, PySpark, SQL**, and **Unity Catalog**. * Proficiency in **Python** and **SQL** for data pipeline development and optimization. * Strong command of **distributed Big Data concepts and practices**, covering both **batch** and **real-time processing**. * **Experience optimizing query performance and tuning** in **Redshift and Spark** environments. * Knowledge of **data modeling** (relational, dimensional, and lakehouse). * Familiarity with **Git, CI/CD, and DataOps/DevOps practices**. * Understanding of **data security and governance** (LGPD, GDPR, lineage, and access control). * An **analytical, proactive, and results-oriented profile**, with strong technical excellence. **Additional Information** Flexible Benefit/Meal Allowance: BRL 40.00 per business day. Remote Work Allowance. Required to work onsite? We offer a transportation allowance. For those arriving by train/metro, we provide a shuttle service from the station to the office. Bradesco Health Insurance Plan. Amil Dental Insurance Plan. Pharmacy Allowance. Childcare Allowance. Birthday Day Off — celebrate however you like! To maintain physical health and well-being, we partner with certified gym apps. To relax and support mental health, we partner with online therapy and meditation platforms. SESC Partnership — Full Membership. Exclusive discounts at top universities and educational institutions for undergraduate, graduate, and MBA programs. Plus, free access to Omie Academy for employees. English-in-Company course partnership. Insurance discount program. Swile Shop: exclusive discount platform. Dell partnership. PPRL (Profit Sharing Plan). Travel benefits. Life insurance. We are a software company that brings prosperity to the Brazilian entrepreneurial ecosystem, unlocking business growth through a platform that solves any management complexity — simply, intuitively, and efficiently. Omie seeks professionals capable of further amplifying results within an organizational culture rooted in trust, transparency, and loyalty among teams, partners, and customers. We look for people with a growth mindset—valuing adaptability, collaboration, and motivation by innovation and continuous learning. **We are all \#OmieLovers!** We believe **EVERYONE** should feel welcomed, safe, and fulfilled while being their best selves. Thus, all our opportunities are open to everyone, valuing and encouraging inclusion and diversity.