···
Log in / Register
Senior Data Engineer – Python, Scala & Spark | Data Engineering & Data Modeling
Indeed
Full-time
Onsite
No experience limit
No degree limit
79Q22222+22
Favourites
Share
Some content was automatically translatedView Original
Description

Job Summary: We are seeking a data engineering specialist with strong expertise in Python, Scala, and Apache Spark to serve as a technical reference in building scalable data pipelines and high-performance solutions. Key Highlights: 1. Architectural autonomy and vision in data engineering 2. Dynamic environment with interaction across diverse technologies 3. One of the best companies to work for in Brazil **What We’re Looking For:** A data engineering specialist with strong expertise in Python, Scala, and Apache Spark. We seek someone capable of serving as a technical reference—autonomous, architecturally minded, and experienced in building scalable data pipelines, data modeling, and high-performance solutions. **Key Responsibilities:** Build and maintain high-performance data pipelines (ETL/ELT); Develop solutions in Python, Scala, and Spark for large-scale data volumes; Data modeling (dimensional/Kimball, Data Vault, relational/analytical); Orchestrate workflows (Airflow, ADF, Luigi; Control-M is a plus); Work with data layers (Landing, Cleaning, Processing, Curation, Data Marts); Integrate sources/services using SQL, NoSQL, and Data Lakes (Parquet/Delta/ORC); Implement best practices: Git, data testing, observability; Collaborate with architecture, product, and analytics teams. **Requirements:** Python and Scala for pipelines and automation; Apache Spark (Spark SQL, DataFrames, optimization/partitioning); Data modeling: Dimensional (Kimball), Data Vault, relational/analytical; Orchestration: Airflow, ADF, Luigi (Control-M preferred); Big Data: Hadoop, Hive, Kafka (integration/streaming); Databases and formats: Postgres, SQL Server, Oracle; MongoDB, Cassandra, Redis; Parquet, Delta Lake, ORC; Cloud platforms: AWS, Azure, or GCP; Data layers: Landing, Curation; ETL chaining; Data Marts; Best practices: Git, testing, observability, query/load performance; Advanced Spanish. **Nice-to-Haves:** MapReduce, data governance, advanced monitoring/tuning; Self-service tools (Looker/Metabase) and applied descriptive statistics; Intermediate/advanced English. **Work Location: Remote** **Why Build Your Career at Meta?** We offer autonomy, clear goals, and a dynamic, challenging environment where professionals can interact with diverse technologies, participate in all types of projects, bring new ideas, and work from anywhere in Brazil—and why not, the world. Additionally, we are one of the best companies to work for in Brazil according to Great Place to Work, and one of the 10 fastest-growing companies in the country for three consecutive years, per the Informática Hoje Yearbook. **What Are Our Values?** * We are people serving people * We think and act like owners * We have a drive for performance * We grow and learn together * We pursue excellence and simplicity * Innovation and creativity are in our DNA Everyone is welcome regardless of background, disability, ethnicity, religious belief, sexual orientation, appearance, age, or related factors. We want you to grow with us in an inclusive, opportunity-rich environment. If this resonates with you, then \#JoinMeta!

Source:  indeed View original post
João Silva
Indeed · HR

Company

Indeed
Cookie
Cookie Settings
Our Apps
Download
Download on the
APP Store
Download
Get it on
Google Play
© 2025 Servanan International Pte. Ltd.