Staff data engineer

Description

Job Summary: Lead the data engineering team technically, define standards, and ensure synergy with the data platform, prioritizing quality, observability, and cost efficiency. Key Highlights: 1. Technical leadership in data engineering and standard definition 2. Focus on quality, observability, and cost efficiency 3. Data environment with Airflow, Superset, PySpark, Iceberg, Athena, and AWS Description: What we expect from you: * Strong SQL, Python, Spark/PySpark, and Linux skills; * Broad knowledge of AWS services, preferably: IAM, EC2, Athena, DynamoDB, RDS, S3, EMR, Lambda, Step Functions, Lake Formation, CloudWatch, Kinesis; * Experience with Prometheus, Grafana, CloudTrail; * Experience maintaining data tools such as Airflow, Superset, DataHub, etc.; * Experience with relational and NoSQL databases; * Experience building CI/CD pipelines; * Experience with Kubernetes; * Experience with Terraform; * Experience with GitHub Actions; Nice-to-have: * Experience with MLOps and ML model pipelines; * Experience in data domains within Fintechs; Your day-to-day at Conta Simples: As a Staff Data Engineer for the Data Platform, you will provide technical leadership to our data engineering team, define standards, and introduce best practices into our processes. You will also work closely with the platform team to ensure alignment between the standards used by Conta Simples' technology team and our data platform, prioritizing quality, observability, and cost efficiency. In our tech stack, we primarily use Airflow, Superset, PySpark, Iceberg, Athena, EMR, Lambda, and Step Functions in an AWS environment. 2511130202461745919