Senior AWS Data Engineer (Remote)

Description

Job Summary: As a Senior Data Engineer at Dataside, you serve as technical leader on projects, supporting the Tech Lead, developing the team, and making end-to-end technical decisions for the client. Key Highlights: 1. Autonomous technical leadership and strategic support in projects. 2. Conducts in-depth technical reviews and mentoring for the team. 3. Proposes scalable architectures and sustainable solutions. **Senior AWS Data Engineer (Remote)** **Role in the Company:** The Senior Data Engineer at Dataside serves as technical leader on projects, supporting the Tech Lead and contributing to team development and knowledge dissemination. You have autonomy over end-to-end technical decisions, ensuring deliverables align with client needs. Additionally, you conduct mentoring sessions, perform rigorous technical reviews, and drive the company’s technical evolution. With a strategic view of data value, you connect your deliverables to business impact. More than building solutions, you act as a consultative partner—prompting reflection and strengthening client relationships through well-founded proposals and trust. **Your Day-to-Day Responsibilities:** * Serve as lead engineer on contracts and autonomously drive technical decisions. * Support the Tech Lead in technical and strategic project leadership. * Conduct in-depth technical reviews and mentoring with the team. * Propose batch and streaming architectures with a focus on scalability, efficiency, and business alignment. * Build performance improvement and cost reduction plans. * Diagnose technical and operational bottlenecks and propose sustainable solutions. * Communicate solutions clearly across different audiences (business, technical, management). * Work with multiple integrations, high-volume data, and performance-critical demands. **What We’re Looking For:** * Proven experience in highly complex data engineering projects. * Ability to operate effectively in environments where prior familiarity with the tech stack is absent—learning quickly. * Strong expertise in Spark (advanced) and Python, applying sound software engineering practices (SOLID principles). * Advanced SQL skills, including query tuning and execution plan analysis. * Experience integrating via RESTful APIs and working with distributed systems. * Proficiency in the AWS analytics stack, including: S3, Athena, Redshift, Glue, EMR, Kinesis, Lambda, Step Functions, Lake Formation, Secrets Manager, CloudWatch, SNS, Cost Explorer, Glue DataBrew, Amazon Macie. * Familiarity with various data modeling techniques: Data Vault, dimensional modeling, event-driven pipelines. * Knowledge of NoSQL databases such as DynamoDB, MongoDB, and Cassandra. * Expertise in cluster sizing, distributed computing, and detailed cost analysis. **Hard Skills:** * Spark (advanced), including Catalyst Optimizer, persistence, broadcast joins, caching, and bucketing. * Python following SOLID principles and component reuse. * Advanced SQL with tuning, partitioning, and execution plan optimization. * Consumption and integration via RESTful APIs. * AWS Analytics Stack: S3, Athena, Glue, EMR, Redshift, Kinesis, Lambda, Step Functions, Lake Formation, Glue DataBrew, Macie, CloudWatch, SNS, Cost Explorer. * Amazon Redshift (advanced level): Optimization using sort keys, compression, vacuum tuning, advanced WLM, SVL/SVV logs, Redshift Spectrum, hybrid architecture with S3\. * Data modeling: Data Vault, 3NF, dimensional, event\-driven pipelines. * NoSQL databases (DynamoDB, MongoDB). * CI/CD using Git, GitHub Actions, or GitLab CI. * Unit testing concepts applied to data pipelines. * Observability and data quality frameworks and practices: Great Expectations, Airflow, Prometheus, Grafana. * Building reusable and composable solutions, with emphasis on Data Products and Data Mesh strategies. * Cloud cost assessment and planning: use of Cost Explorer, sizing via AWS Pricing Calculator. **Soft Skills:** * Technical leadership and strategic influence. * Ability to “learn how to learn.” * Clarity and depth in communication with both technical and business stakeholders. * Consultative mindset, active listening, and proactivity. * Collaborative spirit, mentoring attitude, and team development orientation. * Organization, delivery focus, and strong sense of responsibility. * Intermediate English proficiency. **Nice-to-Haves:** * **Experience with social media APIs.** * **AWS certification.** * **Advanced English proficiency.** **What We Offer:** * **Health allowance:** Monthly stipend to support your private health insurance enrollment. * **Wellhub**, to keep your body and mind active—your way. * **Online therapy**, fully covered by the company, because mental health matters. * **Online nutrition counseling**, up to two monthly consultations to support your dietary health. * ️ **Life insurance**, with a policy value of R$ 125,000, offering greater security for you and your family. * **Birthday day off**, because your day deserves to be special. * **Paid time off**, so you can recharge. * **Internal gamification**, turning achievements into rewards and recognition. * **Educational partnerships** with institutions such as FIAP, Anhanguera, and Instituto Infnet, to support your growth and learning. * **Certification bonus**, recognizing and rewarding your effort in acquiring technical certifications. ***Contract type: PJ (Individual Entrepreneur).*** ***We value every voice and every person, because we know diversity makes us more innovative and stronger.***