Description
**Role in the company:** The Mid-Level Data Engineer at Dataside has autonomy to deliver high-complexity solutions in data engineering projects. Acts as the technical owner for contracts, always supported by a Technical Leader, Senior Engineer, or Data Architect. Responsibilities include advising clients on pipeline design, service selection, cost and performance optimization, identifying opportunities for improvement in existing architectures, and communicating those to more senior technical leads.
Also actively participates in developing less experienced colleagues by conducting technical code reviews and mentoring juniors or team members in growth phases.
Additionally, the professional is expected to focus on generating real business value, working with empathy, active listening, and strategic vision. It is essential to delight clients through well-structured deliveries, clear communication, and a collaborative posture—working side-by-side to solve the project’s key pain points with a focus on concrete results.
**Responsibilities:**
Design, build, and maintain data pipelines using PySpark, SQL, and AWS services.
Manage data ingestion and transformation efficiently, emphasizing reusability and best practices.
Work on projects involving Glue, EMR, Redshift, Athena, Lambda, and Step Functions.
Optimize data lifecycle in S3 and ensure query performance.
Generate value through data organization and governance.
Work in critical, high-volume environments.
Lead client meetings, explain technical decisions, and propose scalable solutions.
Anticipate technical risks and suggest mitigations.
Guide junior professionals and actively disseminate best practices across the team.
**Requirements:**
Practical experience with medium- and high-complexity data projects.
Hands-on experience building pipelines with Spark/PySpark and advanced SQL.
Proficiency in the AWS analytics stack:
S3, Glue, EMR, Athena, Redshift, Lambda, Step Functions.
Experience with CI/CD, Git version control, and automated deployment.
Strong communication skills with both technical and non-technical stakeholders.
Clear understanding of data flow and cloud architecture.
Autonomy in execution and accountability for deliverables.
**Hard Skills:**
Advanced PySpark.
Advanced SQL.
AWS analytics stack: S3, Glue, EMR, Athena, Redshift, Lambda, Step Functions.
Git + CI/CD.
Amazon Redshift:
Table creation and maintenance, distribution styles (KEY, EVEN, ALL), sort keys, vacuum/stats, materialized views, COPY/UNLOAD, WLM.
**Soft Skills:**
Consultative mindset.
Organization and autonomy.
Clarity and structure in communication.
Ability to anticipate problems and risks.
Team spirit and results orientation.
Ability to guide and influence less experienced colleagues.
Intermediate English (preferred).
**Desired Certifications:**
AWS Certified Data Engineer – Associate.
AWS Certified Solutions Architect – Associate.
**Differentiators:**
Knowledge/experience with Terraform, DBT, DuckDB, Docker.
Databricks Certified Data Engineer Associate.
**What we offer:**
* **Healthcare allowance:** Monthly financial support to help cover your private health insurance plan.
* **Wellhub**, to keep your body and mind active—in the way you prefer.
* **Online therapy**, fully covered by the company, because mental health matters.
* **Online nutrition counseling**, up to two sessions per month to support your dietary health.
* ️ **Life insurance**, with a policy value of BRL 125,000, providing greater security for you and your family.
* **Birthday day off**, because your special day deserves to be celebrated.
* **Paid time off**, to recharge your energy.
* **Internal gamification**, turning achievements into rewards and recognition.
* **Educational partnerships**, with institutions such as FIAP, Anhanguera, and Instituto Infnet, to support your growth and learning.
* **Technical certification bonus**, recognizing and rewarding your effort to learn.
***Contract type: PJ (Individual Entrepreneur).***
***We value every voice and every person, because we know diversity makes us more innovative and stronger.***