Software Engineer (Apache Airflow) - Remote Work

Description

Summary: As a Software Engineer specializing in Apache Airflow, you will build and manage complex data pipeline orchestration to ensure reliable data delivery and power data-driven decision-making. Highlights: 1. Design, develop, and maintain complex DAGs for data orchestration 2. Collaborate with data engineers and analysts on automated workflows 3. Implement best practices for orchestration code using Python At BairesDev®, we've been leading the way in technology projects for over 15 years. We deliver cutting\-edge solutions to giants like Google and the most innovative startups in Silicon Valley. Our diverse 4,000\+ team, composed of the world's Top 1% of tech talent, works remotely on roles that drive significant impact worldwide. When you apply for this position, you're taking the first step in a process that goes beyond the ordinary. We aim to align your passions and skills with our vacancies, setting you on a path to exceptional career development and success. As a Software Engineer specializing in Apache Airflow, you will build and manage complex data pipeline orchestration to ensure reliable data delivery. You will work at the intersection of data engineering and automation, designing scalable workflows that power the organization's data\-driven decision\-making. What You'll Do: * Design, develop, and maintain complex Directed Acyclic Graphs (DAGs) to orchestrate data movement and transformation. * Manage task dependencies and scheduling logic to ensure timely and accurate data processing across various systems. * Monitor workflow execution and implement proactive alerting to identify and resolve pipeline failures or performance bottlenecks. * Optimize Airflow infrastructure and operator configurations to handle increasing data volumes and concurrency requirements. * Collaborate with data engineers and analysts to translate business requirements into efficient automated workflows. * Implement best practices for version control, testing, and deployment of orchestration code using Python. What we are looking for: * 4\+ years of experience in Data Engineering, Software Engineering, or a related field with a focus on data orchestration. * Proven expertise in building and managing scalable data pipeline orchestration using Apache Airflow. * Proficiency in designing and developing complex DAGs and effectively handling task dependencies. * Strong background in Python programming specifically for data workflow automation and orchestration. * Hands\-on experience monitoring workflow execution and troubleshooting pipeline performance issues. * Advanced proficiency in English. How we do make your work (and your life) easier: * 100% remote work (from anywhere). * Excellent compensation in USD or your local currency if preferred * Hardware and software setup for you to work from home. * Flexible hours: create your own schedule. * Paid parental leaves, vacations, and national holidays. * Innovative and multicultural work environment: collaborate and learn from the global Top 1% of talent. * Supportive environment with mentorship, promotions, skill development, and diverse growth opportunities. Join a global team where your unique talents can truly thrive and make a significant impact! Apply now!