Description
Summary:
Seeking a highly skilled Python Developer with a strong data engineering background to build efficient, reliable, and scalable data pipelines.
Highlights:
1. Develop and manage workflows with Apache Airflow to streamline data processes
2. Design and implement a Python SDK to optimize data engineering efforts
3. Collaborate with team members to enhance overall team efficiency
We are seeking a highly skilled **Python Developer** with a strong background in data engineering and a passion for building efficient, reliable, and scalable data pipelines.
**Responsibilities**
* Develop and manage workflows with Apache Airflow to streamline data engineering processes
* Design and implement a Python SDK to support and optimize data engineering efforts
* Create and maintain RESTful APIs for seamless integration
* Write and execute unit and integration tests for Python and Java applications
* Refactor Python and Java scripts to adhere to best coding practices and standards
* Optimize database interactions while ensuring data integrity and performance
* Maintain CI/CD pipelines for automated testing, building, and deployment
* Collaborate with team members to enhance overall team efficiency and knowledge\-sharing
* Ensure all applications meet established security and compliance guidelines
**Requirements**
* 2\+ years of experience in Python development with a focus on writing efficient, testable code
* Expertise in Apache Airflow, including dynamic DAG generation
* Background in creating and managing data pipelines
* Competency in unit and integration testing using tools like Pytest
* Familiarity with Java is a strong advantage
* Strong communication skills, both written and verbal
* Ability to work independently and deliver results under minimal supervision
* Commitment to staying updated with new and emerging technology trends