SENIOR DATA ENGINEER

Description

Job Summary: The professional will be responsible for developing and optimizing data extraction, building data pipelines using AWS, and implementing real-time data streams. Key Highlights: 1. Development and optimization of data extraction via Remote API. 2. Creation of data pipelines using the AWS ecosystem for telemetry. 3. Implementation of real-time data streams with AWS Lambda and Kinesis. **Job Description:** ---------------------- Develop and optimize data extraction via Remote API from a telemetry platform. Build data pipelines using the AWS ecosystem to process tracking events (ignition, sensors, geofences). Structure storage in Amazon S3 (Bronze, Silver, Gold layers); model data in Amazon Redshift or Athena for BI consumption. Implement real-time data streams using AWS Lambda and Amazon Kinesis (or MSK/Kafka) for immediate alerts. Create and monitor data orchestrators (e.g., AWS Step Functions or Managed Workflows for Apache Airflow \- MWAA). **Mandatory Requirements:** ------------------------------ Bachelor's degree in Computer Science, Computer Engineering, Software Engineering, Data Engineering, or related fields. Experience integrating with Remote API or Data Service. AWS Core: Practical experience with S3, Lambda, Glue, Athena, and Redshift. Languages: Python (PySpark/Pandas) and Advanced SQL. Databases: Experience with relational databases (RDS/PostgreSQL) and familiarity with NoSQL (DynamoDB) for tracking logs. Integrations: Experience with RESTful APIs and handling JSON/XML files. **Desirable Requirements:** -------------------------- AWS Certified Data Engineer or Solutions Architect certification. Experience with AWS IoT Core for direct sensor communication. Knowledge of visualization tools (QuickSight, Power BI, or Tableau) integrated with AWS. Familiarity with infrastructure-as-code tools (Terraform or CloudFormation). Knowledge of telemetry platforms at any level. **Employment Type:** -------------------------- CLT **PwD (Persons with Disabilities):** -------- INDIFFERENT **Benefits:** --------------- Pharmacy Benefit \- Golden Farma Health and Wellness \- TotalPass Fuel Allowance or Transportation Allowance Meal Allowance and Food Allowance Medical and Dental Assistance; Education Assistance (Undergraduate, Postgraduate, and MBA) SESC Partnership Language School Partnership School Partnership for Employees' Children Breakfast **Work Location:** ---------------------- 1 **Additional Information:** --------------------------- On-site