Senior Data Engineer

Description

Job Summary: A data professional who applies statistical techniques, statistical modeling, data mining, and Big Data practices to transform raw data into strategic insights. Key Highlights: 1. Experience in developing and maintaining data lakes and data warehouses. 2. Proficiency in Python and SQL, with advanced knowledge of ETL/ELT. 3. Collaboration with data science, BI, and infrastructure teams. **Job Description:** **Responsibilities the professional will perform:** Applies statistical techniques for variable selection, sampling, and experimental design. Applies segmentation, statistical and computational modeling techniques (e.g., AI and Machine Learning). Applies data mining techniques, data structures, and data science–based solutions. Performs data modeling, statistical generation, and trend identification, including exploratory, descriptive, diagnostic, predictive, and prescriptive analyses. Data visualization and analysis in Python (pandas, numpy, statsmodels, matplotlib, seaborn). Works with Big Data environments and tools (Hadoop and PySpark), programming languages and tools (Python, R, Scala, and SQL), and masters data management platforms and tools. **Required Experience, Skills, and Knowledge:** Responsibilities: * Design, build, and maintain scalable and robust data pipelines meeting analytical requirements. * Implement and manage large-scale data storage solutions on GCP. * Optimize database performance and ensure data quality, integrity, and security through best practices and automation. * Collaborate with data science, BI, and infrastructure teams to develop efficient solutions that transform raw data into strategic insights. Skills: * Proven experience in developing and maintaining data lakes and data warehouses. Preferred: Google Cloud Storage/BigQuery. * Proficiency in Python and SQL. * Advanced knowledge of ETL/ELT tools and experience orchestrating data pipelines. Preferred: dbt. * Experience in cloud-based data architecture (GCP, AWS, Azure). **Education:** Postgraduate degree or MBA. Mandatory qualification: Bachelor’s degree in Information Technology (or a related field). OR Bachelor’s degree in any field, accompanied by a completed postgraduate program (specialization, master’s, or doctoral degree) in Information Technology (or a related field), with a minimum duration of 360 classroom hours. Mandatory Qualification: Postgraduate degree or MBA in the relevant field and/or Software Engineering processes, with a minimum duration of 360 classroom hours. OR At least three (3) professional certifications in the relevant field and/or agile methodologies, issued by a recognized certification body. **Years of Experience:** Mandatory experience Minimum six (6) years of professional experience in the relevant technical specialty area. OR Minimum four (4) years of cumulative professional experience, plus at least two (2) professional certifications in the relevant field and/or agile methodologies, issued by a recognized certification body. **Knowledge and Skills:** SQL, Python, AI, data lake, warehouse ### **Employment Type:** CLT ### **Benefits:** Meal Voucher, Food Voucher, Dental Plan, Health Insurance, TotalPass, Subsidy ### **Department:** Government