We collect, process, and activate millions of data points from physical stores, e-commerce platforms, web navigation, and loyalty programs. Through technology, we make mass communication highly personalized and automated. **Responsibilities and Duties** This professional will work on projects involving automated processes, with a focus on delivering relevant information at the right time—leveraging technology to handle large volumes of data for major clients. They will participate in defining processes and systems, gathering requirements, and independently or collaboratively performing analysis and development. Additionally, they will implement and maintain ETL pipelines, delivering business/solution-focused outputs with high technical quality and performance. They will work with marketing platforms and Customer Data Platforms. **Requirements and Qualifications** **Senior Data Engineer (Focus on MLOps \& Architecture)** ------------------------------------------------------------- *Senior Data Engineer with focus on MLOps and Architecture (Customer Intelligence \& Personalization).* We are seeking a Senior Data Engineer with expertise in MLOps and Architecture to ensure the technical foundation enabling scalable data and AI capabilities. You will be responsible for architecting resilient cloud-based data pipelines (AWS/GCP) and building the automation pipeline (MLOps) that safely transitions Machine Learning models from the Data Scientist’s notebook into production. Furthermore, you are expected to build the "bridge" between the Data Scientists’ experimentation environment and large-scale activation across our customer touchpoints. You will serve as the guardian of the infrastructure enabling recommendation systems to run with low latency, high availability, and continuous monitoring—ensuring the right offer reaches the right customer at the exact millisecond. **Responsibilities:** ---------------------- * Modern Pipeline Engineering: Develop ETL/ELT workflows using Python and managed cloud services. Orchestrate data ingestion from multiple sources into our Data Lake/Warehouse (BigQuery/S3\). * MLOps \& Automation: Implement CI/CD pipelines for Machine Learning (CT \- Continuous Training). Automate model retraining and deployment using native cloud tools (SageMaker/Vertex AI) or open-source frameworks. * Infrastructure as Code (IaC): Provision and manage resources on AWS and GCP using Terraform or automation scripts, ensuring reproducible and secure environments. * Optimization and Costs (FinOps): Monitor and optimize query and processing performance, ensuring cost efficiency in the cloud (e.g., proper instance selection, BigQuery table partitioning). * Governance and Quality: Implement automated data quality checks (Data Quality) and ensure pipeline observability (failure alerts, latency monitoring). **Technical Skills (Hard Skills):** ---------------------------------------- *As a Senior professional, deep mastery of architecture and automation is expected:* **Programming Language:** * Advanced proficiency in Python (Mandatory). Emphasis on writing clean, modular, and testable code. * Solid experience with PySpark for distributed processing. **Cloud Environment (AWS \& GCP):** * AWS: Knowledge of services such as S3, Lambda, Glue, EMR, Kinesis, and SageMaker. * GCP: Proficiency in BigQuery (essential), Cloud Functions, Dataflow, and Vertex AI. **MLOps and Orchestration Stack:** * Experience with workflow orchestrators: Apache Airflow (or Cloud Composer/MWAA). * ML lifecycle tools: MLflow, DVC, or native suites (SageMaker Pipelines / Vertex Pipelines). * Model Serving: Proficiency in deploying real-time recommendation models via scalable APIs (using FastAPI, BentoML, Seldon Core, or TFServing). * Monitoring and Observability: Configuration of alerts for Model Drift (performance degradation) and Data Drift, ensuring recommendations remain relevant over time. * Recommendation System Architecture: Knowledge of infrastructure for hybrid models, including Feature Stores (e.g., Feast or Hopsworks) to serve user and item vectors with low latency. **Databases and SQL:** * Advanced SQL for Data Warehousing (focus on analytical performance). **Infrastructure and Deployment:** * Docker (containerization of scripts and models). * Terraform (IaC). * CI/CD knowledge (GitHub Actions, GitLab CI, or CodePipeline). **Behavioral Skills (Soft Skills):** ----------------------------------------------- *As a Senior professional, deep mastery is expected in: business acumen, critical thinking, and adaptability.* * **Agile and Technology-Agnostic:** Capable of moving fluidly between AWS and GCP, selecting the best tool for each problem—without technological bias. * **Data Product Vision:** Understands that the pipeline is not the end goal but the means to deliver business value. Cares whether data arrives on time for Marketing use. * **Proactive Collaboration:** Acts as the Data Scientist’s “best friend,” helping optimize inefficient code without creating friction. * **Mentoring and Technical Leadership:** Ability to guide Data Scientists on best practices for productive, scalable code development. * **Systems Thinking:** Ability to trace data flow from origin (e.g., navigation logs) through to final impact on the customer, anticipating infrastructure bottlenecks. * **Cross-Functional Communication:** Acts as a translator between infrastructure requirements (IT), modeling needs (Data Science), and business objectives (Marketing/CRM). * **Complex Problem Solving:** Calm and precise handling of production incidents affecting real-time user experience. * **Quality Advocacy:** Rigorous commitment to data governance, security, and compliance (LGPD), ensuring automation never compromises customer privacy. **Additional Information*** Experience with recommendation systems is indispensable for this role. * English and/or Spanish. Being **Pmweber** means finding a collaborative space full of growth opportunities. It means facing challenges every day alongside enthusiastic people ready to overcome them. **Because there are no limits for extraordinary people.** **We live our culture.** Here, you’ll meet exponential talent, join incredible teams embracing unique challenges, participate in innovative projects with cloud-based collaboration, and enjoy opportunities for scalable growth. **But what does Pmweb do?** Pmweb is a technology and services company focused on marketing and CRM. We exist to help companies build unique relationships at scale—elevating both our clients and our team to a new level of value creation. **Which values will you find here?** **Open and Authentic:** * People should be themselves to do their best work. * We belong to the world. * Truth and doing what’s right are non-negotiable for us. * We treat people the way they expect to be treated. **Understanding in Every Sense:** * Understanding context—not just tasks. * We are obsessed with our customers’ success. * Data is the fuel for scale. * Relationships are our business. **Constant Evolution:** * We always strive to be prepared. * We are resilient in adversity and adapt to change. * We are curious about shaping the future. * We believe in innovation. **And what benefits does Pmweb offer?** **We Prioritize Health and Well-being:** We provide Medical and Dental Insurance, Life Insurance, Childcare Assistance, Birthday Day Off, and Wellhub. Transportation Allowance and Meal/Voucher Allowance are also part of our benefits. **Your Growth Is Part of Our Growth:** We offer Language Incentives, Education Incentives, and Certification Incentives. **We Are Flexible:** We offer 7 different working hour options for you to choose from—and with our hybrid work model, we also provide Home Office Allowance. **We Recognize Achieved Results:** We have a structured evaluation cycle and constant feedback. This is a fundamental part of reaching our PLR result—Profit Sharing Plan. Liked it? **Find the right job for you here**, and join our team. Learn more about life at Pmweb on our Instagram profile @pmwebers.