Job Summary: 3M is seeking a Principal Data Engineer to design and support enterprise-wide Data Mesh platforms, collaborating with global teams on advanced digital solutions. Key Highlights: 1. Collaborate with innovative and creative minds around the world 2. Apply your talent to innovations that make a difference 3. Lead projects and provide technical mentorship 3M has a long\-standing reputation as a company committed to innovation. We provide the freedom to explore and encourage curiosity and creativity. We gain new insight from diverse thinking, and take risks on new ideas. Here, you can apply your talent in bold ways that matter. Job Description: Job Description: Collaborate with innovative minds around the world Choosing where to start and grow your career has a significant impact on your professional and personal life. Therefore, it is equally important to know that the company—and its leaders—you choose to work for will support and guide you. With diversity of people, global locations, technologies, and products, 3M is a place where you can collaborate with over 60\.000 curious and creative professionals. The Impact You Will Have in This Role 3M is seeking a Principal Data Engineer to join the Corporate Research Systems Lab (CRSL) and develop scalable data systems. As part of an agile team, you will enable applications across diverse markets, including energy, manufacturing, personal safety, transportation, electronics, and consumer goods. As a Principal Data Engineer, you will have the opportunity to design and support enterprise-wide Data Mesh platforms to empower computing and digital technology solutions for users worldwide: * Architect, design, and build scalable, efficient, and fault-tolerant data operations. * Collaborate with senior leadership, analysts, engineers, and scientists to implement new data domains and initiatives on mesh and Lakehouse platforms. * Lead technical architecture for accelerated solution designs, including integration, modeling, governance, and data applications. * Explore and recommend new tools and technologies to optimize the data platform. * Enhance and implement best practices for data analytics engineering. * Collaborate with data engineering teams and domain nodes to design physical data models and mappings. * Work with various subject-matter experts to develop advanced digital solutions and drive digital transformation. * Conduct code reviews, manage performance improvements, and reinforce maintainability standards. * Develop and maintain scalable data pipelines for ingestion, transformation, and distribution of data streams. * Advise and guide business units, data scientists, and data consumers on standards, pipeline development, and data consumption. * Provide technical guidance and mentorship, ensuring adherence to best practices and high software quality through rigorous testing and reviews. * Lead project planning and execution, manage schedules and resources, and facilitate effective communication among teams and stakeholders. * Foster a positive team environment, support recruitment, and provide training opportunities for skill development. Your Skills and Experience To ensure your success from day one, 3M requires, at a minimum: * Bachelor’s or advanced degree in Computer Science or related field from an accredited institution. * Professional experience in data management, data governance, and design/development of data warehouses/lakehouses, with proficiency in SQL and NoSQL systems. * Proficiency in English. Additional qualifications that may further enhance your success in this role: * Proficiency in architecting distributed cloud workloads (AWS, Databricks preferred). * Extensive experience and proficiency in Python, Apache Spark, PySpark, and Data Warehouse/Lakehouse architecture (Databricks preferred). * Hands-on experience using Python for data extraction via APIs and building data pipelines. * Strong experience in data engineering, data systems, and governance—programming with both structured and unstructured data. Experience with materials science, chemistry, computational chemistry, or physics data is a plus but not required. * Proficiency in building data pipelines to integrate business applications and processes. * Solid understanding of advanced Databricks concepts (Delta Lake, MLflow, custom libraries, Workflows, Unity Catalog). * Experience with AWS services for data lake and pipeline development, including S3, Glue, EMR, etc. * Experience with stream processing systems: Kinesis, Spark Streaming, Storm, Kafka, etc. * Knowledge of data quality and validation principles, encryption, access control, authentication, and authorization. * Advanced experience in defining and implementing feature engineering. * Experience with Docker containers, Kubernetes, and developing/interacting with APIs. * Experience with orchestration tools (Temporal.io, Apache Airflow). * Experience with Large Language Model (LLM) architectures and data engineering requirements to support ingestion, tokenization, and indexing for LLMs. * Knowledge of Retrieval‑Augmented Generation (RAG) pipelines, vectorization, and integration with vector databases (e.g., FAISS, OpenSearch Vector, Pinecone, pgvector). * Experience with model inference and hosting platforms, including AWS Bedrock, Databricks Model Serving, SageMaker. * Understanding of security, governance, and compliance practices for data used in LLMs. * Excellent interpersonal, collaboration, team-building, and communication skills. Work Location This position follows an in-office model, requiring the employee to work onsite at the Sumaré/SP office for at least four days per week. Travel: May include up to 5% domestic/international travel. Relocation: Not authorized. Supporting Your Well\-Being 3M offers many programs to help you live your best life—physically and financially. To ensure competitive compensation and benefits, 3M regularly benchmarks against peer companies of similar size. Talk to Max For assistance in searching our current job openings or for more information about all things 3M, visit Max, our virtual recruiting assistant at 3M.com/careers. Learn more about 3M’s creative solutions to the world’s problems at www.3M.com or on Instagram, Facebook, and LinkedIn @3M. 3M is an equal opportunity employer. 3M does not discriminate against any applicant based on race, color, age, religion, gender, sexual orientation, gender identity or expression, national origin, or disability. Safety is a core value at 3M. All employees are expected to contribute to a strong Environmental Health and Safety (EHS) culture by following safety policies, identifying hazards, and engaging in continuous improvement. Please note: your application may not be considered if you do not provide your education and work history, either by: 1\) uploading a resume, or 2\) entering the information into the application fields directly. 3M Global Terms of Use and Privacy Statement Carefully read these Terms of Use before using this website. Your access to and use of this website and application for a job at 3M are conditioned on your acceptance and compliance with these terms. Please click on the following links and select the country where you are applying for employment to review the applicable Terms of Use (link here) and Privacy Policy (link here). Before submitting your application, you will be asked to confirm your agreement with the terms.