Data Engineer

Description

Job Summary: A professional to design and implement efficient data pipelines, structure large volumes of complex data, and support investigative systems. Key Highlights: 1. Lead the application of cutting-edge technologies in criminal investigation 2. Develop solutions for public security and justice 3. Work with data, AI, and evidence visualization With over 20 years in the market, TechBiz Forense Digital is a national reference in technological solutions for public security and justice, serving law enforcement agencies across the country. Our Research, Development and Innovation (RDI) area operates at the forefront of technologies applied to criminal investigation, with a focus on data, artificial intelligence, and evidence visualization. Our purpose is clear: **deliver technology to those who administer justice.** **Key Responsibilities** * Design and implement efficient, scalable, and secure data pipelines; * Structure large volumes of complex data, with emphasis on entity correlation in investigations, graph modeling, and performance optimization; * Model and implement databases for investigative purposes, prioritizing traceability, integrity, and query efficiency; * Directly contribute to structuring data for investigative systems, correlation algorithms, and analytical intelligence modules; * Integrate data from multiple sources (APIs, relational databases, files, streams); * Collaborate closely with software engineers, data scientists, analysts, and researchers; * Document data engineering workflows, structures, and technical decisions; * Participate in defining the architecture of RDI products, focusing on scalability and investigative purpose. **Technical Requirements** * Proven experience in data engineering, ETL/ELT pipeline design, and handling large-scale data; * Proficiency in Python for data transformation and orchestration (including libraries such as Pandas, Polars, PySpark, or similar); * Advanced knowledge of complex data modeling, especially for analytical and investigative purposes; * Strong experience with relational databases (PostgreSQL, SQL Server, etc.); **Strategic Advantage** * Proficiency in graph databases, especially Neo4J (Cypher, modeling of entities and complex relationships); * Experience with version control tools (Git), orchestration platforms (Airflow or similar), and cloud infrastructure (preferably AWS or Azure); * Knowledge of data security, traceability, and governance practices; * Familiarity with agile methodologies (Scrum, Kanban, Lean Development). * Basic knowledge of AI and machine learning frameworks applied to data correlation and classification; **Desirable Differentiators** * Experience with investigative visualization tools (e.g., graph-based interfaces, interactive dashboards); * Hands-on experience with sensitive or confidential data (government, justice, security); * Prior participation in applied research projects or development of solutions for the public sector. Work Mode: Hybrid (Preferably Belo Horizonte and Rio de Janeiro)