···
Log in / Register
Data Engineering and AI | Mid-Level Data Engineer
Indeed
Full-time
Onsite
No experience limit
No degree limit
Centervale Shopping Avenida Deputado Benedito Matarazzo Jardim Oswaldo Cruz, - San Marino, São José dos Campos - SP, 12230-002, Brazil
Favourites
Share
Some content was automatically translatedView Original
Description

**The Mission** The Data Engineer is responsible for building the pipeline that transforms raw data—available in various formats, from transactional databases to text files—into a format suitable for querying and analysis. It is also the Data Engineer’s responsibility to keep this pipeline running, ensuring data is collected at the right time and with the security level required by the company. **Your Challenges Will Include** * Supporting the deployment of machine learning models into production environments by providing models with data stored in a warehouse or sourced directly from data sources, configuring data attributes, managing compute resources, and setting up monitoring tools (AWS CloudWatch, AWS EventBridge); * Managing stored data and structuring it appropriately using database management systems; * Monitoring the overall performance and stability of automated data pipelines, as well as making necessary modifications according to requirements; * Collecting and integrating data from different environments, sourced from both structured and unstructured data; serving as a technical reference; * Tracking team action plan outcomes, ensuring value-driven and high-quality deliveries aligned with organizational objectives; * Building and maintaining data catalogs; * Conducting code reviews of ETL code. **Above all, you must identify with our purpose: valuing people so each individual can build their own story.** **In addition, it is desirable that you have** * Proficient knowledge of cutting-edge database languages and technologies (OLTP, OLAP, Data Lake, Warehouse, and Big Data); * Programming skills to develop, customize, and manage integration tools, databases, warehouses, and analytical systems (DMS, Glue, AWS Lambda, Step Functions, Crawler, Athena, Redshift, S3, Dynamo, Delta Tables); * Knowledge of file formats such as JSON, PARQUET, AVRO, ORC, etc.; * Experience with data cataloging tools such as Amundsen and Glue Catalog; * Experience with ETL code pipelines (CI/CD); * Extensive experience working as a Data Engineer.

Source:  indeed View original post
João Silva
Indeed · HR

Company

Indeed
Cookie
Cookie Settings
Our Apps
Download
Download on the
APP Store
Download
Get it on
Google Play
© 2025 Servanan International Pte. Ltd.