Description
**What are we looking for?**
**Data Engineer (Cloud & Data Platform)**
Overview: We are seeking a Data Engineer to build and optimize end-to-end data pipelines on a modern cloud-based data platform. The role will focus on ingesting data from RPA systems and APIs, transforming it into structured datasets, and delivering it seamlessly to downstream and external applications.
This is a hands-on position requiring strong experience in Python, GCP (BigQuery, GCS), and CI/CD, as well as knowledge of infrastructure-as-code using Terraform.
**Key Responsibilities:**
* Design and develop scalable data pipelines for ingesting data from APIs and RPA sources
* Load and manage data in raw/staging layers and transform them into curated/exposure layers
* Build and deploy cloud-based functions/services written in Python
* Work with Google Cloud Storage (GCS) and BigQuery for storage, transformation, and querying
* Implement and manage CI/CD pipelines in Azure DevOps
* Use and extend Terraform templates to provision and manage cloud resources
* Develop automated processes to export and format data for ingestion into external systems
* Ensure data quality, performance, and reliability
**Required Skills and Experience**
* Strong proficiency in Python and SQL
* Experience building pipelines that ingest data from REST APIs
* Practical experience with: Google Cloud Platform (BigQuery, GCS, Cloud Functions)Azure DevOps for CI/CD
* Google Cloud Platform (BigQuery, GCS, Cloud Functions)
* Azure DevOps for CI/CD
* Familiarity with Terraform / Infrastructure as Code (template-based usage is acceptable)
* Experience with large-scale and/or semi-structured data
**Location of the Position:**
Remote position
**Why build your career at Insi?**
We offer autonomy, clear goals, and a dynamic, challenging environment where professionals have opportunities to interact with diverse technologies, participate in all types of projects, bring new ideas, and work from anywhere in Brazil—and why not, the world. Additionally, we are one of the best companies to work for in Brazil according to Great Place to Work, and one of the top 10 fastest-growing companies in the country for three consecutive years, as reported by the Anuário Informática Hoje.
**What are our values?**
* We are people serving people
* We think and act like owners
* We have a drive for performance
* We grow and learn together
* We pursue excellence and simplicity
* Innovation and creativity are in our DNA
All individuals are welcome regardless of their background, disability, ethnicity, religious belief, sexual orientation, appearance, age, or related factors. We want you to grow with us in an inclusive environment full of opportunities.
**Do you identify with this? Then, #JoinInsi!**