Description
Job Summary:
Join us in developing and evolving a public data intelligence platform, transforming information into market insights and intelligence for clients.
Key Highlights:
1. Participation in the development and evolution of the data layer
2. Hands-on profile with Python backend, automation, and AI
3. Building useful solutions autonomously within a product environment
**About Brasil317 (DataGovBR)**
Brasil317 builds **DataGovBR**, a public-data-driven intelligence platform for procurement and bidding markets. We organize, cross-reference, and transform public information into market insights: opportunities, purchase history, agency behavior, competition, prevailing prices, and signals that help our clients make faster, more informed decisions — with less guesswork.
**The Challenge**
You will contribute to the development and evolution of our data layer, supporting the collection, transformation, organization, and delivery of information that powers our product. We seek a **hands-on** professional who is equally comfortable with **Python backend development, automation, web scraping, data engineering, and practical AI applications**, helping turn public data into features and intelligence for our customers. We already have an analytical foundation and a visualization layer in the product, and we aim to strengthen our team with someone who can execute effectively, collaborate across multiple domains, and pragmatically advance DataGovBR’s technical capabilities.
**Responsibilities**
* Develop and maintain **Python** routines for data collection, processing, and delivery.
* Build and evolve data pipelines and automation workflows focused on reliability, organization, and maintainability.
* Perform **web scraping** and extract data from diverse public sources — both structured and unstructured.
* Support the development of procurement-domain intelligence: opportunities, pricing, purchasing agencies, suppliers, competition, and market signals.
* Implement integrations and services that feed the data product and platform visualizations.
* Use **Docker** for packaging, environment standardization, and service/job execution.
* Support the application of **AI** to business problems — such as classification, information extraction, data enrichment, summarization, and intelligent automation.
* Collaborate with the team to investigate inconsistencies, improve data quality, and evolve business rules.
* Contribute to technical documentation, process organization, and production routine maintenance.
**Requirements**
* Solid experience with **Python** for scripting, service development, automation, or pipeline implementation.
* Practical knowledge of **Docker**, including environment setup, application packaging, and simplified deployment/execution.
* Experience with **web scraping**, parsing, and web-based data collection.
* Familiarity with API consumption, data processing, and system integrations.
* Proficiency in **SQL**, including querying, validation, and support for data analysis.
* Experience with version control and software development best practices.
* Interest or hands-on experience with **applied AI**, especially using models for extraction, classification, organization, or enrichment of information.
* Organized, proactive mindset with strong adaptability to evolving product environments.
**Nice-to-Haves**
* Experience with public data, government, public procurement, or bidding processes.
* Experience scraping documents, PDFs, public portals, and low-standardization sources.
* Knowledge of NLP, OCR, LLMs, or information extraction pipelines.
* Basic understanding of BI, data visualization, or dashboard development support.
* Familiarity with Linux, containers, and server/cloud-based routine execution.
* Ability to collaborate effectively with product, data, and frontend teams.
**Tech Stack (Reference)**
* **Python**
* **PostgreSQL / SQL**
* **Docker**
* **Scraping / Automation / Jobs**
* **BI and Data Products**
* **Applied AI for Extraction and Intelligence**
* Infrastructure/Containers/Cloud (varies per project)
**What You’ll Find Here**
* Real-world problems with direct client impact.
* Space to build useful solutions — with autonomy and speed.
* A growing product environment offering practical learning in data, automation, and AI.
* Opportunities to tackle diverse challenges — bridging backend, data, and business intelligence.