Job Summary: We are seeking an experienced Python developer to design and maintain web scraping applications, APIs, and automations, focusing on continuous improvement of solution quality and reliability in the agricultural credit sector. Key Highlights: 1. Work in an intelligence HUB that innovates agricultural credit. 2. Develop robust web scraping and API solutions. 3. Work with cutting-edge technologies in a dynamic environment. AgRisk is a **complete intelligence HUB** **that integrates data, technology, governance, and analytics** to support every stage of the agricultural credit journey. As a pioneering solution in the industry, it establishes a new standard of efficiency, simplicity, and precision—making decisions faster, safer, and more consistent for **risk, credit, compliance, and intelligence teams**. **Key HUB Solutions:** * **AgRisk:** Integrates national restriction data into the credit analysis workflow, enabling structured reading of delinquency, payment history, and risk signals throughout the decision-making journey. Information is consolidated into a single environment and used to support more consistent credit decisions—always in conjunction with financial, legal, and behavioral data. * **AgFlow:** A credit pipeline responsible for structuring and organizing the credit analysis and decision-making journey—from registration to formalization. * **CredAcademy:** Training for professionals seeking authority over agricultural credit. **Your Responsibilities Here:** * Design, build, and maintain **web scraping and crawler applications**, emphasizing robustness and scalability, using tools such as Scrapy, BeautifulSoup, Selenium, or Playwright when necessary. * Define and implement **resilience strategies**, including retries, rate limiting, IP rotation, user-agent rotation, layout change detection, fallbacks, and idempotent reprocessing. * Create and maintain **automations and pipelines** (scheduled jobs, workers, asynchronous processes), ensuring traceability and metrics. * Develop and maintain **REST API integrations** (internal and external), ensuring proper error handling, contracts, and versioning. * Build and evolve **APIs using FastAPI and/or Flask**, focusing on performance, security, and standardization. * Continuously improve solution **quality and reliability**, through testing, code review, linting, CI/CD, and observability (structured logs, metrics, and tracing where applicable). * Collaborate closely with **Backend, Data, and Product teams**, transforming business needs into technically sound solutions. * Mentor mid-level and junior developers, influence team technical standards, and support recruitment when needed. **What We Expect From You:** * Solid production experience with **Python** (5+ years or equivalent), with mastery of best practices such as type hints, project organization, and coding standards. * Practical experience with **web scraping, crawlers, and/or complex integrations**, using Scrapy, BeautifulSoup, Selenium, or equivalent tools. * Experience developing **APIs with FastAPI and/or Flask**, including authentication, validation, versioning, and documentation. * Knowledge of **robust REST integrations**, applying concepts such as timeouts, retries, idempotency, circuit breaker (where applicable), and observability. * Familiarity with **containers (Docker)** and cloud environments, with ability to operate and debug production services. * Experience with both **relational and non-relational databases** (PostgreSQL and/or MongoDB), including modeling and performance considerations. * Strong communication skills, autonomy, and comfort working remotely in a dynamic, startup-like environment. **Nice-to-Have Qualifications:** * Experience with **GCP** (Cloud Run, Cloud Functions) and/or **AWS Lambda**. * Experience with **Kubernetes** or operation of distributed workloads. * Experience with **queues and event systems** (Pub/Sub, SQS, RabbitMQ, Kafka) and asynchronous processing. * Knowledge of **Node.js and TypeScript** for backend service integration. * Experience with **Playwright**. * Technical or conversational English.