Job Summary: We are seeking a developer to design, build, and maintain web scraping, automation, and API applications within an intelligence HUB for agricultural credit. Key Highlights: 1. Work in a comprehensive intelligence HUB for agricultural credit. 2. Design and build robust web scraping and API applications. 3. Collaborate with Backend, Data, and Product teams, and mentor developers. AgRisk is a **comprehensive intelligence HUB** **that integrates data, technology, governance, and analytics** to support every stage of the agricultural credit journey. As a pioneering solution in the sector, it establishes a new standard of efficiency, simplicity, and precision—enabling faster, safer, and more consistent decisions for **risk, credit, compliance, and intelligence** teams. **Core HUB Solutions:** * **AgRisk:** Integrates national restrictive data into the credit analysis workflow, enabling structured reading of delinquency, payment history, and risk signals throughout the decision-making journey. Information is consolidated into a single environment and used to support more consistent credit decisions—always alongside financial, legal, and behavioral data. * **AgFlow:** A credit pipeline responsible for structuring and organizing the credit analysis and decision-making journey—from registration to formalization. * **CredAcademy:** Training for professionals seeking authority over agricultural credit. **Your Responsibilities:** * Design, build, and maintain **web scraping and crawler** applications focused on robustness and scalability, using tools such as Scrapy, BeautifulSoup, Selenium, or Playwright as needed. * Define and implement **resilience strategies**, including retries, rate limiting, IP and user-agent rotation, layout change detection, fallbacks, and idempotent reprocessing. * Create and maintain **automations and pipelines** (scheduled jobs, workers, asynchronous processes), ensuring traceability and metrics. * Develop and maintain **REST API integrations** (internal and external), ensuring proper error handling, contracts, and versioning. * Build and evolve **APIs using FastAPI and/or Flask**, with emphasis on performance, security, and standardization. * Continuously improve the **quality and reliability** of solutions through testing, code review, linting, CI/CD, and observability (structured logs, metrics, and tracing where applicable). * Collaborate closely with **Backend, Data, and Product teams**, translating business needs into technically sound solutions. * Mentor mid-level and junior developers, influencing team technical standards and supporting recruitment when needed. **What We Expect From You:** * Solid production experience with **Python** (5+ years or equivalent), with strong command of best practices such as typing, project organization, and coding standards. * Practical experience with **web scraping, crawlers, and/or complex integrations**, using Scrapy, BeautifulSoup, Selenium, or equivalent tools. * Experience developing **APIs with FastAPI and/or Flask**, including authentication, validation, versioning, and documentation. * Knowledge of **robust REST integrations**, applying concepts such as timeouts, retries, idempotency, circuit breakers (where applicable), and observability. * Familiarity with **containers (Docker)** and cloud environments, with ability to operate and debug production services. * Experience with both **relational and non-relational databases** (PostgreSQL and/or MongoDB), including data modeling and performance considerations. * Strong communication skills, autonomy, and comfort working remotely in a dynamic, startup-like environment. **Nice-to-Have Qualifications:** * Experience with **GCP** (Cloud Run, Cloud Functions) and/or **AWS Lambda**. * Experience with **Kubernetes** or operation of distributed workloads. * Experience with **queues and event systems** (Pub/Sub, SQS, RabbitMQ, Kafka) and asynchronous processing. * Knowledge of **Node.js and TypeScript** for integration with backend services. * Experience with **Playwright**. * Technical or conversational English.