• 2 min read

AgriMarketWatch

Python FastAPI TimescaleDB Redis Celery Data Pipeline Astro

Summary

AgriMarketWatch is an end-to-end data pipeline, analytical intelligence engine, and accessible consumer web portal engineered to bring radical transparency to the Philippine agricultural supply chain and retail wet market (palengke) prices.

The platform aggregates fragmented, heterogeneous data across government bodies (PSA OpenSTAT, NMIS Cold Storage PDF bulletins, SRA Sugar Balances, and DA Bantay Presyo daily reports) into a unified time-series store, translating complex commodity volatility into accessible, plain-language consumer insights.


Homepage & Feature Highlights

  • Consumer Market Intelligence: Displays traffic-light supply badges (🟢 Abundant / 🟡 Stable / 🔴 Tight), 7-day price trajectory arrows, and plain-language market explanations for household grocery planners.
  • Weekly Palengke Basket Tracking: Calculates real-time total costs for staple family food baskets across 56+ wet markets nationwide, with automated budget substitution recommendations.
  • Senior-First Accessible Design (WCAG 2.1 AAA): Features dynamic text scaling, high-contrast dark/light toggles, and screen-reader voice guidance for Filipino elders (mga lolo at lola).
  • High-Throughput Time-Series Persistence: Utilizes TimescaleDB hypertables with native columnar compression (Gorilla and Delta-of-delta encoding), cutting storage footprints by ~85% while retaining sub-millisecond query performance.

High-Level Architecture

High-Level Architecture