Infrastructure-as-code for Shortlist — a system that uses LLMs to automatically assess real-estate listings.
- GKE cluster with a general-purpose node pool and a Spot GPU node pool for LLM inference
- Multi-cloud: GCP for compute/storage, AWS SES for transactional email (SPF, DKIM, DMARC)
- Cross-cloud auth via OIDC workload identity federation (GKE → AWS IAM)
- GCS model cache to avoid redundant transformer model downloads
The system is composed of several single-purpose microservices.
| Component | Purpose |
|---|---|
shortlist-runner |
Core profile assessment orchestration |
shortlist-llm-assessor |
LLM inference on GPU nodes |
shortlist-rm-ingester |
Web scraping/data ingestion (optional) |
shortlist-rm-email-notifier |
Email notifications to house hunter (optional) |
Helm releases for most of these components live here.
Terraform · GKE · Helm · AWS SES · GCS · OIDC Federation