Skip to content
#

two-tier-inference

Star

Here are 2 public repositories matching this topic...

Language: All
Filter by language
All 2 C++ 1 TypeScript 1

aws-samples / sample-nvidia-nemotron-cascade-workshop

Star 0

Sample code for two-tier LLM inference (cascading) on Amazon Bedrock, using a single Bedrock Converse API surface. NVIDIA Nemotron Nano handles routine support-ticket classification on every request; Anthropic Claude Sonnet handles cases the routing logic flags as harder. Includes a bake-off harness, sample data, and tests. Next.js + TypeScript.

typescript workshop nextjs mit-0 anthropic-claude amazon-bedrock aws-samples nvidia-nemotron model-routing llm-cost-optimization llm-cascade bedrock-converse-api two-tier-inference
  • Updated Jun 19, 2026
  • TypeScript

Improve this page

Add a description, image, and links to the two-tier-inference topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the two-tier-inference topic, visit your repo's landing page and select "manage topics."

Learn more