Scaling Chat

Routing AI chat requests

Route by intent: classify the question into a small set of buckets, send hard buckets to the strong model, easy buckets to the cheap one, and keep a fallback chain for uncertainty.

Route by intent, not by hope

Classify each message into a small set of buckets: factual question, troubleshooting, sales, complaint, chitchat. Then route:

Keep the buckets few. Ten intents is enough. Fifty is a taxonomy you'll maintain forever.