Skip to main content

Module model_router

sqz_engine

Module model_router 

Source

Structsยง

ModelRouter
Routes tasks to local or remote models based on complexity heuristics.
RoutingDecision
The result of a routing decision.
TaskContext
Context describing a task to be routed to a model.