Blog
Guides to local inference control-plane workflows.
Why inferctl does not run inference
Inferctl plans a local route and checks readiness. Your client sends the model request.
Readiness is not a test prompt
A readiness check should collect route evidence without sending a model prompt.
Pass a handoff, not a prompt
Use inferctl to select a local endpoint and model. Keep prompts, credentials, and request execution in the client.