xinference.client.Client.query_engine_by_model_name#

Client.query_engine_by_model_name(model_name: str, model_type: str | None = 'LLM', enable_virtual_env: bool | None = None)[fuente]#

Get the engine parameters with the model name registered on the server.

Parámetros:

  • model_name (str) – The name of the model.

  • model_type (str) – Model type, LLM by default.

Devuelve:

The supported engine parameters of registered models on the server.

Tipo del valor devuelto:

Dict[str, List[Dict[str, Any]]]