xinference.client.Client.get_model#

Client.get_model(model_uid: str) → RESTfulModelHandle[fuente]#

Launch the model based on the parameters on the server via RESTful APIs.

Parámetros:

model_uid (str) – The unique id that identify the model.

Devuelve:

The corresponding Model Handler based on the Model specified in the uid:

xinference.client.handlers.GenerateModelHandle -> provide handle to basic generate Model. e.g. Baichuan.
xinference.client.handlers.ChatModelHandle -> provide handle to chat Model. e.g. Baichuan-chat.

Tipo del valor devuelto:

ModelHandle

Muestra:

RuntimeError – Report failure to get the wanted model with given model_uid. Provide details of failure through error message.