kh= r U d dl Z d dlZd dlmZ d dlmZ d dlmZ d dlm Z m
Z
m Z m Z m
Z
mZmZmZmZ d dlmZmZmZmZ ddlmZ d d
lmZ d d lm Z m Z m Z m Z d d l m!Z! d
dl"m#Z# e rd dl$m%Z% ejL e' Z(e)Z*ee+d< ed Z,ee+d< G d de Z- G d de Z. G d de Z/ G d d Z0y) N)AsyncExitStack) timedelta)Path)
TYPE_CHECKINGAny
AsyncIterableDictListLiteralOptionalUnionoverload) NotRequired TypeAlias TypedDictUnpack )get_hf_hub_version )AsyncInferenceClient)ChatCompletionInputMessageChatCompletionInputToolChatCompletionStreamOutput'ChatCompletionStreamOutputDeltaToolCall)PROVIDER_OR_POLICY_T )
format_result)
ClientSessionToolName)stdiossehttp
ServerTypec d e Zd ZU eed< eee ed< eeeef ed< eeee df ed< y)StdioServerParameters_TcommandargsenvNcwd)
__name__
__module__ __qualname__str__annotations__r r
r r
r e/var/www/teggl/fontify/venv/lib/python3.12/site-packages/huggingface_hub/inference/_mcp/mcp_client.pyr% r% ! s?
L
d3i
T#s(^ $$ U3d?+ ,,r0 r% c R e Zd ZU eed< eeeef ed< ee ed< ee ed< y)SSEServerParameters_Turlheaderstimeoutsse_read_timeoutN) r* r+ r, r- r. r r r floatr/ r0 r1 r3 r3 ( s0 H
c3h
((
!%((r0 r3 c b e Zd ZU eed< eeeef ed< ee ed< ee ed< ee ed< y)StreamableHTTPParameters_Tr4 r5 r6 r7 terminate_on_closeN)
r* r+ r, r- r. r dictr r boolr/ r0 r1 r: r: / s; H
c3h
((
##!),,#D))r0 r: c * e Zd ZdZddddddee dee dee dee fdZd Zd
Z d Z
e d e d
de
e fd Ze d e d de
e fd Ze d e d de
e fd Zd edefdZ ddeeeef deee dedeeeef fdZ y) MCPClienta
Client for connecting to one or more MCP servers and processing chat completions with tools.
This class is experimental and might be subject to breaking changes in the future without prior notice.
Args:
model (`str`, `optional`):
The model to run inference with. Can be a model id hosted on the Hugging Face Hub, e.g. `meta-llama/Meta-Llama-3-8B-Instruct`
or a URL to a deployed Inference Endpoint or other local or remote endpoint.
provider (`str`, *optional*):
Name of the provider to use for inference. Defaults to "auto" i.e. the first of the providers available for the model, sorted by the user's order in https://hf.co/settings/inference-providers.
If model is a URL or `base_url` is passed, then `provider` is not used.
base_url (`str`, *optional*):
The base URL to run inference. Defaults to None.
api_key (`str`, `optional`):
Token to use for authentication. Will default to the locally Hugging Face saved token if not provided. You can also use your own provider API key to interact directly with the provider's service.
N)modelproviderbase_urlapi_keyr@ rA rB rC c i | _ t | _ g | _ |
| t d || _ t
|d n|||| | _ y )NzCAt least one of `model` or `base_url` should be set in `MCPClient`.)r@ rA rC rB )sessionsr
exit_stackavailable_tools
ValueError
payload_modelr client)selfr@ rA rB rC s r1 __init__zMCPClient.__init__N sZ :<
(*>@ =X - bc c "*".$E
r0 c K | j j d{ | j j d{ | S 7 (7 w)zEnter the context managerN)rJ
__aenter__rF rK s r1 rN zMCPClient.__aenter__e s@ kk$$&&&oo((*** '*s! A
A !A
A A
A
c K | j j ||| d{ | j d{ y7 7 w)zExit the context managerN)rJ __aexit__cleanup)rK exc_typeexc_valexc_tbs r1 rQ zMCPClient.__aexit__k s: kk##Hgv>>>lln ? s !AAAAAAc K | j j d{ | j j d{ y7 '7 w)zClean up resourcesN)rJ closerF acloserO s r1 rR zMCPClient.cleanupp s; kk !!!oo$$&&& "&s! A A!A A
A
A typer paramsc K y wNr/ rK rY rZ s r1 add_mcp_serverzMCPClient.add_mcp_serveru s gj r! c K y wr\ r/ r] s r1 r^ zMCPClient.add_mcp_serverx s cfr_ r" c K y wr\ r/ r] s r1 r^ zMCPClient.add_mcp_server{ s ilr_ c K ddl m}m} ddl m} |dk( rddlm} t j d|d d|j d g d|d i}d
D ] }|j | || ||< |d i |} | j j || d { \ }
} n|d k( rvdd
l m } t j d|d d|d i}dD ] }|j | || ||< | j j | d i | d { \ }
} n|dk( rwddl
m}
t j d|d d|d i}dD ] }|j | || ||< | j j |
d i | d { \ }
} }nt d| | j j ||
| |j! dt# d { }t j% d |j' d { |j) d { }t j% d|j* D cg c] }|j, c} |j* D ] }|j, | j. v r$t j1 d|j, d ?|| j. |j, < | j2 j5 t7 j8 d |j, |j: |j< d d y 7 7 7 7 E7 7 c c}w w)!aU Connect to an MCP server
Args:
type (`str`):
Type of the server to connect to. Can be one of:
- "stdio": Standard input/output server (local)
- "sse": Server-sent events (SSE) server
- "http": StreamableHTTP server
**params (`Dict[str, Any]`):
Server parameters that can be either:
- For stdio servers:
- command (str): The command to run the MCP server
- args (List[str], optional): Arguments for the command
- env (Dict[str, str], optional): Environment variables for the command
- cwd (Union[str, Path, None], optional): Working directory for the command
- For SSE servers:
- url (str): The URL of the SSE server
- headers (Dict[str, Any], optional): Headers for the SSE connection
- timeout (float, optional): Connection timeout
- sse_read_timeout (float, optional): SSE read timeout
- For StreamableHTTP servers:
- url (str): The URL of the StreamableHTTP server
- headers (Dict[str, Any], optional): Headers for the StreamableHTTP connection
- timeout (timedelta, optional): Connection timeout
- sse_read_timeout (timedelta, optional): SSE read timeout
- terminate_on_close (bool, optional): Whether to terminate on close
r )r StdioServerParameters)typesr ) stdio_clientz-Connecting to stdio MCP server with command: r& r' )r' r( r) Nr! )
sse_clientz!Connecting to SSE MCP server at: r4 )r5 r6 r7 r" )streamablehttp_clientz,Connecting to StreamableHTTP MCP server at: )r5 r6 r7 r; zUnsupported server type: zhuggingface_hub.MCPClient)nameversion) read_stream write_stream client_infozInitializing session...z Connected to server with tools:zTool 'z.' already defined by another server. Skipping.function)ri description
parameters)rY rn r/ ) mcpr rc rd mcp.client.stdiore loggerinfogetrF enter_async_contextmcp.client.sserg mcp.client.streamable_httprh rH Implementationr debug
initialize
list_toolstoolsri rE warningrG appendr parse_obj_as_instancero inputSchema)rK rY rZ r rc mcp_typesre
client_kwargskey
server_paramsreadwriterg rh _sessionresponsetools r1 r^ zMCPClient.add_mcp_server~ s1 8 =* 7? 5 KKGyHYGZZ[\b\f\fgmoq\r[st u &y(9 :M-
5::c?.)/M#&
5 2 BM BM $ C CLQ^D_ ``KD%
U] 1 KK;F5M?K L "F5M 2MA
5::c?.)/M#&
5 !% C CJD_Q^D_ ``KD%
V^ H KKFve}oV W "F5M 2MW
5::c?.)/M#&
5 $(??#F#FG\Gm_lGm#n nND% 8 ?@ @ ;; " % 4 44 . 0 5
./ """ !++-- 6x~~8^t8^_ NN DyyDMM) {2` ab (/DMM$)) $
' ''== *$(II+/+;+;*.*:*:%
[ a a o
# .8^s A%M (6M L) A M ,.M L,A M '.M L/AM -L2.,M L5M 2L83"M L;
(CM ,M /M 2M 5M 8M ;M messagesexit_loop_toolsexit_if_first_chunk_no_toolreturnc K | j }|g || j }| j j j j | j
||dd d{ }ddd}i }d}|2 3 d{ } |d z
}| j r1t | j dkD r| j d j nd}
|
sP|
j r|
j |d
< |
j r|d xx |
j z
cc< |
j r|
j D ] } | j |vrP| j j | j j d k( rd| j _ | || j < a| j j sx|| j j xj | j j z
c_ |r|d
k rt | dk( r y| ~7 7 }6 |d s|r|j d
dk( rd|d
< |rjg } |j! D ]P }
| j# |
j$ d|
j j& |
j j xs d dd R | |d< |j# | |j! D ] } | j j& } t) j* | j j xs d }n_# t( j, $ rI}d| j$ |d| d}t/ j0 | }|j# | | Y d}~d}~ww xY wd| j$ d|d}|rY||D cg c] }|j j& nc c}w c}v r-t/ j0 | }|j# | | y| j2 j | }|I |j5 || d{ 7 }t7 | |d < n&# t8 $ r}d| |d < Y d}~nd}~ww xY wd| |d < t/ j0 | }|j# | | yw)au Process a query using `self.model` and available tools, yielding chunks and tool outputs.
Args:
messages (`List[Dict]`):
List of message objects representing the conversation history
exit_loop_tools (`List[ChatCompletionInputTool]`, *optional*):
List of tools that should exit the generator when called
exit_if_first_chunk_no_tool (`bool`, *optional*):
Exit if no tool is present in the first chunks. Default to False.
Yields:
[`ChatCompletionStreamOutput`] chunks or [`ChatCompletionInputMessage`] objects
NautoT)r@ r r} tool_choicestreamunknown )rolecontentr r r r z{}r assistantrn )ri arguments)idrY rn
tool_callsr z%Invalid JSON generated by the model: )r tool_call_idri r )r r r ri z0Error: MCP tool call failed with error message: z"Error: No session found for tool: ) rG rJ chat completionscreaterI choiceslendeltar r r indexrn r ru valuesr r ri jsonloadsJSONDecodeErrorr r rE call_toolr Exception)rK r r r r} r messagefinal_tool_calls
num_of_chunkschunkr tool_calltool_calls_listtc
function_name
function_argserr tool_messagetool_message_as_objtr results r1 process_single_turn_with_toolsz(MCPClient.process_single_turn_with_tools s@ ( $$ &=o=(<(<=E ))55<<$$ =
,5"DOQ
$ % Q M.3mmEMM@RUV@VEMM!$**\`E zz"'**}} "emm3" !&!1!1
mI .>> % . . 8 8 @IDVDVD`D`dhDh;=I . . 8?E& "$'>"?@E& &* E&
u 79S ST U E&r0 r? )1r logging
contextlibr datetimer pathlibr typingr r r r r
r r r
r typing_extensionsr r r r utils._runtimer _generated._async_clientr _generated.typesr r r r
_providersr utilsr rq r getLoggerr* rs r- r r. r# r% r3 r: r? r/ r0 r1 r s % d d d G G 0 ; . ! 8 $ ) 67
I 7-i -)I )* *z& z&r0