rh> .UdZddlZddlZddlZddlZddlZddlmZddlm Z ddl m Z ddl m Z mZmZmZmZmZmZmZmZmZmZmZmZmZddlmZddlmZmZm Z m!Z!m"Z"m#Z#d d l$m%Z%m&Z&m'Z'm(Z(d d l)m*Z*m+Z+e rdd l,m-Z-m.Z.ddl/m0Z0e1Z2ee1e fZ3ee4efZ5ee5e3e2dfZ6ddhZ7ejpe9Z:e GddZ;e GddZdZ?ede6dee5fdZ@ededdeedfdZ@edee6deee5ddffdZ@de6de1fdZAde6de1de1fd ZBd!e1ddfd"ZCde4defd#ZDde4defd$ZEde4ddfd%ZFd&ee4efdefd'ZGd(ee4d)eHdeee1ee+ffd*ZId(ee4d)eHdeee1ee+ffd+ZJd,e4d)eHdeee1e+ffd-ZKd.ee4dee*fd/ZLd.ee4dee*fd0ZMd,e4dee*fd1ZNd2d3d&d4dee4fd5ZOiZPeee1ee1feQd6<d7ee1d8ee1ddfd9ZRd7ee1dee1fd:ZSd;edefd<ZTd=ee1d>ee1de!fd?ZUy)@zEContains utilities used by both the sync and async inference clients.N)contextmanager) dataclass)Path) TYPE_CHECKINGAny AsyncIterableBinaryIOContextManagerDict GeneratorIterableListLiteralNoReturnOptionalUnionoverload) HTTPError)GenerationErrorIncompleteGenerationErrorOverloadedErrorTextGenerationError UnknownErrorValidationError) get_sessionis_aiohttp_availableis_numpy_availableis_pillow_available)ChatCompletionStreamOutputTextGenerationStreamOutput)ClientResponse ClientSessionImager&z text-to-imagezimage-to-imagecreZdZUeed<eed<eeed<eeeeefed<ee ed<eee fed<y)RequestParametersurltaskmodeljsondataheadersN) __name__ __module__ __qualname__str__annotations__rrr rContentTrt/var/www/html/ai-insurance-compliance-backend/venv/lib/python3.12/site-packages/huggingface_hub/inference/_common.pyr(r(IsE H I C= 5dD) ** 8  #s(^r6r(c:eZdZUdZeed<eed<eed<eed<y) ModelStatusas This Dataclass represents the model status in the HF Inference API. Args: loaded (`bool`): If the model is currently loaded into HF's Inference API. Models are loaded on-demand, leading to the user's first request taking longer. If a model is loaded, you can be assured that it is in a healthy state. state (`str`): The current state of the model. This can be 'Loaded', 'Loadable', 'TooBig'. If a model's state is 'Loadable', it's not too big and has a supported backend. Loadable models are automatically loaded when the user first requests inference on the endpoint. This means it is transparent for the user to load a model, except that the first call takes longer to complete. compute_type (`Dict`): Information about the compute resource the model is using or will use, such as 'gpu' type and number of replicas. framework (`str`): The name of the framework that the model was built with, such as 'transformers' or 'text-generation-inference'. loadedstate compute_type frameworkN)r/r0r1__doc__boolr3r2r r5r6r7r9r9Ts, L JNr6r9c8ts tdddl}|S)NzMPlease install aiohttp to use `AsyncInferenceClient` (`pip install aiohttp`).r)r ImportErroraiohttp)rBs r7_import_aiohttprCus  !ijj Nr6c8ts tdddl}|S)z.Make sure `numpy` is installed on the machine.zGPlease install numpy to use deal with embeddings (`pip install numpy`).rN)rrAnumpy)rEs r7 _import_numpyrF~s  cdd Lr6c<ts tdddlm}|S)z,Make sure `PIL` is installed on the machine.zPlease install Pillow to use deal with images (`pip install Pillow`). If you don't want the image to be post-processed, use `client.post(...)` and get the raw response from the server.rr%)rrAPILr&r%s r7_import_pil_imagerIs%   `   Lr6contentreturncyNr5rJs r7_open_as_binaryrOs"r6cyrMr5rNs r7rOrOs%(r6c#Kt|tr|jds|jdr>tj d|t j |jyt|}|jstd|dt|tr7tj d||jd5}|dddytryd d l m}t||jr]tj d tj }|j#||j$xsd |j'y|y#1swYyxYww)zOpen `content` as a binary file, either from a URL, a local path, raw bytes, or a PIL Image. Do nothing if `content` is None. TODO: handle base64 as input https://http://zDownloading content from NzFile not found at z. If `data` is a string, it must either be a URL or a path to a local file. To pass raw content, please encode it as bytes first.zOpening content from rbrr%zConverting PIL Image to bytesPNG)format) isinstancer2 startswithloggerdebugrgetrJrexistsFileNotFoundErroropenrrHr&ioBytesIOsaverVgetvalue)rJfr&buffers r7rOrOs9'3   j )W-?-? -J LL4WI> ?-##G,44 4 w-~~#$WI.OO  '4  ,WI67 \\$  1G  gu{{ + LL8 9ZZ\F LL(?%L @//# #  M! sCE8E,BE8,E51E8ct|5}t|tr|n|j}t j |j cdddS#1swYyxYw)z\Encode a raw file (image, audio) into base64. Can be bytes, an opened file, a path or a URL.N)rOrWbytesreadbase64 b64encodedecode)rJr- data_as_bytess r7 _b64_encoderlsN  !8T *4 7TYY[  .557888s AAA$default_mime_typect|tr$|jds|jdr|Sd}t|ttfrt j |dd}nGt r=ddlm}t||jr!d|jxsdj}|xs|}t|}d |d |S) NrRrSF)strictrr%zimage/rUdata:z;base64,) rWr2rXr mimetypes guess_typerrHr&rVlowerrl)rJrm mime_typer& encoded_datas r7_as_urlrvs'3W%7%7 %CwGYGYZcGdI'C;'((?B   gu{{ + '.."9E!@!@!B CDI..Iw'L 9+Xl^ 44r6 encoded_imagect}|jtjt j |S)z/Parse a base64-encoded string into a PIL Image.)rIr^r_r`rh b64decode)rwr&s r7 _b64_to_imagerzs/  E 5::bjj!1!1-!@A BBr6cHtj|jS)acParse bytes from a Response object into a Python list. Expects the response body to be JSON-encoded data. NOTE: This is exactly the same implementation as `_bytes_to_dict` and will not complain if the returned data is a dictionary. The only advantage of having both is to help the user (and mypy) understand what kind of data to expect. r,loadsrjrNs r7_bytes_to_listr~ ::gnn& ''r6cHtj|jS)acParse bytes from a Response object into a Python dictionary. Expects the response body to be JSON-encoded data. NOTE: This is exactly the same implementation as `_bytes_to_list` and will not complain if the returned data is a list. The only advantage of having both is to help the user (and mypy) understand what kind of data to expect. r|rNs r7_bytes_to_dictrrr6c`t}|jtj|S)zParse bytes from a Response object into a PIL Image. Expects the response body to be raw bytes. To deal with b64 encoded images, use `_b64_to_image` instead. )rIr^r_r`)rJr&s r7_bytes_to_imagers&  E 5::bjj) **r6responsecPt|trtj|S|SrM)rWrfr,r})rs r7_as_dictr s#-h#>4::h LHLr6bytes_output_as_linesdetailsc#bK|D]} t||}||y#t$rYywxYww)z*Used in `InferenceClient.text_generation`.N%_format_text_generation_stream_output StopIterationrr byte_payloadoutputs r7 _stream_text_generation_responsersH .  :<QF  L    s / // ,/,/ctK|23d{} t||}||7#t$rYywxYw6yw)z/Used in `AsyncInferenceClient.text_generation`.Nrrs r7&_async_stream_text_generation_responser%sS 4l :<QF  L    4s486$68 &886 3838rc|jdsy|jdk(r td|jd}t j |j djd}|jdt|d|jdtj|}|s|jjS|S Nsdata:s data: [DONE]z[DONE] signal received.zutf-8rpz/nerror error_type)rXstriprrjr,r}lstriprstripr[_parse_text_generation_errorr"parse_obj_as_instancetokentext)rrpayload json_payloadrs r7rr3s  " "8 ,.566!!'*G::gnnW5<EcI\I\IaIaIc G$[[. 0 C Z'  s A A A,rrc|dk(r t|S|dk(r t|S|dk(r t|S|dk(r t|St |S)N generationincomplete_generation overloaded validation)rrrrr)rrs r7rrsZ\!u%%,,(//\!u%%\!u%%  r6)Vr>rhr_r,loggingrq contextlibr dataclassesrpathlibrtypingrrrr r r r r rrrrrrrequestsrhuggingface_hub.errorsrrrrrrutilsrrrr_generated.typesr!r"rBr#r$ PIL.Imager&r2UrlTPathTrfBinaryTr4TASKS_EXPECTING_IMAGES getLoggerr/rYr(r9rCrFrIrOrlrvrzr~rrrr?rrrrrrrrr3rrrrr5r6r7rsL %!"_^T5  c4i x  %w. /*+;<   8 $    @  " "G" "  ( T](GDM"( ( 'Xh/'Ihw>OQUW[>[4\''T88c85X5#5#5(CCC (E(d((E(d(+U+w+MuUD[)MdM #E? 59  8C=(#=> >?  (/ :>  = }-GH HI 88"&8 eC33458, %  ()  u% -. JJ ()J*O?OTabgTh6GI#T(3-c*B%CHY8C=YVZ[^V_YdhY>8C=>T#Y>I(6  8C= Uh r6