rhH,ddlmZddlZddlZddlmZddlmZmZm Z ddl m Z m Z  ddlm Z ddlZddlmZmZmZmZmZmZddlmZdd lmZdd lmZej<eZ er erdd l!m"Z"dd Z#Gd deZ$y#e$r ddlm Z YdwxYw)) annotationsN)Path) TYPE_CHECKINGAnyCallable)load_onnx_modelload_openvino_model)Self) AutoConfig AutoModel AutoTokenizer MT5ConfigPretrainedConfigT5Config)is_peft_available)find_adapter_config_file) InputModule PeftConfigcdfd }|S)Ncttjt|z dt|z fi|S)NT)exist_ok)osmakedirsr)save_directorykwargs_save_pretrained_fn subfolders {/var/www/html/ai-insurance-compliance-backend/venv/lib/python3.12/site-packages/sentence_transformers/models/Transformer.pywrapperz)_save_pretrained_wrapper..wrappers5 D(94tD"4#7)#CNvNN)rz str | PathreturnNone)rrr s`` r_save_pretrained_wrapperr%sO Nr!ceZdZUdZdZded<ddgZded<d Zd ed < d dfd Z dd Z ddZ ddZ ddZ ddZ ddZd dZ d! d"dZd!d#dZe d$ d%dZe d$ d&dZe d' d(fd ZxZS)) TransformeraHugging Face AutoModel to generate token embeddings. Loads the correct class, e.g. BERT / RoBERTa etc. Args: model_name_or_path: Hugging Face models name (https://huggingface.co/models) max_seq_length: Truncate any inputs longer than max_seq_length model_args: Keyword arguments passed to the Hugging Face Transformers model tokenizer_args: Keyword arguments passed to the Hugging Face Transformers tokenizer config_args: Keyword arguments passed to the Hugging Face Transformers config cache_dir: Cache dir for Hugging Face Transformers to store/load models do_lower_case: If true, lowercases the input (independent if the model is cased or not) tokenizer_name_or_path: Name or path of the tokenizer. When None, then model_name_or_path is used backend: Backend used for model inference. Can be `torch`, `onnx`, or `openvino`. Default is `torch`. sentence_bert_config.jsonstrconfig_file_namemax_seq_length do_lower_casez list[str] config_keysTbool save_in_rootc t |||_| |_|i}|i}|i}|j ||| |\} } |j || || | fi|| d|vr||d<t j||n|fd|i||_|t|jdrtt|jjdrTt|jdr>t|jjj|jj}||_|:|jj j"|jj_yy)Nmodel_max_length cache_dirconfigmax_position_embeddings)super__init__r,backend _load_config _load_modelr from_pretrained tokenizerhasattr auto_modelr3minr4r1r+ __class____name__tokenizer_class) selfmodel_name_or_pathr+ model_argstokenizer_args config_argsr2r,tokenizer_name_or_pathr7r3 is_peft_modelr?s rr6zTransformer.__init__@s^ *  J  !N  K $ 1 12DiQXZe f +VYeZde  %*?!$T__%;%;%S%SUYUcUcUtUt!u, ! -59^^5M5M5V5VDOO " " 2 .r!c @t|||jd|jd|jdd Dts td|dk7r t dd d lm}|j|fi|d |id fStj|fi|d |idfS) aLoads the transformers or PEFT configuration Args: model_name_or_path (str): The model name on Hugging Face (e.g. 'sentence-transformers/all-MiniLM-L6-v2') or the path to a local model directory. cache_dir (str | None): The cache directory to store the model configuration. backend (str): The backend used for model inference. Can be `torch`, `onnx`, or `openvino`. config_args (dict[str, Any]): Keyword arguments passed to the Hugging Face Transformers config. Returns: tuple[PretrainedConfig, bool]: The model configuration and a boolean indicating whether the model is a PEFT model. tokenrevisionlocal_files_onlyF)r2rJrKrLzgLoading a PEFT model requires installing the `peft` package. You can install it via `pip install peft`.torchaPEFT models can currently only be loaded with the `torch` backend. To use other backends, load the model with `backend="torch"`, call `model.transformers_model.merge_and_unload()`, save that model with `model.save_pretrained()` and then load the model with the desired backend.rrr2T) rgetr Exception ValueErrorpeftrr:r )rBrCr2r7rFrs rr8zTransformer._load_configos %"#!oog.$4!,1CU!K   %&}'! w (-:--.@eKe[degkk k))*<a aW`achhhr!c |dk(r|rdD]}|j|dt|tr|j|||fi|yt|tr|j |||fi|yt j|f||d||_y|dk(rtd ||dd||_y|dk(rtd ||dd||_ytd |d ) aLoads the transformers or PEFT model into the `auto_model` attribute Args: model_name_or_path (str): The model name on Hugging Face (e.g. 'sentence-transformers/all-MiniLM-L6-v2') or the path to a local model directory. config ("PeftConfig" | PretrainedConfig): The model configuration. cache_dir (str | None): The cache directory to store the model configuration. backend (str): The backend used for model inference. Can be `torch`, `onnx`, or `openvino`. is_peft_model (bool): Whether the model is a PEFT model. model_args (dict[str, Any]): Keyword arguments passed to the Hugging Face Transformers model. rM)rKNr3r2onnxzfeature-extraction)rCr3 task_nameopenvinozUnsupported backend 'z6'. `backend` should be `torch`, `onnx`, or `openvino`.r$) pop isinstancer_load_t5_modelr_load_mt5_modelr r:r=rr rP)rBrCr3r2r7rHrDadapter_only_kwargs rr9zTransformer._load_models( g *6=&NN#5t<=&(+###$6 XZXFI.$$$%7YjY"+";";&#/5#NX# -#5. DO  "1#5. DO4WI=stu ur!c Vddlm}dg|_|j|f||d||_y)Loads the encoder model from T5r)T5EncoderModel decoder.*rSN) transformersr^"_keys_to_ignore_on_load_unexpectedr:r=)rBrCr3r2rDr^s rrYzTransformer._load_t5_models8/=HM98.88  '- FP r!c Vddlm}dg|_|j|f||d||_y)r]r)MT5EncoderModelr_rSN)r`rcrar:r=)rBrCr3r2rDrcs rrZzTransformer._load_mt5_models80>I]:9/99  '- FP r!c|dt|j|jjjdS)Nz Transformer() architecture))dictget_config_dictr=r?r@rBs r__repr__zTransformer.__repr__s3d4#7#7#9HaHaHjHjkllmnnr!c l|jDcic] \}}|dvr||}}}|jd i||ddi}|d}||d<trddlm}t |j|r|jj jrr|jd} |d} tj| |jj j| j} tj| | fd |d<|jjjr d |vr|d |d <|Scc}}w)z#Returns token_embeddings, cls_token) input_idsattention_masktoken_type_ids inputs_embeds return_dictTrtoken_embeddings)PeftModelForFeatureExtractionrm)device)dim hidden_statesall_layer_embeddingsr$)itemsr=rrQrrrXactive_peft_configis_prompt_learningsizerMonesnum_virtual_tokensrscatr3output_hidden_states) rBfeaturesrkeyvaluetrans_featuresoutputsrqrr batch_sizermprefix_attention_masks rforwardzTransformer.forwards7'nn. UXX J  "$//ONOfO$O"1:'7#$   :4??,IJOO66II-2215 !)*:!;(-  B B U U^l^s^s)%.3YY8M~7^de-f)* ?? ! ! 6 6?g;U/6/GH+ ,; sD0cB|jjjS)N)r=r3 hidden_sizeris rget_word_embedding_dimensionz(Transformer.get_word_embedding_dimensions%%111r!c i}t|dtr|g}nt|dtr\g}g|d<|D]L}tt |j \}}|j ||dj |N|g}n7gg} }|D]*} |j | d| j | d,|| g}|D cgc])} | D cgc]} t| jc} +}} } |jr-|D cgc] } | D cgc]} | jc} "}} } |j|j||dd|jd|Scc} wcc} } wcc} wcc} } w)z-Tokenizes a text and maps tokens to token-idsr text_keysrt longest_firstpt)padding truncationreturn_tensors max_length) rXr)rgnextiterrxappendstripr,lowerupdater;r+) rBtextsroutput to_tokenizelookuptext_keytextbatch1batch2 text_tuplecolss rtokenizezTransformer.tokenizesr eAh $ 'K a$ 'K"$F;  5!%d6<<>&:!;$""4({#**84 5'-KFF# -  jm, jm, -"6*KALL41A 4L L   ?JKs3!AGGI3KKK DNN*#..    5L4Ks0 E$ E .E$ E/E* 'E/E$*E/c |jj|||jj||j|y)N)safe_serialization)r=save_pretrainedr; save_config)rB output_pathrrs rsavezTransformer.save.s: '' HZ'[ &&{3 %r!c N|j||||||||| | |  } |dd|i| S)N) rCrrJ cache_folderrKrLtrust_remote_code model_kwargstokenizer_kwargs config_kwargsr7rCr$)_load_init_kwargs)clsrCrrJrrKrLrrrrr7r init_kwargss rloadzTransformer.load3sP$++1%-/%-',  H&8HKHHr!c  |j||||||} |||||d}d| vri| d<d| vri| d<d| vri| d<| dj|| dj|| dj||r| dj|| r| dj| | r| dj| i| || dS)N)rCrrJrrKrL)rrJrKrLrrDrErF)r2r7) load_configr)rrCrrJrrKrLrrrrr7rr3 hub_kwargss rrzTransformer._load_init_kwargsTs$1%- ! # 0!2   v %#%F< 6 )')F# $  &$&F= ! |##J/ '' 3}$$Z0  < ' ' 5  # $ + +,< =  = ! ( ( 7H&H|HHr!c |r|gngd}|D]}t ||||||||} | snd vrd| dvr| djdd| vrd| dvr| djdd| vrd| dvr| djd| S)N)r(zsentence_roberta_config.jsonzsentence_distilbert_config.jsonzsentence_camembert_config.jsonzsentence_albert_config.jsonz sentence_xlm-roberta_config.jsonzsentence_xlnet_config.json)rCrconfig_filenamerJrrKrLrDrrErF)r5rrW) rrCrrrJrrKrLconfig_filenamesr3r?s rrzTransformer.load_configs   0 OW(#5# /)!!1)F  6 !&9VL=Q&Q < $ $%8 9 v %*=HXAY*Y # $ ( ()< = F "':f]>S'S = ! % %&9 : r!)NNNNNFNrM)rCr)r+z int | NonerDdict[str, Any] | NonerErrFrr2 str | Noner,r.rGrr7r)r"r#) rCr)r2rr7r)rFdict[str, Any]r"z*tuple[PeftConfig | PretrainedConfig, bool]) rCr)r3zPeftConfig | PretrainedConfigr2r)r7r)rHr.r"r#)rCr)r3rr2r)r"r#)r"r))rdict[str, torch.Tensor]r"r)r"int)T)rz.list[str] | list[dict] | list[tuple[str, str]]rz str | boolr"r)rr)rr.r"r#) NNNFFNNNrM)rCr)rr)rJbool | str | NonerrrKrrLr.rr.rrrrrrr7r)r"r )rCr)rr)rJrrrrKrrLr.rr.rrrrrrr7r)r"r)rNNNNF)rCr)rr)rrrJrrrrKrrLr.r"r)r@ __module__ __qualname____doc__r*__annotations__r-r/r6r8r9rYrZrjrrrr classmethodrrr __classcell__)r?s@rr'r'$sc.8c7.@K@L$ &*,004-1 $#-1-W-W#-W* -W . -W + -W-W-W!+-W-W -W^(i"%(i2<(iGJ(iYg(i 3(iT2v2v.2v 2v  2v  2v 2vh  oB2\`&C&NX& &P&  #'#'#!&"'.226/3II I ! I ! III I,I0I-II !II@ #'#'#!&"'.226/37I7I 7I ! 7I ! 7I7I7I 7I,7I07I-7I7I !7I7Ir&*#'#'#!&+++$ + ! + ! +++ ++r!r')rrrr)r"zCallable[..., None])% __future__rloggingrpathlibrtypingrrrsentence_transformers.backendrr r ImportErrortyping_extensionsrMr`r r r rrrtransformers.utils.import_utilsrtransformers.utils.peft_utilsr(sentence_transformers.models.InputModuler getLoggerr@loggerrQrr%r'r$r!rrs{" //N' dd=B@   8 $&(V+V1'&'sB BB