rhpdZddlmZddlmZddlmZmZeje Z GddeZ dgZ y) zPaliGemmamodel configuration)PretrainedConfig)logging)CONFIG_MAPPING AutoConfigcLeZdZdZdZddiZeedZdgZ dfd Z xZ S) PaliGemmaConfiga This is the configuration class to store the configuration of a [`PaliGemmaForConditionalGeneration`]. It is used to instantiate an PaliGemmamodel according to the specified arguments, defining the model architecture. Instantiating a configuration with the defaults will yield a similar configuration to that of the PaliGemma-2B. e.g. [paligemma-hf/paligemma-2b](https://huggingface.co/paligemma-hf/paligemma-2b) Configuration objects inherit from [`PretrainedConfig`] and can be used to control the model outputs. Read the documentation from [`PretrainedConfig`] for more information. Args: vision_config (`PaliGemmaVisionConfig`, *optional*): Custom vision config or dict text_config (`Union[AutoConfig, dict]`, *optional*): The config object of the text backbone. Can be any of `LlamaConfig` or `MistralConfig`. image_token_index (`int`, *optional*, defaults to 256000): The image token index to encode the image prompt. vocab_size (`int`, *optional*, defaults to 257152): Vocabulary size of the PaliGemmamodel. Defines the number of different tokens that can be represented by the `inputs_ids` passed when calling [`~PaliGemmaForConditionalGeneration`] projection_dim (`int`, *optional*, defaults to 2048): Dimension of the multimodal projection space. hidden_size (`int`, *optional*, defaults to 2048): Dimension of the hidden layer of the Language model. Example: ```python >>> from transformers import PaliGemmaForConditionalGeneration, PaliGemmaConfig, SiglipVisionConfig, GemmaConfig >>> # Initializing a Siglip-like vision config >>> vision_config = SiglipVisionConfig() >>> # Initializing a PaliGemma config >>> text_config = GemmaConfig() >>> # Initializing a PaliGemma paligemma-3b-224 style configuration >>> configuration = PaliGemmaConfig(vision_config, text_config) >>> # Initializing a model from the paligemma-3b-224 style configuration >>> model = PaliGemmaForConditionalGeneration(configuration) >>> # Accessing the model configuration >>> configuration = model.config ``` paligemmaimage_token_idimage_token_index) text_config vision_configpast_key_valuesc ||_||_||_||_d|_t |jt r,|jdd|d<t|ddi||_n|tddddddd d d |_||_ t |jt r,|jdd |d<t|ddi||_ n|td d ddddd||_ |jj|jjzdz|j_ ||j_t|8di|y)NF model_typesiglip_vision_modelii)intermediate_size hidden_size patch_size image_sizenum_hidden_layersnum_attention_heads vocab_sizevision_use_headgemmai@)rrrrnum_key_value_headsis_encoder_decoderrr)r projection_dimrrr& isinstancedictgetrr rrnum_image_tokenssuper__init__) selfrr r rr(rkwargs __class__s /var/www/html/ai-insurance-compliance-backend/venv/lib/python3.12/site-packages/transformers/models/paligemma/configuration_paligemma.pyr.zPaliGemmaConfig.__init__Nsg"3,&*"' d(($ /*7*;*;LJ_*`M, '!/ l0K!L!]}!]D   "!/0E!F"& "$$&! % "D ' d&& -(3 g(NK %-k,.GHW;WD   -g6 "$"'$%$%#(% D .2-?-?-J-JdN`N`NkNk-kpq,q),:) "6")NNirr!r!) __name__ __module__ __qualname____doc__r attribute_mapr sub_configskeys_to_ignore_at_inferencer. __classcell__)r1s@r2r r sP, \J-M#-zJK#4"5 /#/#r3r N) r7configuration_utilsrutilsrautorr get_loggerr4loggerr __all__r'r3r2rBsA#3-   H %e#&e#P  r3