rh)dZddlZddlmZmZddlmZddlmZddl m Z m Z m Z m Z mZddlmZmZdd lmZd d lmZej,eZGd d eZd gZy)zq Processor class for InstructBLIP. Largely copy of Blip2Processor with addition of a tokenizer for the Q-Former. N)OptionalUnion) BatchFeature)ProcessorMixin) AddedTokenPaddingStrategyPreTokenizedInput TextInputTruncationStrategy) TensorTypelogging) VideoInput) AutoTokenizerc$4eZdZdZgdZdZdZdZdfd Z dde de e e e e e e fded e eeefd e eeefd eed ed eedeedededededededee eefdef"dZdZdZedZfdZefdZxZS)InstructBlipVideoProcessora Constructs an InstructBLIPVideo processor which wraps a InstructBLIP image processor and a LLaMa/T5 tokenizer into a single processor. [`InstructBlipVideoProcessor`] offers all the functionalities of [`InstructBlipVideoImageProcessor`] and [`AutoTokenizer`]. See the docstring of [`~InstructBlipVideoProcessor.__call__`] and [`~InstructBlipVideoProcessor.decode`] for more information. Args: video_processor (`InstructBlipVideoVideoProcessor`): An instance of [`InstructBlipVideoVideoProcessor`]. The video processor is a required input. tokenizer (`AutoTokenizer`): An instance of ['PreTrainedTokenizer`]. The tokenizer is a required input. qformer_tokenizer (`AutoTokenizer`): An instance of ['PreTrainedTokenizer`]. The Q-Former tokenizer is a required input. num_query_tokens (`int`, *optional*): Number of tokens used by the Qformer as queries, should be same as in model's config. )video_processor tokenizerqformer_tokenizerAutoVideoProcessorrc t|ds2tddd|_|j|jgdn|j|_||_t ||||y)N video_tokenz