rhGdZddlZddlZddlmZddlmZmZmZm Z ddl Z ddl m cm Zddl m Z ddlmZddlmZdd lmZmZmZdd lmZmZdd lmZmZmZmZdd lm Z m!Z!m"Z"m#Z#m$Z$d dl%m&Z&m'Z'm(Z(e#jRe*Z+dZ,dZ-dZ.dbdZ/de j`de j`fdZ1ee!dGdde Z2ee!dGdde Z3ee!Gdde Z4Gdd e jjZ6Gd!d"e jjZ7Gd#d$e jjZ8Gd%d&e jjZ9Gd'd(e jjZ:Gd)d*e jjZ;Gd+d,e jjZ<Gd-d.e jjZ=Gd/d0e jjZ>Gd1d2eZ?Gd3d4e jjZ@Gd5d6e jjZAGd7d8e jjZBGd9d:e jjZC dcd;e jjde j`d?ee j`d@eDdAeDdBee j`fdCZEGdDdEe jjZFGdFdGe jjZGGdHdIe jjZHGdJdKe jjZIGdLdMe jjZJGdNdOeZKGdPdQe jjZLGdRdSe jjZMe!GdTdUeZNGdVdWeNZOe!dXGdYdZeNZPe!Gd[d\eNZQe!Gd]d^eNZRe!Gd_d`eNZSgdaZTy)dzPyTorch CLAP model.N) dataclass)AnyCallableOptionalUnion)nn)ACT2FN)GradientCheckpointingLayer)BaseModelOutputBaseModelOutputWithPooling,BaseModelOutputWithPoolingAndCrossAttentions)ALL_ATTENTION_FUNCTIONSPreTrainedModel)apply_chunking_to_forward find_pruneable_heads_and_indicesmeshgridprune_linear_layer) ModelOutputauto_docstringcan_return_tuplelogging torch_int)ClapAudioConfig ClapConfigClapTextConfigc|j\}}}|dddddddfjdd|d}|j|||z|}|S)ae Interpolate data in time domain. This is used to compensate the resolution reduction in downsampling of a CNN. Args: hidden_states (`torch.FloatTensor` of shape (batch_size, time_length, classes_num)): Input hidden states ratio (`int`): The ratio of the length of the output to the length of the input. Nr)shaperepeatreshape) hidden_statesratio batch_size time_length classes_num upsampleds y/var/www/html/ai-insurance-compliance-backend/venv/lib/python3.12/site-packages/transformers/models/clap/modeling_clap.py interpolater)+sX.;-@-@*ZkaD!m,33Aq%CI!!*kE.A;OI c|j\}}}}|j|||z|||z||}|jddddddjjd|||}|S)aR Returns the resized hidden states. The output shape should be `(batch_size * num_windows, window_size, window_size, num_channels)` Args: hidden_states (`torch.FloatTensor` of shape `(batch_size, height, width, num_channels)`): Input hidden states window_size (`int`): Window size rrr rviewpermute contiguous)r" window_sizer$heightwidth num_channelswindowss r(window_partitionr9<s}/<.A.A+J|!&&Fk);8Lk[gM##Aq!Q15@@BGGKYdfrsG Nr*c|jd}|jd||z||z|||}|jddddddjjd|||}|S)a Merges windows to produce higher resolution features. Args: windows (`torch.FloatTensor` of shape `(num_windows * batch_size, window_size, window_size, num_channels)`): Input windows window_size (`int`): Window size height (`int`): Height of the resized audio width (`int`): Width of the resized audio r/rrr r,r-r.r0)r8r4r5r6r7s r(window_reverser;Qsn==$Lll2v4e{6JKYdfrsGooaAq!Q/::<AA"feUabG Nr*c|j|j}tj|dj ||z|z}|j |zS)a Replace non-padding symbols with their position numbers. Position numbers begin at padding_idx+1. Padding symbols are ignored. This is modified from fairseq's `utils.make_positions`. Args: x: torch.Tensor x: Returns: torch.Tensor rdim)neinttorchcumsumtype_aslong) input_ids padding_idxpast_key_values_lengthmaskincremental_indicess r("create_position_ids_from_input_idsrJesW << $ ( ( *D <<!4<