rhRddlZddlZdZdZdZdZdZd dZdZ d Z d Z d Z y) Ncxtj|}|j|}tj|d}dx}} |j |}|dkDr4tj tj|||j|j|}|jtjjk7r$tj||jfd}n@|j}|j}||zdz |z} tj| ||z|fd}|dkDr4tj tj|||j||j||||j!||||fS#||j||||j!||wwxYw)zy returns the inverted lists content as a pair of (list_ids, list_codes). The codes are reshaped to a proper size int64dtypeNruint8)faissdowncast_InvertedLists list_sizenpzerosget_idsmemcpyswig_ptrnbytes get_codes code_size InvertedListsINVALID_CODE_SIZE n_per_block block_size release_ids release_codes) invlistsllslist_idsidscodes list_codesnpbbsls_rounds n/var/www/html/ai-insurance-compliance-backend/venv/lib/python3.12/site-packages/faiss/contrib/inspect_tools.py get_invlistr% s++H5H   A Bxx'*HC%-q! 6 LL13 H""1%   !4!4!F!F F2x'9'9":'JJ&&C$$BS1 ,H8R3Y"8s5    -C ;;rttRWWbgg ..r4ctj|j}tj|jj |j |j }||fS)zo extract matrix + bias from the PCA object works for any linear transform (OPQ, random rotation, etc.) )r r6bAr8d_outd_in)pcar@rAs r$get_LinearTransform_matrixrE>sJ cee$A cee$,,SYYAA a4Kr4cL|j\}}||j|fk(sJtj|||du}tj|j |j | tj||j d|_|j|S)zA make a linear transform from a matrix and a bias term (optional)NT) shaper LinearTransformcopy_array_to_vectorravelrAr@ is_trainedset_is_orthonormal)rAr@rBrClts r$make_LinearTransform_matrixrNGs''KE4}ww5)###   tUATM :B qwwy"$$/} ""1bdd+BM Ir4ctj|jjd|j}tj|j }t |jDcgc]}|||||dzc}Scc}w)z. return to codebooks of an additive quantizer r)r r6 codebooksr8dcodebook_offsetsr(r9)aqrQcor*s r$ get_additive_quantizer_codebooksrVUsz%%bll3;;BEI   r22 3Brtt   "Q%1q5 "  s0Bctj|jjd}|j |j |j S)z1 copy and return the data matrix in an IndexFlat float32)r r6rviewr8ntotalrR)indexxbs r$ get_flat_datar]_s:   u{{ + 0 0 ;B ::ellEGG ,,r4ctj|jj|j|j S)z2 get the codes from an indexFlatCodes as an array )r r6rr8rZr) index_flats r$get_flat_codesr`es7  !1!1 2 : ::// 11r4c|j}tj|j|jfd}t j t j||j|j|S)zf get the neighbor list for the vectors stored in the NSG structure, as a N-by-K matrix of indices int32r) get_final_graphr r NKr rrdatar)nsggraph neighborss r$get_NSG_neighborsrjks_    !E%''577+7;I LL y!  r4)N) numpyr r r%r+r3r>rErNrVr]r`rjr4r$rms?   >0/  - 1 r4