rh=bdZddlmZddlZddlZddlZddlmZGddZGdd eZ y) a@ This file contains deprecated code that can only be used with the old `model.fit`-style Sentence Transformers v2.X training. It exists for backwards compatibility with the `model.old_fit` method, but will be removed in a future version. Nowadays, with Sentence Transformers v3+, it is recommended to use the `SentenceTransformerTrainer` class to train models. See https://www.sbert.net/docs/sentence_transformer/training_overview.html for more information. Instead, you should create a `datasets` `Dataset` for training: https://huggingface.co/docs/datasets/create_dataset ) annotationsN) InputExamplecDeZdZdZddddej dddfdZd d Zy ) STSDataReadera1Reads in the STS dataset. Each line contains two sentences (s1_col_idx, s2_col_idx) and one label (score_col_idx) Default values expects a tab separated file with the first & second column the sentence pair and third column the score (0...1). Default config normalizes scores from 0...5 to 0...1 rr Tc ||_||_||_||_||_||_||_||_| |_y)N) dataset_folder score_col_idx s1_col_idx s2_col_idx delimiterquotingnormalize_scores min_score max_score) selfr rrr rrrrrs ~/var/www/html/ai-insurance-compliance-backend/venv/lib/python3.12/site-packages/sentence_transformers/readers/STSDataReader.py__init__zSTSDataReader.__init__sF-*$$" 0""c tjj|j|}|j drt j |ddn t |d5}tj||j|j}g}t|D]\}}t||j} |jr)| |jz |j |jz z } ||j"} ||j$} |j't)|t+|z| | g| |dkDst-||k\snd d d |S#1swYSxYw) zJfilename specified which data split to use (train.csv, dev.csv, test.csv).z.gzrtutf8)encodingzutf-8)rr)guidtextslabelrN)ospathjoinr endswithgzipopencsvreaderrr enumeratefloatr rrrrrappendrstrlen) rfilename max_examplesfilepathfIndataexamplesidrowscores1s2s r get_exampleszSTSDataReader.get_examples0s577<< 3 3X>  ' IIhv 6h1 ::cT^^T\\RDH$T? Cc$"4"456(("T^^38WXE)) (SW2DRQSH\a bc!#H (E  &' &s!CE=E EE#N)r)__name__ __module__ __qualname____doc__r& QUOTE_NONErr8rrrrs/#,rrcHeZdZdZddddej dddffd ZxZS) STSBenchmarkDataReaderzReader especially for the STS benchmark dataset. There, the sentences are in column 5 and 6, the score is in column 4. Scores are normalized from 0...5 to 0...1 r r Trc 6t ||||||||||  y)N) r rrr rrrrr)superr) rr rrr rrrrr __class__s rrzSTSBenchmarkDataReader.__init__Ns2 )!!'-  r)r9r:r;r<r&r=r __classcell__)rEs@rr@r@Is0  rr@) r< __future__rr&r$r rrr@r>rrrIs2# 22j ] r