rh4 ,UdZddlZddlZddlmZmZmZmZddlZddlm Z m Z ddl m Z mZmZddlmZddlmZee eefZej.Zej0Zd agaeeegdfeefed <ej<Zej@Z!eZ"e#ejHd rejHjJZ&nd ed efdZ&e#ejHdrejHjNZ(nd ed efdZ(dZ)dZ*d e+fdZ,d5dZ-Gdde.Z/d e+fdZ0d e+fdZ1d6d eed dfdZ2d efdZ3d efdZ4d6d eed efdZ5d6d eed efdZ6 d7deeded ed dfd!Z7d e8eeffd"Z9d#eeeeegdfd dfd$Z:d6d eed eeeffd%Z;d5d&Zd6d eed e8eeffd*Z?Gd+d Z Gd,d-Z@d'ed.d e@fd/ZAd8d eeeejfd e fd0ZB d8d1e d eeeejfd dfd2ZCdd3lDgd4ZEy)9zH This package enables an interface for accessing MTIA backend in python N)AnyCallableOptionalUnion)deviceTensor) _dummy_type_LazySeedTracker classproperty)Device)_get_device_indexF _queued_calls_mtia_exchangeDevicerreturnc$|dkrytdNrz)PyTorch was compiled without MTIA support RuntimeErrorrs f/var/www/html/ai-insurance-compliance-backend/venv/lib/python3.12/site-packages/torch/mtia/__init__.py_exchange_devicer% A:FGG_mtia_maybeExchangeDevicec$|dkrytdrrrs r_maybe_exchange_devicer/rrctyN) _lazy_initrrinitr#5sLrc(txr t S)z9Return whether PyTorch's MTIA state has been initialized.) _initialized_is_in_bad_forkr"rris_initializedr'9s  1 111rc>tjjSr )torch_C_mtia_isInBadForkr"rrr&r&>s 88 % % ''rc tsttdryt5tr dddyt r t dt s tdtjjdt_ tjdtjD tD] \}} | t)tddadddy#t $r1}dt#|ddj%|}t'||d}~wwxYw#t)tdwxYw#1swYyxYw) Nis_initializingzwCannot re-initialize MTIA in forked subprocess. To use MTIA with multiprocessing, you must use the 'spawn' start methodzTorch not compiled with MTIA enabled. Ensure you have `import mtia.host_runtime.torch_mtia.dynamic_library` in your python src file and include `//mtia/host_runtime/torch_mtia:torch_mtia` as your target dependency!Tc3&K|] }|s| ywr r").0callss r z_lazy_init..dsXuRWUXsz6MTIA call failed lazily at initialization with error: z( MTIA call was originally invoked at: )r'hasattr_tls_initialization_lockr&r _is_compiledAssertionErrorr)r* _mtia_initr-rextend_lazy_seed_tracker get_calls ExceptionstrjoinDeferredMtiaCallErrordelattrr%) queued_callorig_tracebackemsgs rr!r!BsL74):; ,   ,,  I ~ *   $X0B0L0L0NXX -/< <+ ^<M < D+ , Y,,H!<PQTUVQWPXYCCE77>CZB[]04!; < D+ ,W,,sM D=BD=9 D(C+ D(D=+ D%4,D  D%%D((D::D==Ec eZdZy)r?N)__name__ __module__ __qualname__r"rrr?r?usrr?c>tjjS)z*Return true if compiled with MTIA support.)r)r* _mtia_isBuiltr"rrr6r6ys 88 ! ! ##rc2tsytdkDS)z'Return true if MTIA device is availableFr)r6 device_countr"rr is_availablerM~s > >A rctjj|5tjj cdddS#1swYyxYw)z?Waits for all jobs in all streams on a MTIA device to complete.N)r)mtiarr*_mtia_deviceSynchronizers r synchronizerQs9   6 "2xx//1222s AAc>tjjS)z,Return the number of MTIA devices available.)r)r*_mtia_getDeviceCountr"rrrLrL 88 ( ( **rc>tjjS)z0Return the index of a currently selected device.)r)r*%_accelerator_hooks_get_current_devicer"rrcurrent_devicerWs 88 9 9 ;;rcVtjjt|dS)aSReturn the currently selected :class:`Stream` for a given device. Args: device (torch.device or int, optional): selected device. Returns the currently selected :class:`Stream` for the current device, given by :func:`~torch.mtia.current_device`, if :attr:`device` is ``None`` (default). Toptional)r)r*_mtia_getCurrentStreamrrs rcurrent_streamr\! 88 * *+tjjS)z4Return a dictionary of MTIA memory allocator history)r)r*_mtia_memorySnapshotr"rrsnapshotrirTrobservercBtjj|y)z9Attach an out-of-memory observer to MTIA memory allocatorN)r)r*_mtia_attachOutOfMemoryObserver)rjs rattach_out_of_memory_observerrms HH,,X6rcVtjjt|dS)aReturn capability of a given device as a tuple of (major version, minor version). Args: device (torch.device or int, optional) selected device. Returns statistics for the current device, given by current_device(), if device is None (default). TrY)r)r*_mtia_getDeviceCapabilityrrs rget_device_capabilityrp" 88 - -.?QU.V WWrc>tjjS)zEmpty the MTIA device cache.)r)r*_mtia_emptyCacher"rr empty_cacherts 88 $ $ &&rstreamcH|ytjj|y)aSet the current stream.This is a wrapper API to set the stream. Usage of this function is discouraged in favor of the ``stream`` context manager. Args: stream (Stream): selected stream. This function is a no-op if this argument is ``None``. N)r)r*_mtia_setCurrentStreamrus r set_streamrys~ HH##F+rcdt|}|dk\r tjj|yy)zSet the current device. Args: device (torch.device or int): selected device. This function is a no-op if this argument is negative. rN)rr)r*%_accelerator_hooks_set_current_devicers r set_devicer|s,v &F { 66v>rcVtjjt|dS)zReturn a dictionary of MTIA device properties Args: device (torch.device or int, optional) selected device. Returns statistics for the current device, given by current_device(), if device is None (default). TrY)r)r*_mtia_getDevicePropertiesrrs rget_device_propertiesrrqrc6eZdZdZdefdZdZdededefdZy) rzContext-manager that changes the selected device. Args: device (torch.device or int): device index to select. It's a no-op if this argument is a negative integer or ``None``. c6t|d|_d|_y)NTrYr)ridxprev_idx)selfrs r__init__zdevice.__init__ s$Vd; rc`tjj|j|_yr )r)r*(_accelerator_hooks_maybe_exchange_devicerr)rs r __enter__zdevice.__enter__sII$((S rtypevalue tracebackc`tjj|j|_y)NF)r)r*rrr)rrrrs r__exit__zdevice.__exit__s88DDT]]SrN)rFrGrH__doc__rrrrr"rrrrs3sTSrcNeZdZUdZeded<dedfdZdZdeded efd Z y ) StreamContextaContext-manager that selects a given stream. All MTIA kernels queued within its context will be enqueued on a selected stream. Args: Stream (Stream): selected stream. This manager is a no-op if it's ``None``. .. note:: Streams are per-device. torch.mtia.Stream cur_streamrucd|_||_tdd|_tj j s|jd|_tj j sdntjjd|_ tj j sd|_ ytjjd|_ y)NTr) rrurrr)jit is_scriptingrOr`src_prev_streamdst_prev_stream)rrus rrzStreamContext.__init__&s $T40yy%%'xx ..0Dejj6O6OPT6U  ..0D 6;jj6O6OPT6U rc|j}||jdk(rytjj d|_|j j |j k7rLt |j 5tjj |j |_dddtjj|y#1swY)xYwNr) rurr)rOr\rrrry)rrs rrzStreamContext.__enter__5s[[  R $zz88>    & &**;*; ; ))* T',zz'@'@ARAR'S$ T j) T Ts ;/CCrrrc*|j}||jdk(ry|jj|jk7r)tj j |jtj j |jyr)rurrrr)rOryr)rrrrrs rrzStreamContext.__exit__Dsj[[  R     & &**;*; ; JJ ! !$"6"6 7 d223rN) rFrGrHrr__annotations__rrrrr"rrrrsF ,--  x(;<   * 4S 4 4 4rrrct|S)a,Wrap around the Context-manager StreamContext that selects a given stream. Arguments: stream (Stream): selected stream. This manager is a no-op if it's ``None``. .. note:: In eager mode stream is of type Stream class while in JIT it doesn't support torch.mtia.stream )rrxs rruruRs   rctjdtdtjdgtj |S)zReturns the random number generator state as a ByteTensor. Args: device (torch.device or int, optional): The device to return the RNG state of. Default: ``'mtia'`` (i.e., ``torch.device('mtia')``, the current mtia device). z.get_rng_state is not implemented in torch.mtia stacklevelr )dtyper)warningswarn UserWarningr)zerosuint8rs r get_rng_stater]s4 MM8 ;;s%++f ==r new_statec<tjdtdy)aSets the random number generator state. Args: new_state (torch.ByteTensor): The desired state device (torch.device or int, optional): The device to set the RNG state. Default: ``'mtia'`` (i.e., ``torch.device('mtia')``, the current mtia device). z.set_rng_state is not implemented in torch.mtiarrN)rrr)rrs r set_rng_staterls MM8r)*)r#rMr'rQrLrWr\r` memory_statsmax_memory_allocatedreset_peak_memory_statsrprrfrirmrtr|ryrurrr)rNr )allpythonr)rO)Fr threadingrtypingrrrrr)r_devicer torch._utilsr r r torch.typesr _utilsrr=int _device_tEventStreamr%rlisttuplerlocalr4Lockr5r:r3r*rrrrr#r'boolr&r!r<r?r6rMrQrLrWr\r`rfdictrirmrprtryr|rrrurrmemory__all__r"rrrs.11 +EE% '3# $     t (2t8 d3i '(y%y~~'%' 588+,xx44HHH  58801"XX??HsHsH 2 ((0f I $d$ d2+2t2 +c+ << U8I. U& U U8I. U& UPQE c]E,/EILE E&+$sCx.+ 7S#s+T127 7X(9"5XsCxX' ,v , ?y ?T ?X(9"5Xc3hX(7474t!8/0!]! >%S%,, 67 >V > @F$S#u||%;< " r