rh PdZddlmZddlmZddlZddlmZmZgdZ de fd Z de fd Z dd e deejfd Zde fd ZedeeZdeddfdZedeeZddedej*fdZdej*ddfdZddeddfdZGddZy)z] This package introduces support for the current :ref:`accelerator` in python. )Optional) deprecatedN) _device_t_get_device_index) current_acceleratorcurrent_device_idxcurrent_device_indexcurrent_stream device_count device_index is_availableset_device_idxset_device_index set_stream synchronizereturncft}|ytj|}|jS)aReturn the number of current :ref:`accelerator` available. Returns: int: the number of the current :ref:`accelerator` available. If there is no available accelerators, return 0. .. note:: This API delegates to the device-specific version of `device_count`. On CUDA, this API will NOT poison fork if NVML discovery succeeds. Otherwise, it will. For more details, see :ref:`multiprocessing-poison-fork-note`. r)rtorchget_device_moduler accmods m/var/www/html/ai-insurance-compliance-backend/venv/lib/python3.12/site-packages/torch/accelerator/__init__.pyr r s3  C {  ! !# &C    cft}|ytj|}|jS)aCheck if the current accelerator is available at runtime: it was build, all the required drivers are available and at least one device is visible. See :ref:`accelerator` for details. Returns: bool: A boolean indicating if there is an available :ref:`accelerator`. .. note:: This API delegates to the device-specific version of `is_available`. On CUDA, when the environment variable ``PYTORCH_NVML_BASED_CUDA_CHECK=1`` is set, this function will NOT poison fork. Otherwise, it will. For more details, see :ref:`multiprocessing-poison-fork-note`. Example:: >>> assert torch.accelerator.is_available() "No available accelerators detected." F)rrrrrs rrr/s3*  C {  ! !# &C    rcheck_availablecdtjjx}|r |r tr|Sy)aJReturn the device of the accelerator available at compilation time. If no accelerator were available at compilation time, returns None. See :ref:`accelerator` for details. Args: check_available (bool, optional): if True, will also do a runtime check to see if the device :func:`torch.accelerator.is_available` on top of the compile-time check. Default: ``False`` Returns: torch.device: return the current accelerator as :class:`torch.device`. .. note:: The index of the returned :class:`torch.device` will be ``None``, please use :func:`torch.accelerator.current_device_index` to know the current index being used. This API does NOT poison fork. For more details, see :ref:`multiprocessing-poison-fork-note`. Example:: >>> # xdoctest: >>> # If an accelerator is available, sent the model to it >>> model = torch.nn.Linear(2, 2) >>> if (current_device := current_accelerator(check_available=True)) is not None: >>> model.to(current_device) N)r_C_accelerator_getAcceleratorr)rrs rrrLs-4xx3355B_J rc>tjjS)zReturn the index of a currently selected device for the current :ref:`accelerator`. Returns: int: the index of a currently selected device. )rr_accelerator_getDeviceIndexrrr r ls 88 / / 11rz#Use `current_device_index` instead.)categorydevicec\t|d}tjj|y)a Set the current device index to a given device. Args: device (:class:`torch.device`, str, int): a given device that must match the current :ref:`accelerator` device type. .. note:: This function is a no-op if this device index is negative. FoptionalN)rrr_accelerator_setDeviceIndexr%r s rrr{s"%Ve` device type. If not given, use :func:`torch.accelerator.current_device_index` by default. Returns: torch.Stream: the currently selected stream for a given device. Tr')rrr_accelerator_getStreamr*s rr r s%%Vd;L 88 * *< 88rstreamcBtjj|y)aSet the current stream to a given stream. Args: stream (torch.Stream): a given stream that must match the current :ref:`accelerator` device type. .. note:: This function will set the current device index to the device index of the given stream. N)rr_accelerator_setStream)r-s rrrs HH##F+rc\t|d}tjj|y)aWait for all kernels in all streams on the given device to complete. Args: device (:class:`torch.device`, str, int, optional): device for which to synchronize. It must match the current :ref:`accelerator` device type. If not given, use :func:`torch.accelerator.current_device_index` by default. .. note:: This function is a no-op if the current :ref:`accelerator` is not initialized. Example:: >>> # xdoctest: +REQUIRES(env:TORCH_DOCTEST_CUDA) >>> assert torch.accelerator.is_available() "No available accelerators detected." >>> start_event = torch.Event(enable_timing=True) >>> end_event = torch.Event(enable_timing=True) >>> start_event.record() >>> tensor = torch.randn(100, device=torch.accelerator.current_accelerator()) >>> sum = torch.sum(tensor) >>> end_event.record() >>> torch.accelerator.synchronize() >>> elapsed_time_ms = start_event.elapsed_time(end_event) Tr'N)rrr_accelerator_synchronizeDevicer*s rrrs".%Vd;L HH++L9rc>eZdZdZdeeddfdZd dZdeddfdZ y) r aContext manager to set the current device index for the current :ref:`accelerator`. Temporarily changes the current device index to the specified value for the duration of the context, and automatically restores the previous device index when exiting the context. Args: device (Optional[int]): a given device index to temporarily set. If None, no device index switching occurs. Examples: >>> # xdoctest: +REQUIRES(env:TORCH_DOCTEST_CUDA) >>> # Set device 0 as the current device temporarily >>> with torch.accelerator.device_index(0): ... # Code here runs with device 0 as the current device ... pass >>> # Original device is now restored >>> # No-op when None is passed >>> with torch.accelerator.device_index(None): ... # No device switching occurs ... pass r%rNc ||_d|_y)N)idxprev_idx)selfr%s r__init__zdevice_index.__init__s rcz|j/tjj|j|_yyN)r5rr_accelerator_exchangeDevicer6)r7s r __enter__zdevice_index.__enter__s+ 88 !HH@@JDM rexc_infocp|j*tjj|jyyr:)r5rr _accelerator_maybeExchangeDevicer6)r7r=s r__exit__zdevice_index.__exit__s' 88  HH 5 5dmm D r)rN) __name__ __module__ __qualname____doc__rintr8r<objectr@r#rrr r s:.x}DKE&ETErr )Fr:)rDtypingrtyping_extensionsrr_utilsrr__all__rEr boolrr%rr FutureWarningr rrStreamr rrr r#rrrNs( 0 c&d:(5<<:P@2c2Z)  7Y 7d 7%  99 95<< 9,u||,,: ::6"E"Er