rhzdZddlmZddlmZmZmZddlZddlm Z ddlm Z gd Z ee e edfZd efd Zd efd Zd efd Zd efdZd efdZd efdZd efdZd efdZd"ded dfdZGddZGddZeZead"ded efdZGddeZded efdZ d efdZ!ded dfdZ"d e fd Z#d efd!Z$y)#zj This package implements abstractions found in ``torch.cuda`` to facilitate writing device-agnostic code. )AbstractContextManager)AnyOptionalUnionNdevice)amp) is_availableis_initialized synchronizecurrent_devicecurrent_streamstream set_device device_countStream StreamContextEventreturncRtjjjS)z/Returns a bool indicating if CPU supports AVX2.)torch_C_cpu_is_avx2_supportede/var/www/html/ai-insurance-compliance-backend/venv/lib/python3.12/site-packages/torch/cpu/__init__.pyrr!s 88== + + --rcRtjjjS)z1Returns a bool indicating if CPU supports AVX512.)rrr_is_avx512_supportedrrrr!r!&s 88== - - //rcRtjjjS)z6Returns a bool indicating if CPU supports AVX512_BF16.)rrr_is_avx512_bf16_supportedrrrr#r#+s 88== 2 2 44rcRtjjjS)z/Returns a bool indicating if CPU supports VNNI.)rrr_is_avx512_vnni_supportedrrr_is_vnni_supportedr&0s 88== 2 2 44rcRtjjjS)z3Returns a bool indicating if CPU supports AMX_TILE.)rrr_is_amx_tile_supportedrrrr(r(6 88== / / 11rcRtjjjS)z3Returns a bool indicating if CPU supports AMX FP16.)rrr_is_amx_fp16_supportedrrrr+r+;r)rcRtjjjS)zInitializes AMX instructions.)rrr _init_amxrrrr-r-@s 88== " " $$rcy)zReturns a bool indicating if CPU is currently available. N.B. This function only exists to facilitate device-agnostic code Trrrrr r Es rr cy)zWaits for all kernels in all streams on the CPU device to complete. Args: device (torch.device or int, optional): ignored, there's only one CPU device. N.B. This function only exists to facilitate device-agnostic code. Nrrs rrrNrc:eZdZdZd deddfdZd dZd dZd dZy) rzH N.B. This class only exists to facilitate device-agnostic code priorityrNcyNr)selfr2s r__init__zStream.__init__] rcyr4rr5rs r wait_streamzStream.wait_stream`r7rcyr4rr5s r record_eventzStream.record_eventcr7rcyr4r)r5events r wait_eventzStream.wait_eventfr7r)rN) __name__ __module__ __qualname____doc__intr6r:r=r@rrrrrXs)  d    rrc4eZdZdefdZdddZddZdddZy) rrcy)NTrr<s rqueryz Event.queryksrNcyr4rr9s rrecordz Event.recordnr7rcyr4rr<s rrzEvent.synchronizeqr7rcyr4rr9s rwaitz Event.waittr7rr4rB)rCrDrEboolrJrLrrOrrrrrjst   rrctS)zReturns the currently selected :class:`Stream` for a given device. Args: device (torch.device or int, optional): Ignored. N.B. This function only exists to facilitate device-agnostic code )_current_streamrs rrr|s  rcFeZdZUdZeeed<dZdZde de de dd fd Z y ) rzvContext-manager that selects a given stream. N.B. This class only exists to facilitate device-agnostic code cur_streamc(||_t|_yr4)r_default_cpu_stream prev_streamr9s rr6zStreamContext.__init__s .rc<|j}|yt|_|ayr4)rrRrW)r5rTs r __enter__zStreamContext.__enter__s#[[   +$rtypevalue tracebackrNc:|j}|y|jayr4)rrWrR)r5rZr[r\rTs r__exit__zStreamContext.__exit__s![[   **r) rCrDrErFrr__annotations__r6rYrr^rrrrrs?   /%+S++++rrrct|S)zWrapper around the Context-manager StreamContext that selects a given stream. N.B. This function only exists to facilitate device-agnostic code )r)rs rrrs   rcy)zReturns number of CPU devices (not cores). Always 1. N.B. This function only exists to facilitate device-agnostic code r rrrrrrs rcy)zzSets the current device, in CPU we do nothing. N.B. This function only exists to facilitate device-agnostic code Nrrs rrrr0rcy)zyReturns current device for cpu. Always 'cpu'. N.B. This function only exists to facilitate device-agnostic code cpurrrrrrs rcy)zReturns True if the CPU is initialized. Always True. N.B. This function only exists to facilitate device-agnostic code Trrrrr r s rr4)%rF contextlibrtypingrrrrr _devicer __all__strrG _device_trPrr!r#r&r(r+r-r rrrrVrRrrrrrrr rrrrms; .''   '3T) * .D. 0d0 545 5D5 22 22 %4% d T  $   h% 9  +*+>!6!4! c yTr