rh ddlZddlZddlZddlZddlmZddlmZddlm Z m Z ddl m Z m Z mZddlmZdZd efd Zd ed efd Zd ed dfd Z dddddddeedeedeed eedeef dZddeed dfdZddeed dfdZddeeded dfdZ d deedeedeed eedeef dZ ddddddddeedeedeed eedeef dZy)!N)knobs)proton)register_triton_hookunregister_triton_hook)set_profiling_offset_profiling_onis_command_line)Optionalrreturnctjjjj j }|dk(ry|dk(ryt d)Ncudacuptihip roctracerz/No backend is available for the current target.)tritonruntimedriveractiveget_current_targetbackend ValueError)rs j/var/www/html/ai-insurance-compliance-backend/venv/lib/python3.12/site-packages/triton/profiler/profile.py_select_backendrsHnn##**==?GGG& E JKKrcd}|dk(rltjj}|Ptt j t jjjdz dz dz dz }|S)Nrbackendsnvidialib) rr cupti_dirstrpathlibPath__file__parentabsolute)rlib_paths r_get_backend_default_pathr)sjH'<<))  7<<188??HHJZWZbbejjmttuH Orcp|dk(r1ddg}|D]'}tj|dtd|dyy)NrHIP_VISIBLE_DEVICESCUDA_VISIBLE_DEVICESz3Proton does not work when the environment variable zK is set on AMD GPUs. Please unset it and use `ROCR_VISIBLE_DEVICES` instead)osgetenvr)rhip_device_envsenvs r _check_envr1%s[+02HI" Cyyd#/ I#OZ[ rshadowtreecontextdatarhooknamer5r6r7ctry|t}| t}t|t |}t |r|dk(r t tj|||||S)a Start profiling with the given name and backend. Usage: ```python proton.start("my_profile") # do something proton.finalize() ``` Args: name (str, optional): The name (with path) of the profiling session. If not provided, the default name is "~/proton.hatchet". backend (str, optional): The backend to use for profiling. Available options are [None, "cupti", "cupti_pcsampling", "roctracer"]. Defaults to None, which automatically selects the backend matching the current active runtime. context (str, optional): The context to use for profiling. Available options are ["shadow", "python"]. Defaults to "shadow". data (str, optional): The data structure to use for profiling. Available options are ["tree"]. Defaults to "tree". hook (str, optional): The hook to use for profiling. Available options are [None, "triton"]. Defaults to None. Returns: session (int): The session ID of the profiling session. Nr) r DEFAULT_PROFILE_NAMErr1r)r r libprotonstart)r8r5r6rr7 backend_paths rr<r</sdJ |#!#w,W5L   ??4$ FFrsessionctr|dk7r td|tjytj|y)z Activate the specified session. The profiling session will be active and data will be recorded. Args: session (int): The session ID of the profiling session. Defaults to None (all sessions) Returns: None rzEOnly one session can be activated when running from the command line.N)r rr; activate_allactivater>s rrArAhs;W\`aa 7#rctr|dk7r td|tjytj|y)a  Stop the specified session. The profiling session's data will still be in the memory, but no more data will be recorded. Args: session (int): The session ID of the profiling session. Defaults to None (all sessions) Returns: None rzGOnly one session can be deactivated when running from the command line.N)r rr;deactivate_all deactivaterBs rrErE{s;W\bcc  "W%r output_formatc|*ttj|tyt r|dk7r t dtj ||y)a Finalizes a profiling session. Flush and write the profiling data to the file specified by the session name. Args: session (int, optional): The session ID to finalize. If None, all sessions are finalized. Defaults to None. output_format (str, optional): The output format for the profiling results. Aavailable options are ["hatchet"]. Returns: None NrzEOnly one session can be finalized when running from the command line.)rr; finalize_allrr rfinalize)r>rFs rrIrIsK}-  Ade e7M2rcVtjfd}|S)z Context manager for profiling. Internally use only. Args: See start() for the arguments. Returns: wrapper (function): The wrapped function. cNt }|i|}t||S)Nr4)r<rE) argskwargsr>retrr5r6funcr7r8s rwrapperz_profiling..wrappers2gD'PTUD#F#7 r) functoolswraps)rOr8r5r6rr7rPs`````` r _profilingrSs,$__T Nrr8r5r6rr7cH| fd}|St|S)z Decorator for profiling. Usage: ```python @proton.profile def foo(): pass ``` Args: See start() for the arguments. Returns: decorator (function): The decorator function. c&t|S)NrTrS)frr5r6r7r8s r decoratorzprofile..decoratorsadG$PW^bc crrTrW)rOr8r5r6rr7rYs ````` rprofilerZs64 | d d$T7w]abbr)N)Nhatchet)Nr2r3NN)rQrr-r#rtriton._C.libprotonrr;r7rrflagsrr r typingr r:r"rr)r1r<intrArErIrSrZrrras 3>GGLL s s 6G& ! 6G 3-6Gc]6G 3- 6G c] 6G 3- 6Gr$hsm$t$&& &&&3hsm333t32% !  3-c] 3-  c]  3- : "c% !"c 3-"cc] "c 3- "c c] "c 3-"cr