rhddlmZddlmZddlmZmZmZmZddl m Z ddl m Z m Z mZmZmZmZddlmZddlmZ edZGd d e eeZGd d eZy ))abstractmethod) defaultdict)AnyGenericOptionalTypeVar)override)_serialize_single_cache CacheArtifactCacheArtifactFactoryCacheArtifactManagerCacheArtifactsResult CacheInfo)AppendingByteSerializer) OrderedSetTcNeZdZdZeddZedefdZede fdZ y)PrecompileCacheArtifacta5 Data for each cache artifact that will be serialized and deserialized by PrecompileContext, rather than CacheArtifactManager. T represents the deserialized type of the artifact, i.e. the return type of after_deserialization PrecompileCacheArtifact is a frozen dataclass - you can add new serializable fields and metadata specific to your own artifacts as needed, and use them in after_deserialization. Example implementation: class MyPrecompileCacheArtifact(PrecompileCacheArtifact[MySerializableType]): my_field: int def after_deserialization(self) -> MySerializableType: result = pickle.loads(self.content) # Do some extra work post deserialization result.my_post_deserialization_function(self.my_field) return result returnNctd)Nz1Precompile cache artifacts do not populate caches) RuntimeErrorselfs s/var/www/html/ai-insurance-compliance-backend/venv/lib/python3.12/site-packages/torch/_dynamo/precompile_context.pypopulate_cachez&PrecompileCacheArtifact.populate_cache.sNOOcy)NTrs rprecompile_compatiblez-PrecompileCacheArtifact.precompile_compatible2srcy)z Code to be run after reading raw byte contents from disk. Generally converts self.content from raw bytes back into its original form. Nrrs rafter_deserializationz-PrecompileCacheArtifact.after_deserialization6s rrN) __name__ __module__ __qualname____doc__r rboolrrrr!rrrrrsS(PPt q  rrc ~eZdZUdZiZeeefed<e e Z e ed<e Ze eed<eeZeeee efed<eZeed<edfd Zeed ed ed edd fdZeddZed edeefdZedeeeefffd Zede defdZ eddZ!xZ"S)PrecompileContexta PrecompileContext is a special CacheArtifactManager for handling precompilation It uses the same interface as CacheArtifactManager, but handles deserialization differently: instead of placing each artifact into respective caches, it will stitch all the cache artifacts for a single key together and place it into a global Precompile Cache. The following artifact types are supported by PrecompileContext: - BundledAOTAutogradCacheArtifact - CodeStateArtifact (from torch._dynamo.package once available) _new_cache_artifacts_by_key_new_cache_artifacts_seen_artifacts) serialize_fn _serializer _cache_inforNcV|jjt|yN)r*clearsupercls __class__s rr2zPrecompileContext.clear]s ''--/  r artifact_typekeycontentctj|||}||jvry||j|<|jj |y)zg Called from each caching operation to record the artifact in this "mega" list N)r encode_creater,r*add)r5r7r8r9artifacts rrecord_artifactz!PrecompileContext.record_artifactbsO(55mS'R s** * /7'', )rc|jjD]8}|j|jj j |:|jj y)z We normally record artifacts by key, but serialization expects them to be organized by artifact type. This function transfers artifacts from _new_cache_artifacts_by_key to _new_cache_artifacts N)r*valuesr+r6typeappendr2)r5r=s r_save_artifacts_by_typez)PrecompileContext._save_artifacts_by_typezs^ 77>>@ QH  $ $X%7%7%<%<%> ? F Fx P Q ''--/rc:|jj|dS)zP Serialize all artifacts with the given key returned in a list. N)r*get)r5r8s rserialize_artifact_by_keyz+PrecompileContext.serialize_artifact_by_keys ..223==rc@|jt| Sr1)rCr3 serializer4s rrHzPrecompileContext.serializes ##%w ""r artifactsctd)NTODO)NotImplementedError)rIs rpopulate_cachesz!PrecompileContext.populate_cachess !&))rcddlm}y)Nr)BundledAOTAutogradCacheArtifact)-torch._functorch._aot_autograd.autograd_cacherO)r5rOs r"_ensure_cache_artifacts_registeredz4PrecompileContext._ensure_cache_artifacts_registereds rr")#r#r$r%r&r*dictstrr __annotations__rlistr+rrr,rr r.tuplerr/ classmethodr2r rr>rCrrFbytesrH staticmethodrMrQ __classcell__)r6s@rr)r)?sm  =?c=&8!9>1C>H]4K>> #(5 )9#:;##*#7*I**  rr)N)abcr collectionsrtypingrrrrtyping_extensionsr torch.compiler._cacher r r r rr&torch.utils._appending_byte_serializerrtorch.utils._ordered_setrrrr)rrrrbsY#22&K/ CL# mWQZ# LY ,Y r