o i5 @sddlmZddlZddlZddlmZddlmZm Z m Z er,ddl m Z ddlm Z dZdZdd dZdddddgfd ddZdS)!) annotationsN) WrappersMP) TYPE_CHECKINGCallableOptional) ModelPatcher)WrapperExecutorz torch.compiletorch_compile_kwargscompiled_module_dictdict[str, Callable]returnrcsdfdd }|S)zK Create a wrapper that will refer to the compiled_diffusion_model. executorrc sz8i}D]\}}tj|j|||<tj|j||q||i|W|D] \}}tj|j||q*S|D] \}}tj|j||q=w)N)itemscomfyutilsget_attr class_objset_attr)r argskwargs orig_moduleskeyvaluer C/mnt/c/Users/fbmor/ComfyUI/comfy_api/torch_helpers/torch_compile.pyapply_torch_compile_wrappersz@apply_torch_compile_factory..apply_torch_compile_wrapperN)r rr)r rrrrapply_torch_compile_factorys rFdiffusion_modelmodelrbackendstroptionsOptional[dict[str, str]]mode Optional[str]dynamicOptional[bool]keys list[str]c Os||tjt|s dg}|||||d} i} |D]} tjdd|| i| | | <qt| d} |tjt| | |j t <dS)aX Perform torch.compile that will be applied at sample time for either the whole model or specific params of the BaseModel instance. When keys is None, it will default to using ["diffusion_model"], compiling the whole diffusion_model. When a list of keys is provided, it will perform torch.compile on only the selected modules. r)r r"r$ fullgraphr&rrNr) remove_wrappers_with_keyr APPLY_MODEL COMPILE_KEYtorchcompileget_model_objectradd_wrapper_with_key model_optionsTORCH_COMPILE_KWARGS) rr r"r$r*r&r(rrcompile_kwargscompiled_modulesr wrapper_funcrrrset_torch_compile_wrapper!s*  r7)r r r r) rrr r!r"r#r$r%r&r'r(r)) __future__rr. comfy.utilsrcomfy.patcher_extensionrtypingrrrcomfy.model_patcherrrr-r3rr7rrrrs