o iJ @sdZddlmZddlmZddlmZmZmZm Z ddl m Z m Z m ZmZmZmZmZmZmZmZmZmZmZddlmZmZmZm Z m!Z!m"Z"m#Z#m$Z$m%Z%m&Z&dZ'dZ(d Z)d Z*d Z+d Z,Gd dde-Z.Gddde/eZ0Gddde/eZ1dede/dBfddZ2dede3dBfddZ4dede/dBfddZ5 d0de6ej7de/de8dBdefdd Z9 d0de6ej7d!e de8dBde j:fd"d#Z;Gd$d%d%ej7ZGd*d+d+ej7Z?Gd,d-d-eZ@de@fd.d/ZAdS)1aRunway API Nodes API Docs: - https://docs.dev.runwayml.com/api/#tag/Task-management/paths/~1v1~1tasks~1%7Bid%7D/delete User Guides: - https://help.runwayml.com/hc/en-us/sections/30265301423635-Gen-3-Alpha - https://help.runwayml.com/hc/en-us/articles/37327109429011-Creating-with-Gen-4-Video - https://help.runwayml.com/hc/en-us/articles/33927968552339-Creating-with-Act-One-on-Gen-3-Alpha-and-Turbo - https://help.runwayml.com/hc/en-us/articles/34170748696595-Creating-with-Keyframes-on-Gen-3 )Enum)override)IOComfyExtensionInput InputImpl) RunwayImageToVideoRequestRunwayImageToVideoResponseRunwayTaskStatusResponseRunwayModelEnumRunwayDurationEnumRunwayAspectRatioEnumRunwayPromptImageObjectRunwayPromptImageDetailedObjectRunwayTextToImageRequestRunwayTextToImageResponseModel4ReferenceImage RunwayTextToImageAspectRatioEnum) image_tensor_pair_to_batchvalidate_stringvalidate_image_dimensionsvalidate_image_aspect_ratioupload_images_to_comfyapidownload_url_to_video_outputdownload_url_to_image_tensor ApiEndpointsync_oppoll_opz/proxy/runway/image_to_videoz/proxy/runway/text_to_imagez/proxy/runway/tasks@)c@seZdZdZdS)RunwayApiErrorz%Base exception for Runway API errors.N)__name__ __module__ __qualname____doc__r'r':/mnt/c/Users/fbmor/ComfyUI/comfy_api_nodes/nodes_runway.pyr"8sr"c@s(eZdZdZdZdZdZdZdZdZ dS) RunwayGen4TurboAspectRatiozKAspect ratios supported for Image to Video API when using gen4_turbo model.z1280:720z720:1280z1104:832z832:1104z960:960z1584:672N) r#r$r%r&field_1280_720field_720_1280field_1104_832field_832_1104 field_960_960field_1584_672r'r'r'r(r)>sr)c@seZdZdZdZdZdS)RunwayGen3aAspectRatiozLAspect ratios supported for Image to Video API when using gen3a_turbo model.z768:1280z1280:768N)r#r$r%r&field_768_1280field_1280_768r'r'r'r(r0Isr0responsereturnNcC&t|drt|jdkr|jdSdS)zAReturns the video URL from the task status response if it exists.outputrNhasattrlenr6r3r'r'r(get_video_url_from_task_statusP r;cCs"t|dr|jdur|jdSdS)Nprogressd)r8r=r:r'r'r(!extract_progress_from_task_statusWs r?cCr5)zAReturns the image URL from the task status response if it exists.r6rNr7r:r'r'r(get_image_url_from_task_status_r<r@clstask_idestimated_durationcs0t|ttd|dtdd|tdIdHS)z@Poll the task status until it is finished then get the response./)pathcSs|jjSN)statusvalue)rr'r'r(nszget_response..)response_modelstatus_extractorrCprogress_extractorN)rrPATH_GET_TASK_STATUSTaskStatusResponser?)rArBrCr'r'r( get_responsefs rPrequestcsXt|ttddt|dIdH}t||j|IdH}|js!tdt|}t |IdHS)NPOSTrEmethodendpointrKdataz:Runway task succeeded but no video data found in response.) rrPATH_IMAGE_TO_VIDEOr rPidr6r"r;r)rArQrCinitial_responsefinal_response video_urlr'r'r(generate_videots  r]c @BeZdZeddZededejdededede j f d d Z d S) RunwayImageToVideoNodeGen3acCtjddddtjjddddd tjjd d d tjjd tdtjjdtdtjjddddddtj j ddgtj gtj jtj jtj jgdtjtjd gdddd S)Nr_z#Runway Image to Video (Gen3a Turbo)api node/video/Runwaya-Generate a video from a single starting frame using Gen3a Turbo model. Before diving in, review these best practices to ensure that your input selections will set your generation up for success: https://help.runwayml.com/hc/en-us/articles/33927968552339-Creating-with-Act-One-on-Gen-3-Alpha-and-Turbo.promptTText prompt for the generation multilinedefaulttooltip start_frame$Start frame to be used for the videorhdurationoptionsratioseedrRandom seed for generationrgminmaxstepcontrol_after_generate display_moderhwidgets/{"type":"usd","usd": 0.0715 * widgets.duration} depends_onexpr node_id display_namecategory descriptioninputsoutputshidden is_api_node price_badgerSchemaStringrImageComboDurationr0Int NumberDisplaynumberVideoOutputHiddenauth_token_comfy_orgapi_key_comfy_org unique_id PriceBadgePriceBadgeDependsrAr'r'r( define_schema\ z)RunwayImageToVideoNodeGen3a.define_schemarbrirlrorpr4cst|ddt|dddt|ddt||dddIdH}tt|t||td t |t |t t t |d d d gd dIdHS)Nrr min_length? max_width max_heightrrrrr image/png max_images mime_type gen3a_turborfirsturipositionroot promptTextrpmodelrlro promptImage)rrrrr NodeOutputr]rModelr AspectRatiorrstrrArbrirlrorp download_urlsr'r'r(executes2   z#RunwayImageToVideoNodeGen3a.executeN r#r$r% classmethodrrrrintrrrr'r'r'r(r_" 6r_c @r^) RunwayImageToVideoNodeGen4cCr`)Nrz"Runway Image to Video (Gen4 Turbo)raaGenerate a video from a single starting frame using Gen4 Turbo model. Before diving in, review these best practices to ensure that your input selections will set your generation up for success: https://help.runwayml.com/hc/en-us/articles/37327109429011-Creating-with-Gen-4-Video.rbTrcrdrerirjrkrlrmrorprrqrrrsrtrzr|r}r)rrrrrrrr)rrrrrrrrrrrrr'r'r(rrz(RunwayImageToVideoNodeGen4.define_schemarbrirlrorpr4cst|ddt|dddt|ddt||dddIdH}tt|t||td t |t |t t t |d d d gd dtdIdHS)Nrrrrrrrrr gen4_turborrrrrrC)rrrrrrr]rrrrrrrAVERAGE_DURATION_FLF_SECONDSrr'r'r(rs4    z"RunwayImageToVideoNodeGen4.executeNrr'r'r'r(rrrc@sHeZdZeddZededejdejdededed e j fd d Z d S) RunwayFirstLastFrameNodecCstjddddtjjddddd tjjd d d tjjd dd tjjdtdtjjdtdtjjddddddtj j ddgtj gtj jtj jtj jgdtjtjdgdddd S)Nrz Runway First-Last-Frame to Videoraa Upload first and last keyframes, draft a prompt, and generate a video. More complex transitions, such as cases where the Last frame is completely different from the First frame, may benefit from the longer 10s duration. This would give the generation more time to smoothly transition between the two inputs. Before diving in, review these best practices to ensure that your input selections will set your generation up for success: https://help.runwayml.com/hc/en-us/articles/34170748696595-Creating-with-Keyframes-on-Gen-3.rbTrcrdrerirjrk end_framezCEnd frame to be used for the video. Supported for gen3a_turbo only.rlrmrorprrqrrrsrtrzr|r}rrrr'r'r(rGsd# z&RunwayFirstLastFrameNode.define_schemarbrirrlrorpr4c st|ddt|dddt|dddt|ddt|ddt||}t||ddd IdH}t|dkr;td tt |t ||t d t |t |ttt|d d dtt|dddgddtdIdHS)Nrrrrrrrrrrz1Failed to upload one or more images to comfy api.rrrrlastrrr)rrrrrr9r"rrr]rrrrrrrr) rArbrirrlrorpstacked_input_imagesrr'r'r(rsB      z RunwayFirstLastFrameNode.executeNrr'r'r'r(rEs& =rc @sBeZdZeddZe d dededejdBdej fdd Z dS) RunwayTextToImageNodec Csxtjddddtjjddddd tjjd d d tDd tjjddddgtjgtjj tjj tjj gdtj ddd S)NrzRunway Text to Imagezapi node/image/Runwayz~Generate an image from a text prompt using Runway's Gen 4 model. You can also include reference image to guide the generation.rbTrcrdrerocSsg|]}|jqSr')rH).0rr'r'r( sz7RunwayTextToImageNode.define_schema..rmreference_imagez0Optional reference image to guide the generation)rhoptionalz{"type":"usd","usd":0.11})rr) rrrrrrrrrrrrrrr'r'r(rs@ z#RunwayTextToImageNode.define_schemaNrbrorr4c st|ddd}|dur/t|dddt|ddt||dddIdH}tt|d d g}t|ttd d t t |t j ||d dIdH}t ||jtdIdH}|jsWtdttt|IdHS)Nrrrrrrrrrr)rrRrS)rrroreferenceImagesrUrz:Runway task succeeded but no image data found in response.)rrrrrrrrPATH_TEXT_TO_IMAGErrr gen4_imagerPrYAVERAGE_DURATION_T2I_SECONDSr6r"rrrr@)rArbrorreference_imagesrrZr[r'r'r(rs@       zRunwayTextToImageNode.executerF) r#r$r%rrrrrrrrr'r'r'r(rs &rc@s(eZdZedeeejfddZdS)RunwayExtensionr4csttttgSrF)rr_rr)selfr'r'r( get_node_list s zRunwayExtension.get_node_listN) r#r$r%rlisttyper ComfyNoderr'r'r'r(r srcstSrF)rr'r'r'r(comfy_entrypointsrrF)Br&enumrtyping_extensionsrcomfy_api.latestrrrrcomfy_api_nodes.apis.runwayrr r rOr rr rr rrrrrrrrcomfy_api_nodes.utilrrrrrrrrrrrXrrNAVERAGE_DURATION_I2V_SECONDSrr Exceptionr"rr)r0r;floatr?r@rrrrP VideoFromFiler]r_rrrrrr'r'r'r(s` <0     ^_oV