o il@sddlZddlZddlmZddlmZddlZddlZddl m Z ddl m Z ddl Z ddlmZmZmZddlmZmZmZmZmZmZmZmZmZmZmZddlmZm Z m!Z!m"Z"m#Z#m$Z$m%Z%m&Z&d Z'd Z(Gd d d e)eZ*d&d e+dej,fddZ-Gdddej.Z/Gdddej.Z0dede1dBfddZ2dede1dBfddZ3Gdddej.Z4Gdddej.Z5Gdddej.Z6Gd d!d!ej.Z7Gd"d#d#eZ8de8fd$d%Z9dS)'N)Enum)BytesIO)Image)override)IOComfyExtensionInput) InputFileContentInputImageContent InputMessageInputTextContentModelResponsePropertiesOpenAICreateResponseOpenAIImageEditRequestOpenAIImageGenerationRequestOpenAIImageGenerationResponseOpenAIResponse OutputContent) ApiEndpointdownload_url_to_bytesiodownscale_image_tensorpoll_opsync_optensor_to_base64_stringtext_filepath_to_data_urivalidate_stringz/proxy/openai/v1/responseszc@s4eZdZdZdZdZdZdZdZdZ dZ d Z d Z d S) SupportedOpenAIModelzo4-minio1o3zo1-prozgpt-4.1z gpt-4.1-miniz gpt-4.1-nanozgpt-5z gpt-5-miniz gpt-5-nanoN) __name__ __module__ __qualname__o4_minirro1_progpt_4_1 gpt_4_1_mini gpt_4_1_nanogpt_5 gpt_5_mini gpt_5_nanor*r*:/mnt/c/Users/fbmor/ComfyUI/comfy_api_nodes/nodes_openai.pyr)srtimeoutreturncs|j}|r t|dkrtdg}|D]?}|jr"tt|j}n|jr4t}t|j||dIdHntdt | d}t |t jd}|t|qtj|ddS) aKValidates and casts a response to a torch.Tensor. Args: response: The response to validate and cast. timeout: Request timeout in seconds. Defaults to None (no timeout). Returns: A torch.Tensor representing the image (1, H, W, C). Raises: ValueError: If the response is not valid. rz$No images returned from API endpoint)r,Nu>Invalid image payload – neither URL nor base64 data present.RGBAgo@)dim)datalen ValueErrorb64_jsonrbase64 b64decodeurlrropenconvertnpasarrayastypefloat32appendtorch from_numpystack)responser,r0 image_tensorsimg_dataimg_iopil_imgarrr*r*r+validate_and_cast_response6s rGc@s8eZdZeddZe     d dejfdd ZdS) OpenAIDalle2cCstjddddtjjddddd tjjd d d d d tjjdddd tjjddgddddtjjdd d dd dtjjddtjjddddtj jddddgtj gtj j tj j tj jgdtjtjddgddd d! S)"NrHuOpenAI DALL·E 2api node/image/OpenAIu?Generates images synchronously via OpenAI's DALL·E 2 endpoint.promptTText prompt for DALL·Edefault multilinetooltipseedrnot implemented yet in backendrNminmaxstep display_modecontrol_after_generaterPoptionalsize 1024x1024)256x256512x512r] Image sizerNoptionsrPr[nHow many images to generaterNrVrWrXrPrYr[image+Optional reference image for image editing.rPr[mask;Optional mask for inpainting (white areas will be replaced)widgetsa ( $size := widgets.size; $nRaw := widgets.n; $n := ($nRaw != null and $nRaw != 0) ? $nRaw : 1; $base := $contains($size, "256x256") ? 0.016 : $contains($size, "512x512") ? 0.018 : 0.02; {"type":"usd","usd": $round($base * $n, 3)} )  depends_onexpr node_id display_namecategory descriptioninputsoutputshidden is_api_node price_badgerSchemaStringrInt NumberDisplaynumberComborMaskOutputHiddenauth_token_comfy_orgapi_key_comfy_org unique_id PriceBadgePriceBadgeDependsclsr*r*r+ define_schema^s|  /zOpenAIDalle2.define_schemarNrSr]r-c st|ddd}d}d} t} d} |dur|durd}d} t} |} | j\} }}tj| |dd d }| |ddddd|f<|jd d|jd d krStd d ||dddddf<t | d}| d t j}t|}t}|j|dd|d|} d| _n |dus|durtdt|t|ddt| |||||d| rdd| dfind| dIdH}tt|IdHS)NFstrip_whitespacezdall-e-2 /proxy/openai/images/generationszapplication/json/proxy/openai/images/editsmultipart/form-datacpudevicerS$Mask and Image must be the same sizerPNGformatz image.pngz3Dall-E 2 image editing requires an image AND a maskPOSTpathmethod)modelrJrcr\rQrg image/png)response_modelr0files content_type)rrrsqueezershaper>ones Exceptionr unsqueezenumpyr;r9uint8r fromarrayrsaveseeknamerrrr NodeOutputrG)rrJrQrgrjrcr\rrr request_class img_binary input_tensorheightwidthchannels rgba_tensorimage_npimg img_byte_arrrAr*r*r+executes^   "      zOpenAIDalle2.execute)rNNrSr]rr r! classmethodrrrrr*r*r*r+rH\s PrHc@s6eZdZeddZe    d dejfdd Zd S) OpenAIDalle3cCstjddddtjjddddd tjjd d d d d tjjdddd tjjddddgdddtjjddddgdddtjjddgddddgtj gtj j tj j tj j gdtjtjddgdddd S)!NruOpenAI DALL·E 3rIu?Generates images synchronously via OpenAI's DALL·E 3 endpoint.rJrKTrLrMrQrrRrSrTrUqualitystandardhdz Image qualityrastylenaturalvividzVivid causes the model to lean towards generating hyper-real and dramatic images. Natural causes the model to produce more natural, less hyper-real looking images.r\r])r] 1024x1792 1792x1024r`rla  ( $size := widgets.size; $q := widgets.quality; $hd := $contains($q, "hd"); $price := $contains($size, "1024x1024") ? ($hd ? 0.08 : 0.04) : (($contains($size, "1792x1024") or $contains($size, "1024x1792")) ? ($hd ? 0.12 : 0.08) : 0.04); {"type":"usd","usd": $price} ) rnrq)rr|r}rr~rrrrrrrrrrrrr*r*r+rsp )zOpenAIDalle3.define_schemarrrr]r-c sTt|ddd}t|tdddtt||||||ddIdH}tt|IdHS) NFrzdall-e-3rrr)rrJrr\rrQrr0)rrrrrrrrG)rrJrQrrr\rrAr*r*r+rAs"   zOpenAIDalle3.executeN)rrrr]rr*r*r*r+rs LrrAcC|jjd|jjddS)Ng$@gD@.Ausage input_tokens output_tokensrAr*r*r+calculate_tokens_price_image_1_srcCr)Ng @g@@rrrr*r*r+ calculate_tokens_price_image_1_5dsrc@sneZdZeddZe        dd ed ed ed edejdBdejdBdededede j fddZ dS)OpenAIGPTImage1cCstjddddtjjddddd tjjd d d d d tjjdddd tjjddgddddtjjddgddddtjjddgddddtjjdd d dd dtjjddtjjd d!dd"tj jd#d$dd"tjjd%d&d'gd'dd(g tj gtj j tj j tj jgdtjtjddgd)d*d+d, S)-NrzOpenAI GPT Image 1.5rIz?Generates images synchronously via OpenAI's GPT Image endpoint.rJrKTzText prompt for GPT ImagerMrQrrRrSrTrUrlow)rmediumhighz0Image quality, affects cost and generation time.ra backgroundauto)ropaque transparentz'Return image with or without backgroundr\)rr] 1024x1536 1536x1024r`rcrdrerfrgrhrirjrkr gpt-image-1 gpt-image-1.5)rbrNr[rla ( $ranges := { "low": [0.011, 0.02], "medium": [0.046, 0.07], "high": [0.167, 0.3] }; $range := $lookup($ranges, widgets.quality); $n := widgets.n; ($n = 1) ? {"type":"range_usd","min_usd": $range[0], "max_usd": $range[1]} : { "type":"range_usd", "min_usd": $range[0], "max_usd": $range[1], "format": { "suffix": " x " & $string($n) & "/Run" } } ) rnrqr{rr*r*r+rjs  CzOpenAIGPTImage1.define_schemarrrNrSr]rrJrQrrrgrjrcr\rr-c s~t|dd|dur|durtd| dkrt} n| dkr!t} ntd| |durg} |jd} t| D]Q} || | d}t|d d }|d  t j }t |}t}|j|d d |d| dkr{| dd| d|dffq8| dd| d|dffq8|dur|jddkrtd|jdd|jddkrtd|j\}}}tj||ddd}d||dddddf<t|dd d }|d  t j }t |}t}|j|d d |d| dd|dfft|tdddtt| ||||||dd d!| | d"IdH}nt|td#ddtt| ||||||dd | d$IdH}tt|IdHS)%NFrz(Cannot use a mask without an input imagerrzUnknown model: rrSi@) total_pixelsrrrrgimage_z.pngrzimage[]z%Cannot use a mask with multiple imagerrrrrrrjzmask.pngrrrr)rrJrrrcrQr\ moderationr)rr0rrprice_extractorr)rr0r)rr2rrrrangerrrr;r9rrrrrrr=rr>zerosrrrrrrrrrrG)rrJrQrrrgrjrcr\rrr batch_sizei single_image scaled_imagerrr_rr rgba_mask scaled_maskmask_npmask_imgmask_img_byte_arrrAr*r*r+rs       "      zOpenAIGPTImage1.execute)rrrNNrSr]r) rr r!rrstrintrrrrrr*r*r*r+rhsB i   rc@seZdZdZeddZededeefddZ edeede fd d Z edd e j d e defddZe  dde d e j dBdeedBdeeeBeBfddZedejjdddfde dedede j dBdeedBdedBdejfddZdS)OpenAIChatNodez? Node to generate text responses from an OpenAI model. cCstjdddddtjjdddd d tjjd d d ddtjjdtddtjjddddtdjddddtdjddddgtj gtj j tj j tj j gdtjtjdgdddd S) NrzOpenAI ChatGPTapi node/text/OpenAIzText Generationz-Generate text responses from an OpenAI model.rJrKTz6Text inputs to the model, used to generate a response.rMpersist_contextFz/This parameter is deprecated and has no effect.)rNrPadvancedrz'The model used to generate the response)rbrPimageszqOptional image(s) to use as context for the model. To include multiple images, you can use the Batch Images node.riOPENAI_INPUT_FILESrzgOptional file(s) to use as context for the model. Accepts inputs from the OpenAI Chat Input Files node.)r[rPOPENAI_CHAT_CONFIGadvanced_optionsz`Optional configuration for the model. Accepts inputs from the OpenAI Chat Advanced Options node.rlau ( $m := widgets.model; $contains($m, "o4-mini") ? { "type": "list_usd", "usd": [0.0011, 0.0044], "format": { "approximate": true, "separator": "-", "suffix": " per 1K tokens" } } : $contains($m, "o1-pro") ? { "type": "list_usd", "usd": [0.15, 0.6], "format": { "approximate": true, "separator": "-", "suffix": " per 1K tokens" } } : $contains($m, "o1") ? { "type": "list_usd", "usd": [0.015, 0.06], "format": { "approximate": true, "separator": "-", "suffix": " per 1K tokens" } } : $contains($m, "o3-mini") ? { "type": "list_usd", "usd": [0.0011, 0.0044], "format": { "approximate": true, "separator": "-", "suffix": " per 1K tokens" } } : $contains($m, "o3") ? { "type": "list_usd", "usd": [0.01, 0.04], "format": { "approximate": true, "separator": "-", "suffix": " per 1K tokens" } } : $contains($m, "gpt-4.1-nano") ? { "type": "list_usd", "usd": [0.0001, 0.0004], "format": { "approximate": true, "separator": "-", "suffix": " per 1K tokens" } } : $contains($m, "gpt-4.1-mini") ? { "type": "list_usd", "usd": [0.0004, 0.0016], "format": { "approximate": true, "separator": "-", "suffix": " per 1K tokens" } } : $contains($m, "gpt-4.1") ? { "type": "list_usd", "usd": [0.002, 0.008], "format": { "approximate": true, "separator": "-", "suffix": " per 1K tokens" } } : $contains($m, "gpt-5-nano") ? { "type": "list_usd", "usd": [0.00005, 0.0004], "format": { "approximate": true, "separator": "-", "suffix": " per 1K tokens" } } : $contains($m, "gpt-5-mini") ? { "type": "list_usd", "usd": [0.00025, 0.002], "format": { "approximate": true, "separator": "-", "suffix": " per 1K tokens" } } : $contains($m, "gpt-5") ? { "type": "list_usd", "usd": [0.00125, 0.01], "format": { "approximate": true, "separator": "-", "suffix": " per 1K tokens" } } : {"type": "text", "text": "Token-based"} ) rn) rrrsrtessentials_categoryrurvrwrxryrz)rr|r}rBooleanrrrCustomrrrrrrrrr*r*r+r<sf  # zOpenAIChatNode.define_schemarAr-cCs(|jD] }|jdkr|jSqtd)z.Extract message content from the API response.messagez#No output message found in response)outputtypecontent TypeError)rrArr*r*r+!get_message_content_from_responses   z0OpenAIChatNode.get_message_content_from_responsemessage_contentcCs&|D]}|jdkrt|jSqdS)z*Extract text content from message content. output_textz No text output found in response)rrtext)rr content_itemr*r*r+get_text_from_message_contents  z,OpenAIChatNode.get_text_from_message_contentrrg detail_levelcCst|dt|ddS)z2Convert a tensor to an input image content object.data:image/png;base64, input_imagedetail image_urlr)r r)rrgrr*r*r+tensor_to_input_image_contents  z,OpenAIChatNode.tensor_to_input_image_contentNrJrc Csht|ddg}|dur)t|jdD]}|tddt||dddq|dur2|||S) zGCreate a list of input message contents from prompt and optional image. input_text)rrNrrrrr )r rrr=r rrextend)rrJrgr content_listrr*r*r+create_input_message_contentss  z,OpenAIChatNode.create_input_message_contentsFrrrrc st|ddt|ttddttdt||||ddgdd|dd|r*|jdd nid IdH}|j }t |ttd |d td dddgdIdH} t | || S)NFrrruser)rroleT)inputstorestreamrprevious_response_id) exclude_noner/)rcS|jSN)statusrr*r*r+z(OpenAIChatNode.execute.. incomplete completed)rstatus_extractorcompleted_statusesr*)rrrRESPONSES_ENDPOINTrrr r model_dumpidrrrrr) rrJrrrrrcreate_response response_idresult_responser*r*r+rs:      zOpenAIChatNode.execute)rNN)rr r!__doc__rrrlistrrrrr>Tensorr r r r rrr'valueboolr rrrr*r*r*r+r7sV t   rc@sVeZdZdZeddZededefddZegfded e ede j fd d Z d S) OpenAIInputFilesz7 Loads and formats input files for OpenAI API. c Cst}ddt|D}t|ddd}dd|D}tjddd d tjjd ||r.|d nd ddt djddddgt d gdS)z For details about the supported file input types, see: https://platform.openai.com/docs/guides/pdf-files?api-mode=responses cSs>g|]}|r|jds|jdr|jdkr|qS)z.txtz.pdfi)is_filerendswithstatst_size.0fr*r*r+ s  z2OpenAIInputFiles.define_schema..cSrrr)xr*r*r+r!rz0OpenAIInputFiles.define_schema..)keycSsg|]}|jqSr*r7r3r*r*r+r6"sr.zOpenAI ChatGPT Input FilesruLoads and prepares input files (text, pdf, etc.) to include as inputs for the OpenAI Chat Node. The files will be read by the OpenAI model when generating a response. 🛈 TIP: Can be chained together with other OpenAI Input File nodes.filerNzgInput files to include as context for the model. Only accepts text (.txt) and PDF (.pdf) files for now.)rbrNrPrzAn optional additional file(s) to batch together with the file loaded from this node. Allows chaining of input files so that a single message can include multiple input files.Trirrrsrtrurvrw) folder_pathsget_input_directoryosscandirsortedrr|rrrr)r input_dir input_filesr*r*r+rs4  zOpenAIInputFiles.define_schema file_pathr-cCstt|tj|ddS)N input_file) file_datafilenamer)r rr>rbasename)rrCr*r*r+create_input_file_content:s  z*OpenAIInputFiles.create_input_file_contentr:rcCs(t|}||}|g|}t|S)z? Loads and formats input files for OpenAI API. )r<get_annotated_filepathrHrr)rr:rrCinput_file_contentrr*r*r+rBs    zOpenAIInputFiles.executeN) rr r!r)rrrr rHr*rrrr*r*r*r+r.s &&r.c @sJeZdZdZeddZe  d dededBdedBde j fd d Z dS) OpenAIChatConfigzAAllows setting additional configuration for the OpenAI Chat Node.cCsdtjddddtjjdddgddd d tjjd d d ddd d dtjjdd d ddgtdgdS)NrKzOpenAI ChatGPT Advanced OptionsrzKAllows specifying advanced configuration options for the OpenAI Chat Nodes. truncationrdisabledaThe truncation strategy to use for the model response. auto: If the context of this response and previous ones exceeds the model's context window size, the model will truncate the response to fit the context window by dropping input items in the middle of the conversation.disabled: If a model response will exceed the context window size for a model, the request will fail with a 400 errorT)rbrNrPrmax_output_tokensii@zmAn upper bound for the number of tokens that can be generated for a response, including visible output tokens)rVrNrWrPr[r instructionsz:Instructions for the model on how to generate the response)rOr[rPrr;)rr|rrr~r}rrrr*r*r+rPs>  zOpenAIChatConfig.define_schemaNrLrPrNr-cCstt|||dS)af Configure advanced options for the OpenAI Chat Node. Note: While `top_p` and `temperature` are listed as properties in the spec, they are not supported for all models (e.g., o4-mini). They are not exposed as inputs at all to avoid having to manually remove depending on model choice. )rPrLrN)rrr )rrLrPrNr*r*r+rtszOpenAIChatConfig.executer() rr r!r)rrr-rrrrrr*r*r*r+rKMs  #rKc@s(eZdZedeeejfddZdS)OpenAIExtensionr-csttttttgSr)rHrrrr.rK)selfr*r*r+ get_node_listszOpenAIExtension.get_node_listN) rr r!rr*rr ComfyNoderSr*r*r*r+rQsrQcstSr)rQr*r*r*r+comfy_entrypointsrUr):r4r>enumriorrr9r>PILrtyping_extensionsrr<comfy_api.latestrrrcomfy_api_nodes.apis.openair r r r r rrrrrrcomfy_api_nodes.utilrrrrrrrrr"STARTING_POINT_ID_PATTERNrrrr+rGrTrHrfloatrrrrr.rKrQrUr*r*r*r+s:    4(   &mPX?@