Job: AI Generation

This documentation is for update 2.0+, applied to 5.4+.

The AI Generation Job Type is currently experimental! It is subject to change in future updates.

• Input Settings

  • Comfy UI Path: The absolute path to the Comfy UI directory on your PC.

  • Output Path: The relative path to output the generated images in this Unreal Engine project.

  • Process ID: The internal process ID for Comfy UI.

  • Delete Output After Generation: When Comfy UI creates the textures, it will write the images to the disk as pngs. If this is ticked on, these files will be deleted after being imported into this Unreal Engine project.

  • Delete Previous: Delete the previous generation on the next generation.

• Workflow

  • Workflow: Which ComfyUI workflow to use (drop down of all ComfyUI Workflows included in this plugin).

  • Advanced

    • Custom Workflow Path: Path to custom ComfyUI workflows.

• AI Models

  • Model: Which model to use in ComfyUI.

  • VAE: (Optional) Custom VAE.

  • Upscale Model: (Optional) Upscale model to use.

  • Control Net Model: (Optional) Control Net model to use.

  • Advanced

    • Custom Model Path: The path to models.

    • Custom VAE Path: The path to VAE.

    • Custom Upscaler Model Path: The path to upscale models.

• LORAs

  • Loras: (Optional) Loras to use.

    • Lora File: The Lora file to use.

    • Lora Model Strength: The strength of the Lora model.

    • Lora Text Strength: The strength of the Lora text.

  • Custom Lora Path: The path to Loras.

• IMG2IMG

  • Input Resize Smaller Side: The target resize width of the smaller side of the image.

  • KSampler Denoise: The denoise strength of the IMG to IMG KSampler.

• Sampler

  • Circular VAE: Used to generate tiled images.

  • Positive Prompt: The positive prompt for the AI.

  • Negative Prompt: The negative prompt for the AI.

  • Randomise Seed: Whether to randomise seed.

  • Seed Prompt: The current seed.

  • Sampler: The sampler to use.

  • Scheduler: The scheduler to use.

  • Image Width: Generated image width.

  • Image Height: Generated image height.

  • Step Count: Number of steps to use in the KSampler.

  • Cfg: The Cfg value in the KSampler.

  • Advanced

    • Clip Skip: Must be negative.

• SD Upscale

  • Upscale By: Upscale multiplier.

  • Upscale Tile Width: The width of the generated tiles to stitch together.

  • Upscale Tile Height: The height of the generated tiles to stitch together.

  • Advanced

    • Upscale Randomise Seed: Whether to use a different randomised seed for the upscaler.

    • Upscale Seed Prompt: The current seed.

    • Upscale Step Count: Number of steps to use in the upscale node.

    • Upscale Cfg: Upscale cfg value.

    • Upscale Denoise: Denoise value.

    • Upscale Mode Type: Mode of the upscaler.

    • Upscale Sampler: Upscale sampler name.

    • Upscale Scheduler: Upscale scheduler name.

    • Upscale Mask Blur: Blur value for masking the upscaler.

    • Upscale Tile Padding: Padding for the upscaled image.

    • Upscale Seam Fix Mode: Additional seam mode fix.

    • Upscale Seam Fix Denoise: Seam fix denoise value.

    • Upscale Seam Fix Width: The width for the seam fix.

    • Upscale Seam Fix Mask Blur: Blur value for masking the seam fix.

    • Upscale Seam Fix Padding: Padding for the seam fix.

    • Upscale Force Uniform Tiles: Whether to force uniform tiles or not.

    • Upscale Tiled Decode: Whether to use tiled decoding.

• Remove Background

  • Alpha Matting: Whether to Alpha Mat or not.

  • Foreground Threshold: The foreground threshold to apply to the background removal.

  • Background Threshold: The background threshold to apply to the background removal.

  • Erode Size: How much to erode (feather) the edges of the remaining image.

  • Post Process Mask: Whether to use a post-process mask or not.

  • Background Colour: The new background colour to replace the background with.

• Customisation

  • Node Name: Load Img2Img Input: The node name for this node in the ComfyUI workflow.

  • Node Name: Image Resize: The node name for this node in the ComfyUI workflow.

  • Node Name: Load ControlNet Input Image: The node name for this node in the ComfyUI workflow.

  • Node Name: Load ControlNet Model: The node name for this node in the ComfyUI workflow.

  • Node Name: Apply ControlNet: The node name for this node in the ComfyUI workflow.

  • Node Name: Positive Prompt: The node name for this node in the ComfyUI workflow.

  • Node Name: Negative Prompt: The node name for this node in the ComfyUI workflow.

  • Node Name: CLIP Set Last Layer: The node name for this node in the ComfyUI workflow.

  • Node Name: Load Checkpoint: The node name for this node in the ComfyUI workflow.

  • Node Name: VAE Switch: The node name for this node in the ComfyUI workflow.

  • Node Name: Load VAE: The node name for this node in the ComfyUI workflow.

  • Node Name: Circular VAE Decode (tile): The node name for this node in the ComfyUI workflow.

  • Node Name: Make Circular VAE: The node name for this node in the ComfyUI workflow.

  • Node Name: Seamless Tile: The node name for this node in the ComfyUI workflow.

  • Node Name: Empty Latent Image: The node name for this node in the ComfyUI workflow.

  • Node Name: KSampler: The node name for this node in the ComfyUI workflow.

  • Node Name: Load Upscale Model: The node name for this node in the ComfyUI workflow.

  • Node Name: Ultimate SD Upscale: The node name for this node in the ComfyUI workflow.

  • Node Name: CR Upscale Image: The node name for this node in the ComfyUI workflow.

  • Node Name: Remove Background: The node name for this node in the ComfyUI workflow.

• Image Upscale

  • Upscale Mode Type: Mode of the upscaler.

  • Rescale Factor: How much to upscale the image by.

  • Resize Width: The target output width of upscaled image.

  • Resampling Method: The name of the resampling method to use.

  • Super Sample: Whether to super sample or not.

  • Rounding Modulus: The rounding modulus for the upscaler.

• Texture Inputs

  • Enable Texture Input 1: Whether to export Texture Input 1.

  • Enable Texture Input 2: Whether to export Texture Input 2.

  • Enable Texture Input 3: Whether to export Texture Input 3.

  • Enable Texture Input 4: Whether to export Texture Input 4.

• Control Net

  • Control Net Strength: 0-1 value of how much influence the Control Net has on the output.

  • Control Net Start Percent: The start position to apply the Control Net.

  • Control Net End Percent: The end position to apply the Control Net.