AI Model Recommendations
This documentation is for update 2.0+, applied to 5.4+.
This guide provides a list of recommended AI models, VAEs, ControlNets, and LoRAs specifically for generating high-quality, realistic PBR textures with the AI Generation Job. The right combination of these assets can significantly improve the detail, realism, and consistency of your materials.
Note: Workflows and models are generally not cross-compatible between Stable Diffusion 1.5 (SD 1.5) and SDXL. Ensure the models you choose match the base model of your selected workflow.
1. Main Models (Checkpoints)
The Main Model is the foundation of your generation. For PBR textures, you want a model that excels at photorealism and fine detail.

1.1 Notable Mentions for Stylized Textures
While the models above focus on realism, the following checkpoints are excellent for creating stylized, hand-painted, or non-photorealistic (NPR) textures suitable for games like Valorant, Fortnite, or Genshin Impact.
2. Custom VAEs
A VAE (Variational Autoencoder) translates the AI's internal "latent" image into the final pixel image. A good VAE prevents washed-out colors and enhances fine details.
3. Upscale Models
An upscaler increases the resolution of your generated image. These models are generally compatible with both SD 1.5 and SDXL outputs.
4. ControlNet Models
ControlNet models are essential for guiding the generation process to create specific structures. You must use ControlNet models that match your base model version (SD 1.5 or SDXL).

ControlNet Models (for SD 1.5)
control_v11p_sd15_normalbae
Essential for 3D shape/depth.
control_v11f1p_sd15_depth
Controls height differences (walls, tiles).
control_v11p_sd15_canny
Defines hard outlines (grout, planks).
control_v11p_sd15_softedge
Defines soft shapes (fabric, grain).
You can find the official SD 1.5 ControlNet 1.1 models on Hugging Face.
ControlNet Models (for SDXL)
control-lora-depth-rank256
Controls height and structure.
control-lora-canny-rank256
Enforces strong structural lines.
control-lora-recolor-rank256
Guides color for patterned textures.
You can find these and other official SDXL ControlNet LoRAs on Hugging Face.
5. LoRAs for PBR Texturing
LoRAs (Low-Rank Adaptations) are small files that inject a specific style or concept. They are not cross-compatible; a LoRA made for SD 1.5 will not work with an SDXL model, and vice-versa.
You can find these and many more LoRAs on websites like Civitai. Remember to check which base model (SD 1.5 or SDXL) they were trained on.
Last updated
Was this helpful?