floyo logo
Powered by
ThinkDiffusion

LoRA Training Video with Hunyuan

62

Hunyuan is great at generating videos, but locking in a specific aesthetic or character is easier with a  LoRA. Here's how to create your own.

Quick start recipe

  • Upload a Zip file of curated images + captions.

  • Enable is_style and include a unique trigger phrase.

  • Compare checkpoints with a range of steps to find the sweet spot.

Setting up your Fal.ai API key on Floyo

  1. Sign up for a Fal.ai account

  2. Go to Usage & Billing and add funds to your account

  3. Create an API key, copy it and keep it safe

  4. Run workflow on Floyo

  5. On top-left corner, click on the team drop-down menu and select "Settings"

  6. Select "API Connect" and paste your API key from earlier in the Fal.ai field and save!

Training overview

This workflow trains a Hunyuan LoRa using the Fal.ai API.

Processing takes 5-10 minutes with the default settings.

If you create a new folder named "Test", the path should look like:

../user_data/comfyui/input/Test

The default settings work very well – if you would like to add a trigger word for your LoRa, you can do that in the Trigger Word field.

Once finished, a new URL will appear in your Preview Text node. Copy the URL and paste the path directly to your browser to download the LoRa.

Prepping your dataset

Fewer, ultra‑high‑res (≈1024×1024+) images beat many low‑quality ones.

Every image must clearly represent the style or individual and be artifact‑free.

For people, aim for at least 10-20 images in different background (5 headshots, 5 wholebody, 5 halfbody, 5 in other scene)

Captioning

  • Give the style a unique trigger phrase (so as not be confused with a regular word or term).

  • For better prompt control, add custom captions that describe content only—leave style cues to the trigger phrase. Create accompanying .txt files with the same name as the image its describing.

  • If you do add custom captions, be sure to turn on is_style to skip auto‑captioning. It is set to off by default.

Training steps

  • The default is set to around 2000, but you can train multiple checkpoints (e.g., 500, 1000, 1500, 2000) and pick the one that balances style fidelity with prompt responsiveness.

  • Too few steps: the character becomes less realistic or the style fades.

  • Too many steps: model overfits and stops obeying prompts.

Output Path

Will be a URL in the Preview Text Node.

Copy the URL and paste the path directly to your ../comfyui/models/LoRA/

by using the Upload by URL feature in the file browser.

Read more

N

Nodes & Models

Hunyuan is great at generating videos, but locking in a specific aesthetic or character is easier with a  LoRA. Here's how to create your own.

Quick start recipe

  • Upload a Zip file of curated images + captions.

  • Enable is_style and include a unique trigger phrase.

  • Compare checkpoints with a range of steps to find the sweet spot.

Setting up your Fal.ai API key on Floyo

  1. Sign up for a Fal.ai account

  2. Go to Usage & Billing and add funds to your account

  3. Create an API key, copy it and keep it safe

  4. Run workflow on Floyo

  5. On top-left corner, click on the team drop-down menu and select "Settings"

  6. Select "API Connect" and paste your API key from earlier in the Fal.ai field and save!

Training overview

This workflow trains a Hunyuan LoRa using the Fal.ai API.

Processing takes 5-10 minutes with the default settings.

If you create a new folder named "Test", the path should look like:

../user_data/comfyui/input/Test

The default settings work very well – if you would like to add a trigger word for your LoRa, you can do that in the Trigger Word field.

Once finished, a new URL will appear in your Preview Text node. Copy the URL and paste the path directly to your browser to download the LoRa.

Prepping your dataset

Fewer, ultra‑high‑res (≈1024×1024+) images beat many low‑quality ones.

Every image must clearly represent the style or individual and be artifact‑free.

For people, aim for at least 10-20 images in different background (5 headshots, 5 wholebody, 5 halfbody, 5 in other scene)

Captioning

  • Give the style a unique trigger phrase (so as not be confused with a regular word or term).

  • For better prompt control, add custom captions that describe content only—leave style cues to the trigger phrase. Create accompanying .txt files with the same name as the image its describing.

  • If you do add custom captions, be sure to turn on is_style to skip auto‑captioning. It is set to off by default.

Training steps

  • The default is set to around 2000, but you can train multiple checkpoints (e.g., 500, 1000, 1500, 2000) and pick the one that balances style fidelity with prompt responsiveness.

  • Too few steps: the character becomes less realistic or the style fades.

  • Too many steps: model overfits and stops obeying prompts.

Output Path

Will be a URL in the Preview Text Node.

Copy the URL and paste the path directly to your ../comfyui/models/LoRA/

by using the Upload by URL feature in the file browser.

Read more

;