Generate Animated Human Videos from Images & Audio with Bytedance Omni Human

Description

Generate Animated Human Videos from Images & Audio with Bytedance Omni Human

Built with n8n + Replicate

This workflow takes an image + audio, sends them to Bytedance’s omni-human model, waits for processing, and returns a generated video.

⚡ Section 1: Start & Authenticate

▶️ On clicking ‘execute’** → Manual trigger to start the workflow.
🔑 Set API Key** → Stores your Replicate API key so future requests are authorized.

Benefit: Secures your API credentials in one place for easy re-use.

🛠️ Section 2: Send Video Generation Request

📡 Create Prediction** → Makes a POST request to Replicate with:

image: input image URL
audio: input audio URL
Model version: 7ec44f5140c7338b3496cbf99ee8ea391a4bc18ff5d1677a146dfc936a91f65b

Benefit: Combines visual and audio inputs to start AI-powered video generation.

🔍 Section 3: Track the Prediction

📦 Extract Prediction ID** → Saves predictionId, status, and predictionUrl for polling.
⏳ Wait** → Pauses 2 seconds between status checks (to avoid spamming the API).
🔁 Check Prediction Status** → Queries Replicate using the stored prediction URL.
✅ Check If Complete** → Branches:

If status = succeeded → move forward.
Else → loop back to Wait until completion.

Benefit: Ensures workflow patiently waits for the video instead of timing out.

📽️ Section 4: Process & Return Results

📦 Process Result** → Cleans the API response, returning:

status
video_url (generated video)
metrics
created_at & completed_at
model: bytedance/omni-human

Benefit: Gives you a neat, structured output with the generated video link ready to use.

📊 Workflow Overview

| Section | Purpose | Key Nodes | Benefit |
| ------------------- | --------------------------- | --------------------------------------------- | -------------------------------- |
| ⚡ Start & Auth | Initialize & secure API key | Manual Trigger, Set API Key | Keeps credentials safe |
| 🛠️ Send Request | Start video generation | Create Prediction | Submits image+audio to Replicate |
| 🔍 Track Prediction | Poll status until done | Extract Prediction ID, Wait, Check Status, If | Reliable async handling |
| 📽️ Process Result | Format output | Process Result | Easy access to final video link |

✅ Final Benefits

🎬 Turns static image + audio into full AI-generated video.
🔑 API key stored securely in workflow.
🔄 Handles async generation with auto-polling.
📤 Outputs clean JSON with direct video link.
🧩 Modular — you can connect results to Slack, Gmail, or Google Drive for auto-sharing.