The Video Parsing Node is designed for multimodal temporal analysis. It simultaneously performs speech transcription and keyframe extraction, generates content descriptions for each keyframe, and structurally aligns all audiovisual information along the timeline.
Usage Example
For example, to parse a video and generate a content summary: This workflow receives a video file URL as input. The Video Parsing Node extracts speech-to-text transcripts, keyframe visual descriptions, and timing information; then, a Large Language Model (LLM) Node generates a concise video content summary.
Node Integration
Method 1: Add via the + Button
-
Hover your mouse over any node on the canvas (e.g., the Start Node); a
+button automatically appears on its right side. -
Click the
+button and select the desired node from the pop-up node list. The node will be automatically added to the canvas and connected to the upstream node.
Method 2: Drag-and-Drop from the Node Library
- In the left-side node library, locate and select Data → Video Parsing.
- Drag the node onto the canvas at your desired location, then drag a connection line from the edge of an upstream node to the Video Parsing Node.
Core Configuration
Input
Specify the video to be parsed. Supports either direct URL input or referencing an upstream node variable. Use the dropdown to select the input method:
| Method | Description | Use Case |
|---|---|---|
| Reference | Reference an upstream node variable | Video URL (String type) from an upstream node, or a File-type video uploaded via the Start Node. |
| Input | Directly enter the video URL | Fixed or externally sourced video URLs. |
- Maximum file size: 512 MB per file.
- Only single-file parsing is supported — batch or list-based parsing is not allowed.
-
Supported formats:
.mp4,.mkv,.avi,.mov,.wmv.
Parser Selection
| Parser Type | Billing | Description |
|---|---|---|
| LLM Audio-Visual Parser | Not billed yet | Built-in LLM-powered parsing; prompt customization is not supported. |
Node Output
The Video Parsing Node outputs structured parsing results based on video content, including file type and time-aligned audio transcripts and video keyframe descriptions.
| Variable Name | Type | Description |
|---|---|---|
fileType | String | File extension (e.g., "mp4", "mkv"). |
segments | Array<Object> | Array of parsed segments, organized chronologically. Each element represents one scene segment. |
segments array element:
| Field Name | Type | Description |
|---|---|---|
audioFrames | Array<Object> | Audio frame array containing ASR details within this segment. |
videoFrames | Array<Object> | Video frame array containing keyframe visual descriptions within this segment. |
startTime | Number | Segment start time (in milliseconds). |
endTime | Number | Segment end time (in milliseconds). |
index | Number | Segment index, starting from 0. |
audioFrames array element:
| Field Name | Type | Description |
|---|---|---|
ASRInfo | String | Speech-to-text transcript (empty string if no audio). |
startTime | Number | Audio frame start time (in milliseconds). |
endTime | Number | Audio frame end time (in milliseconds). |
videoFrames array element:
| Field Name | Type | Description |
|---|---|---|
textInfo | String | Keyframe visual description (scene text generated by the LLM). |
fileUrl | String | Keyframe image URL (signed screenshot URL with expiration). |
startTime | Number | Keyframe start time (in milliseconds). |
endTime | Number | Keyframe end time (in milliseconds). |
Common Usage Patterns
| Paired Node | Typical Use Case |
|---|---|
| Start Node → Video Parsing Node | Start Node provides either a video URL (String type) or uploaded video file (File type); Video Parsing Node parses the video content. |
| Video Parsing Node → LLM Node | Video Parsing Node outputs structured data (e.g., ASR text and visual descriptions from segments); LLM Node generates summaries, answers questions, or extracts insights based on these results. |
| Video Parsing Node → Variable Processing Node | Extract specific fields from parsing results for format conversion or data processing (e.g., concatenate all textInfo values into a unified visual description). |