text-to-video

RunwayML Gen4 Aleph

RunwayML Gen4 Aleph is a Video-to-Video model for editing, transforming, and generating video at $0.18 per second. It utilizes natural language instructions to edit and modify footage—removing objects, changing environments, and applying styles. The API supports context-aware transformations and flexible aspect ratios, ensuring high-quality outputs.

Use one of our client libraries to get started quickly.

RunwayML Gen4 Aleph

RunwayML Gen4 Aleph is a Video-to-Video model for editing, transforming, and generating video at $0.18 per second. It utilizes natural language instructions to edit and modify footage—removing objects, changing environments, and applying styles. The API supports context-aware transformations and flexible aspect ratios, ensuring high-quality outputs.. Ready-to-use REST inference API, best performance, no coldstarts, affordable pricing.

Video output~5-15sfrom $1.00/run

1. Calling the API

Submit a request

Send a POST request to start generation. The API returns immediately with a prediction ID for polling.

curl -X POST "https://api.vibedream.ai/api/v1/models/gen4-aleph/generate" \
  -H "Content-Type: application/json" \
  -H "Authorization: Bearer $VIBEDREAM_API_KEY" \
  -d '{
    "prompt": "A beautiful sunset over mountains with golden light",
    "video": "https://example.com/your-video.mp4",
    "aspect_ratio": "16:9",
    "reference_image": "https://example.com/your-reference_image.jpg"
}'

2. Authentication

The API uses an API Key for authentication.

Get your API Key

Get your API key from vibedream.ai/models/api-keys.

Environment variable

export VIBEDREAM_API_KEY="your-api-key"

3. Queue & Results

Generation requests are queued and processed asynchronously. Poll the prediction endpoint until status is completed or failed.

Submit request

curl -X POST "https://api.vibedream.ai/api/v1/models/gen4-aleph/generate" \
  -H "Content-Type: application/json" \
  -H "Authorization: Bearer $VIBEDREAM_API_KEY" \
  -d '{
    "prompt": "A beautiful sunset over mountains with golden light",
    "video": "https://example.com/your-video.mp4",
    "aspect_ratio": "16:9",
    "reference_image": "https://example.com/your-reference_image.jpg"
}'

Response

Returns immediately with a prediction ID. Use id to poll for results.

{
  "id": "550e8400-e29b-41d4-a716-446655440000",
  "status": "processing",
  "statusUrl": "https://api.vibedream.ai/api/v1/predictions/550e8400-e29b-41d4-a716-446655440000",
  "estimatedTime": "5-15s",
  "costCents": 100,
  "createdAt": "2025-01-15T12:00:00.000Z"
}

Get the result

Polling

# Replace YOUR_PREDICTION_ID with the id from the submit response
curl "https://api.vibedream.ai/api/v1/predictions/YOUR_PREDICTION_ID" \
  -H "Authorization: Bearer $VIBEDREAM_API_KEY"

# Poll every 1-2s until status is "completed" or "failed"

Completed response

outputs is string[] — an array of direct download URLs hosted on assets.vibedream.ai.

{
  "id": "550e8400-e29b-41d4-a716-446655440000",
  "modelId": "gen4-aleph",
  "modelName": "RunwayML Gen4 Aleph",
  "status": "completed",
  "outputs": [
    "https://assets.vibedream.ai/outputs/550e8400-e29b-41d4-a716-446655440000/1736942400000-0.mp4"
  ],
  "error": null,
  "createdAt": "2025-01-15T12:00:00.000Z",
  "completedAt": "2025-01-15T12:00:30.000Z"
}

Failed response

{
  "id": "550e8400-e29b-41d4-a716-446655440000",
  "modelId": "gen4-aleph",
  "modelName": "RunwayML Gen4 Aleph",
  "status": "failed",
  "outputs": null,
  "error": "Your request was flagged by content moderation. Please modify your prompt.",
  "createdAt": "2025-01-15T12:00:00.000Z",
  "completedAt": "2025-01-15T12:00:05.000Z"
}
FieldTypeDescription
idstringUnique prediction ID (UUID).
modelIdstringID of the model used for generation.
modelNamestringHuman-readable model name.
statusstringCurrent status. One of: processing, completed, failed.
outputsstring[] | nullArray of output URLs. Each URL is a direct download link to the generated file on assets.vibedream.ai. null when still processing or failed.
errorstring | nullError message if the generation failed. null on success.
createdAtstringISO 8601 timestamp when the request was submitted.
completedAtstring | nullISO 8601 timestamp when generation finished. null while processing.

4. Schema

Input

ParameterTypeRequiredDefaultRangeDescription
promptstringYes----Text instruction describing the edit (e.g., 'Remove people from the video').
videostringYes----Source video file (upload or public URL).Pass a public video URL. Accepted: MP4, WebM, MOV.
aspect_ratiostringNo--16:9, 4:3, 1:1, 3:4, 9:16Output aspect ratio: 16:9, 4:3, 1:1, 3:4, or 9:16. Default: 16:9.
reference_imagestringNo----Reference image to guide style or appearance (upload or URL).Pass a public image URL. Accepted: JPEG, PNG, GIF, WebP.

Example request

{
    "prompt": "A beautiful sunset over mountains with golden light",
    "video": "https://example.com/your-video.mp4",
    "aspect_ratio": "16:9",
    "reference_image": "https://example.com/your-reference_image.jpg"
}

Output

{
  "id": "550e8400-e29b-41d4-a716-446655440000",
  "modelId": "gen4-aleph",
  "modelName": "RunwayML Gen4 Aleph",
  "status": "completed",
  "outputs": [
    "https://assets.vibedream.ai/outputs/550e8400-e29b-41d4-a716-446655440000/1736942400000-0.mp4"
  ],
  "error": null,
  "createdAt": "2025-01-15T12:00:00.000Z",
  "completedAt": "2025-01-15T12:00:30.000Z"
}