Video to Audio and Piano

Unlock new sonic possibilities with Video to Audio and Piano, an innovative tool for video-to-audio conversion and piano music generation.

Platform: Replicate

Video-to-Audio GenerationPiano Music SynthesisMultimedia Conversion

34 runs

L40S

License Check Required

🚀Function Overview

Converts input videos into audio with customizable generation steps and specialized piano music synthesis.

Key Features

Converts video frames into audio waveforms
Optional piano music generation mode
Customizable generation steps for quality control
Text prompt guidance for audio style

Use Cases

•Generating background music from silent videos
•Creating piano accompaniments for visual content
•Audio restoration for video archives

⚙️Input Parameters

video

string

Input Video

prompt

string

Video-to-Audio Text Prompt

v2a_num_steps

integer

Video-to-Audio Num Steps

if_piano

boolean

If Generating Piano Music

💡Usage Examples

Example 1

Input Parameters

{
  "video": "https://replicate.delivery/pbxt/MuNr3iImIwHmZ1hsqv5BxSytNEb8I2TuNKDJ62fczDuszDx9/nwwHuxHMIpc.00000001.mp4",
  "prompt": "the sound of playing piano",
  "if_piano": true,
  "v2a_num_steps": 25
}

Output Results

https://replicate.delivery/xezq/RfuYXnQi6JxefJivecvfXCXacMFgnc7DsYs8clLeObhoSEuJF/tmplocuin6v.mp4.mp4

Quick Actions

Use NowView Documentation

Technical Specifications

Hardware Type: L40S
Run Count: 34
Commercial Use: Unknown/Restricted
Platform: Replicate

Related Keywords

Video-to-Audio GenerationPiano Music SynthesisMultimedia Conversionbackground music from silent videospiano accompaniments for visual contentaudio restoration for video archives

Related Models

DrumTest2 Rhythmic Audio Transformer

Transforms any rhythmic sound—a drum kit, beatboxing, a toy drum, even drumming on your belly—into a pro-quality performance on Zohar's studio drum kit.

Speaker Diarization

Speaker Diarization with "pyannote/speaker-diarization-3.1"

Resemble Enhance AI

Optimizes audio files with speech