ACE-STEP
Unleash your creativity with ACE-STEP, an innovative AI model for Text-to-Music Generation. Discover how this AI model can transform your workflow!
🚀Function Overview
A diffusion-based foundation model for generating music from text prompts and structured lyrics, optimizing for speed, coherence, and controllability.
Key Features
- 15x faster generation than LLM baselines on A100 GPUs
- Duration-controlled full-song creation with lyric integration
- Parameterized music guidance (CFG, APG)
- Structured lyric formatting using tags like [verse] and [chorus]
- Real-time music synthesis capabilities
Use Cases
- •Original music composition from text descriptions
- •Lyric-driven song generation and remixing
- •AI-assisted music production tools
- •Soundtrack creation for media projects
⚙️Input Parameters
tags
stringText prompts to guide music generation, e.g., 'epic,cinematic'
lyrics
stringLyrics for the music. Use [verse], [chorus], and [bridge] to separate different parts of the lyrics. Use [instrumental] or [inst] to generate instrumental music
duration
numberDuration of the generated audio in seconds. -1 means a random duration between 30 and 240 seconds.
number_of_steps
integerNumber of inference steps.
seed
integerRandom seed. Set to -1 to randomize.
scheduler
stringScheduler type.
guidance_type
stringGuidance type for CFG.
granularity_scale
numberOmega scale for APG guidance, or similar for other CFG types.
guidance_interval
numberGuidance interval.
guidance_interval_decay
numberGuidance interval decay.
guidance_scale
numberOverall guidance scale.
min_guidance_scale
numberMinimum guidance scale.
tag_guidance_scale
numberGuidance scale for tags (text prompt).
lyric_guidance_scale
numberGuidance scale for lyrics.
💡Usage Examples
Example 1
Input Parameters
{
"seed": -1,
"tags": "synth-pop, electronic, pop, synthesizer, drums, bass, piano, 128 BPM, energetic, uplifting, modern",
"lyrics": "[verse]\nWoke up in a city that's always alive\nNeon lights they shimmer they thrive\nElectric pulses beat they drive\nMy heart races just to survive\n\n[chorus]\nOh electric dreams they keep me high\nThrough the wires I soar and fly\nMidnight rhythms in the sky\nElectric dreams together we’ll defy\n\n[verse]\nLost in the labyrinth of screens\nVirtual love or so it seems\nIn the night the city gleams\nDigital faces haunted by memes\n\n[chorus]\nOh electric dreams they keep me high\nThrough the wires I soar and fly\nMidnight rhythms in the sky\nElectric dreams together we’ll defy\n\n[bridge]\nSilent whispers in my ear\nPixelated love serene and clear\nThrough the chaos find you near\nIn electric dreams no fear\n\n[verse]\nBound by circuits intertwined\nLove like ours is hard to find\nIn this world we’re truly blind\nBut electric dreams free the mind",
"duration": 60,
"scheduler": "euler",
"guidance_type": "apg",
"guidance_scale": 15,
"number_of_steps": 60,
"granularity_scale": 10,
"guidance_interval": 0.5,
"min_guidance_scale": 3,
"tag_guidance_scale": 0,
"lyric_guidance_scale": 0,
"guidance_interval_decay": 0
}Quick Actions
Technical Specifications
- Hardware Type
- L40S
- Run Count
- 3.6k
- Commercial Use
- Supported
- Platform
- Replicate