ACE-STEP
Unleash your creativity with ACE-STEP, an innovative AI model for Text-to-Music Generation. Discover how this AI model can transform your workflow!
🚀Function Overview
A diffusion-based foundation model for generating music from text prompts and structured lyrics, optimizing for speed, coherence, and controllability.
Key Features
- 15x faster generation than LLM baselines on A100 GPUs
- Duration-controlled full-song creation with lyric integration
- Parameterized music guidance (CFG, APG)
- Structured lyric formatting using tags like [verse] and [chorus]
- Real-time music synthesis capabilities
Use Cases
- •Original music composition from text descriptions
- •Lyric-driven song generation and remixing
- •AI-assisted music production tools
- •Soundtrack creation for media projects
⚙️Input Parameters
tags
stringText prompts to guide music generation, e.g., 'epic,cinematic'
lyrics
stringLyrics for the music. Use [verse], [chorus], and [bridge] to separate different parts of the lyrics. Use [instrumental] or [inst] to generate instrumental music
duration
numberDuration of the generated audio in seconds. -1 means a random duration between 30 and 240 seconds.
number_of_steps
integerNumber of inference steps.
seed
integerRandom seed. Set to -1 to randomize.
scheduler
stringScheduler type.
guidance_type
stringGuidance type for CFG.
granularity_scale
numberOmega scale for APG guidance, or similar for other CFG types.
guidance_interval
numberGuidance interval.
guidance_interval_decay
numberGuidance interval decay.
guidance_scale
numberOverall guidance scale.
min_guidance_scale
numberMinimum guidance scale.
tag_guidance_scale
numberGuidance scale for tags (text prompt).
lyric_guidance_scale
numberGuidance scale for lyrics.
💡Usage Examples
Example 1
Input Parameters
{ "seed": -1, "tags": "synth-pop, electronic, pop, synthesizer, drums, bass, piano, 128 BPM, energetic, uplifting, modern", "lyrics": "[verse]\nWoke up in a city that's always alive\nNeon lights they shimmer they thrive\nElectric pulses beat they drive\nMy heart races just to survive\n\n[chorus]\nOh electric dreams they keep me high\nThrough the wires I soar and fly\nMidnight rhythms in the sky\nElectric dreams together we’ll defy\n\n[verse]\nLost in the labyrinth of screens\nVirtual love or so it seems\nIn the night the city gleams\nDigital faces haunted by memes\n\n[chorus]\nOh electric dreams they keep me high\nThrough the wires I soar and fly\nMidnight rhythms in the sky\nElectric dreams together we’ll defy\n\n[bridge]\nSilent whispers in my ear\nPixelated love serene and clear\nThrough the chaos find you near\nIn electric dreams no fear\n\n[verse]\nBound by circuits intertwined\nLove like ours is hard to find\nIn this world we’re truly blind\nBut electric dreams free the mind", "duration": 60, "scheduler": "euler", "guidance_type": "apg", "guidance_scale": 15, "number_of_steps": 60, "granularity_scale": 10, "guidance_interval": 0.5, "min_guidance_scale": 3, "tag_guidance_scale": 0, "lyric_guidance_scale": 0, "guidance_interval_decay": 0 }
Quick Actions
Technical Specifications
- Hardware Type
- L40S
- Run Count
- 3.6k
- Commercial Use
- Supported
- Platform
- Replicate