Procedural / Interactive Audio¶
Audio
Open Source¶
-
A Text-Steerable Instrument for Sketching Procedural Soundscapes via Language Models Discovered by AI
2026
A real-time musical interface that converts natural-language scene descriptions into evolving procedural soundscapes. It generates human-readable parameter configurations over a categorical schema for a procedural synthesizer, allowing fine-grained control and seamless crossfading without audio interruption.
llm-steeringprocedural-audiosound-synthesis -
Formula-Bank (Rethinking Procedural Audio Pre-training) Discovered by AI
2026
A benchmark and framework for scaling and adapting procedural audio pre-training, exploring how formula-class coverage and rendering diversity affect transferable audio representation learning.
audio-synthesispre-trainingprocedural-audio -
HelixWorld: Real-Time Interactive Audio-Visual World Model Discovered by AI
2026
A real-time interactive audio-visual world model that generates 24 FPS video and 48kHz stereo audio together from a single native Transformer. It updates both the visual scene and the spatial sound field (including azimuth, distance, and reverb) dynamically based on the user's camera movement and navigation.
interactivespatial-audioworld-model -
PLAUD: Performative Latents and Unsupervised DDSP Discovered by AI
2026
A modular PyTorch framework for Differentiable Digital Signal Processing (DDSP) that targets small, personal datasets and emphasizes playability, modularity, and real-time use. It features an explicit ControlSpace, modular synthesizer routing, and an optional transformer-based Prior model for generative control.
ddspreal-timesynthesis -
Quality Audio Prototyping (QuAP) Discovered by AI
2026
A prototype system that unifies content-based audio retrieval and procedural sound generation within a single interface. It integrates a similarity-based retrieval engine with real-time procedural audio models and a rule-based assistant to guide parameter tuning for sound designers.
audio-retrievalprocedural-audiosound-synthesis -
6KSFx Discovered by AI
2025
A dataset of 6,000 synthetic audio samples across 30 sound categories, designed to advance research and benchmarking in procedural audio and digital Foley synthesis.
datasetfoleyprocedural-audiosynthesis -
NeuralPM Discovered by AI
2025
A real-time neural sound effects synthesis model guided by physically inspired models, enabling intuitive and continuous control over sound parameters for interactive applications.
neural-synthesisphysical-modelsound-effects -
2025
A real-time AI loop-generation VST3 plugin for live performance, featuring an 8-track MIDI-triggered sampler with text-to-audio and experimental draw-to-audio generation.
interactivelivereal-timevst -
SonicGauss Discovered by AI
2025
A novel framework for synthesizing physically-based impact sounds directly from 3D Gaussian Splatting (3DGS) representations by leveraging their inherent geometric and material properties.
3dgsimpact-soundsound-synthesis -
SpecMaskFoley Discovered by AI
2025
A video-guided foley sound synthesis model that steers a pretrained spectral masked generative transformer (SpecMaskGIT) using a ControlNet framework to achieve highly synchronized and semantically accurate audio generation.
controlnetfoley-synthesisgenerative-audiovideo-to-audio -
TexStat: A Statistics-Driven Differentiable Approach for Sound Texture Synthesis Discovered by AI
2025
A perceptually-motivated audio feature extraction library for texture sounds implemented in PyTorch. It can be used both as a differentiable loss function for training generative models (such as GANs, VAEs, and diffusion models) and as an evaluation metric for assessing audio quality and similarity.
loss-functionsound-texturesynthesis -
DiffSound Discovered by AI
2024
A differentiable modal sound rendering and inverse rendering framework designed for physics-based modal sound synthesis and estimating physical properties from real-world audio.
differentiablephysical-audioprocedural-audiosound-synthesis -
UE5-PMG: Procedural Music Generator for Unreal Engine 5 Discovered by AI
2024
An AI-powered procedural music generation plugin for Unreal Engine 5 that generates royalty-free, adaptive soundtracks in real-time. It supports text-to-music generation, real-time gameplay adaptation, stem separation, and local inference with Blueprint and C++ support.
adaptive-audiomusic-generationprocedural-audiounreal-engine -
Cmajor Discovered by AI
2023
A C-family programming language designed specifically for writing fast, portable DSP signal processing code, suitable for real-time procedural audio synthesis in games and plugins.
audio-programmingdspprocedural-audiosynthesis -
DDSP-SFX Discovered by AI
2023
An acoustically-guided sound effects generation framework based on Differentiable Digital Signal Processing that allows deterministic control of acoustic attributes like pitch, brightness, and envelope.
ddspneural-synthesisprocedural-audiosound-effects -
Heavy Compiler Collection (hvcc) Discovered by AI
2023
A python-based compiler for Pure Data patches that generates highly optimized C/C++ code and wrappers for game engines like Unity and audio middlewares like Wwise, enabling efficient procedural audio in games.
dspgame-audioprocedural-audiopure-data -
MetaSounds Procedural Audio Engine Discovered by AI
2023
A real-time procedural audio synthesis and acoustic raycast engine built for Unreal Engine 5 MetaSounds. It models physical acoustic invariants of internal combustion engines, such as cylinder firing rates and radial Doppler shifts, to synthesize audio parameters mathematically in real-time.
metasoundsprocedural-audiosound-synthesisunreal-engine -
NoiseBandNet Discovered by AI
2023
A neural audio synthesis model that generates and controls time-varying sound effects by filtering white noise through a controllable filterbank, offering high-quality procedural sound generation for interactive media.
deep-learningneural-synthesisprocedural-audiosound-effects -
ProVE Discovered by AI
2023
A general framework for learning procedural audio models of environmental sounds, combining variational autoencoders with control mapping to generate realistic, parameter-controllable sound effects.
deep-learningprocedural-audiosynthesisvae -
FunDSP Discovered by AI
2022
An open-source audio digital signal processing (DSP) library for Rust, featuring a powerful inline graph notation for describing and synthesizing audio networks.
audio-librarydsprustsynthesis -
Godot Mixing Desk Discovered by AI
2021
A complete procedural and adaptive audio solution for the Godot Engine, enabling developers to easily implement interactive soundscapes and dynamic music with minimal code.
adaptive-musicgame-audiogodotprocedural-audio -
RAVE Discovered by AI
2021
A real-time audio variational autoencoder that enables fast, high-quality 48kHz audio generation and latent-space control for interactive sound synthesis and performance on consumer CPUs/GPUs.
neural-audioprocedural-audioreal-timevae -
SpecSinGAN Discovered by AI
2021
An unconditional generative architecture that takes a single one-shot sound effect and produces novel variations of it using single-image GANs on spectrograms, ideal for generating game sound variations.
ganprocedural-audiosound-effectssynthesis -
DDSP: Differentiable Digital Signal Processing Discovered by AI
2020
A library that integrates classic digital signal processing elements like synthesizers and filters with deep learning, enabling backpropagation through DSP modules for highly controllable and efficient neural audio synthesis.
deep-learningdspneural-synthesisprocedural-audio -
ZzFX Discovered by AI
2019
A tiny, lightweight JavaScript sound effects generator designed for size-limited web games and game jams, allowing developers to generate retro sound effects procedurally from code without external audio files.
gamedevjavascriptprocedural-audiosound-effects -
AudioKit Discovered by AI
2016
A comprehensive audio synthesis, processing, and analysis platform for iOS, macOS, and tvOS, widely used in mobile game development to implement real-time procedural audio, interactive soundscapes, and custom synthesizers.
iosmacosprocedural-audiosynthesis -
SoLoud Discovered by AI
2014
An easy-to-use, free, and portable C++ game audio engine that natively supports real-time procedural sound generators, speech synthesis, and custom audio filters.
audio-enginecppgamedevprocedural-audio -
LabSound Discovered by AI
2013
A C++ graph-based audio engine originating as a fork of WebKit's WebAudio implementation, designed for real-time procedural audio and interactive sound synthesis.
audio-enginecppgraph-basedreal-time -
Tonic Discovered by AI
2013
An efficient, pure C++ audio synthesis library featuring a clean, patch-based syntax that allows developers to easily build custom synthesizers and procedural sound generators for real-time applications.
cppdspprocedural-audiosynthesis -
libpd Discovered by AI
2010
An embeddable version of the Pure Data audio synthesis engine, allowing developers to run interactive, procedural audio patches directly inside game engines like Unity and Unreal.
game-audioprocedural-audiopure-datasynthesis -
Maximilian Discovered by AI
2010
A comprehensive C++ audio synthesis and signal processing library designed for real-time interactive audio, generative music, and procedural sound design.
cppdspprocedural-audiosynthesis -
ChucK Discovered by AI
2003
A strongly-timed, concurrent audio programming language designed for real-time sound synthesis, music composition, and interactive audio performance.
live-codingprogramming-languagereal-timesynthesis -
Faust Discovered by AI
2002
A functional programming language specifically designed for real-time audio signal processing and sound synthesis, widely used to generate procedural audio and custom DSP effects in games.
audio-programmingdspprocedural-audiosynthesis -
SuperCollider Discovered by AI
1996
An environment and programming language for real-time audio synthesis and algorithmic composition, widely used for advanced procedural sound design and interactive audio systems.
algorithmic-compositionprocedural-audiosynthesis -
The Synthesis ToolKit in C++ (STK) Discovered by AI
1995
A widely used open-source C++ library for real-time audio synthesis and physical modeling. It provides a set of unit generators and algorithms for creating physically modeled musical instruments and procedural sound effects.
cppinstrument-simulationphysical-modelingsynthesis
Proprietary / Industry Tools¶
-
Krotos Studio Discovered by AI
2024
An interactive sound design software that enables real-time performative Foley generation and AI-assisted video-to-sound synchronization for game, film, and media production.
foleyprocedural-audioreal-timesound-effects -
Tsugi GameSynth Discovered by AI
2023
A comprehensive procedural sound design tool designed for game, animation, and movie production. It features specialized synthesizers for footsteps, weather, engines, and impacts, alongside a modular patching environment with over 130 synthesis and control modules.
game-audiomodular-synthprocedural-audiosound-design -
Nemisindo Discovered by AI
2022
An interactive procedural audio platform and plugin suite for Unreal Engine and Unity, enabling real-time, parameter-driven sound effects generation directly within game engines.
game-audioprocedural-audiounityunreal-engine -
MetaSounds Discovered by AI
2021
Unreal Engine 5's high-performance procedural audio system that provides sound designers with complete control over Digital Signal Processing (DSP) graphs. It enables sample-accurate timing, dynamic sound generation, and deep integration with game parameters.
dsp-graphgame-audiointeractive-audiounreal-engine -
Tsugi DSP Action Discovered by AI
2021
A procedural sound design tool that allows creators to generate dynamic, high-quality action sound effects by drawing gestures and adjusting synthesis parameters in real time.
game-audioprocedural-audiosound-effectssynthesis -
Tsugi DSP Series Discovered by AI
2021
A suite of procedural audio tools, including DSP Action, DSP Anime, DSP Motion, and DSP Retro, designed for game developers and animators to generate dynamic, customizable sound effects by drawing and adjusting synthesis parameters.
animeprocedural-audiosound-effectssynthesis -
Tsugi DSP Suite Discovered by AI
2021
A suite of procedural sound design tools including DSP Anime, DSP Action, DSP Fantasy, and DSP Sci-Fi. It uses advanced mathematical models to generate highly customizable, dynamic sound effects for games, animations, and visual novels without relying on static sample libraries.
anime-productionprocedural-audiosound-effects -
DSP Motion Discovered by AI
2020
A commercial procedural sound design tool by Tsugi that allows sound designers and animators to generate dynamic sound effects for motion graphics, character animations, and games by drawing shapes with a mouse or graphics tablet.
animationprocedural-audiosfxsound-design -
GameSynth Discovered by AI
2015
A leading commercial procedural sound design tool by Tsugi, offering specialized synthesis models for impacts, whooshes, footsteps, engines, and weather effects with extensive game engine integration.
foleygame-audioprocedural-audiosound-effects -
FMOD Studio Discovered by AI
2013
A leading proprietary audio middleware and sound engine used in game development to design, author, and play back adaptive, interactive, and procedural audio.
dspgame-audiointeractivemiddleware -
Audiokinetic Wwise Discovered by AI
2006
A comprehensive proprietary interactive audio solution and middleware featuring an advanced authoring tool and cross-platform sound engine for games.
game-audiointeractivemiddlewaresound-engine
