Scriptable audio pipeline questions

[sonic talon]

anyone here familiar with the Scriptable audio pipeline? documentation is very sparse on this.

right now I am stuck at how to create a GeneratorInstance from an AudioClip because its CreateInstance method throws NotImplementedException

[spiral pelican]

can you share the code you've written so far?

and anything you're referencing? I see that this is a very new feature.

[sonic talon]

didn't find mutch other than the official documentation
https://docs.unity3d.com/Manual/audio-scriptable-processors.html

there is a sample for an oscillator but it doesn't include nesting generators (but they do mention that nesting is the intended workflow)

[sonic talon]

not much
it fails right here in my ScriptableObject implementing IAudioGenerator

    public GeneratorInstance CreateInstance(ControlContext context, AudioFormat? nestedFormat, ProcessorInstance.CreationParameters creationParameters)
    {
        return context.AllocateGenerator(new Realtime
        {
            child1 = clip1.definition.CreateInstance(context, nestedFormat, creationParameters),
            child2 = clip2.definition.CreateInstance(context, nestedFormat, creationParameters),
        }, new Control(), nestedFormat, creationParameters);        
    }

(clip1 and clip2 are IAudioGenerator.Serializable I assigned AudioClips in the inspector)
Realtime and Control are local structs implementing the basics with realtime overlaying the two generators but it never gets to that

[sonic talon]

Scriptable audio pipeline questions

[sonic talon]

i found this discussion https://discussions.unity.com/t/audio-status-update-q3-2025/1681867
saying

For future releases beyond 6.3, we’re working on:
- Implementing Audio Clip as a Scriptable Generator, allowing it to provide sample data within processor hierarchies independent of an Audio Source.

but I found no information on what beyond 6.3 means

[sonic talon]

still not implemented in the latest 6.5 alpha

[sonic talon]

In case someone is interested I wrote my own AudioClipGenerator tying together existing unity apis,
probably not the most efficient design but it will do for now

[uneven pasture]

How did you go about doing it?

[rare token]

keep an eye out, 6000.5.0a8 probably next week or so 😉

[rare token]

would be awesome to see this!

[sonic talon]

lets hope

[sonic talon]

i loaded the sample data from AudioClip into a NativeArray<float> to manually sample it inside of the IRealtime

[sonic talon]

https://gist.github.com/BarionLP/904dd1c44c26156cf01507def278beaf

[sonic talon]

unfortunately the Audio Random Container is internal so making a generator will be tricky

[uneven pasture]

Yeah it is kind of annoying that they make the audio scripts internal/sealed. I’m assuming Unity has a good reason for it, but it would be nice to be able to just extend the scripts

[sonic talon]

i think the problem is performance, lagging audio scripts are fatal for sound quality so they need to be careful about how they open it up

[rare token]

https://unity.com/releases/editor/alpha/6000.5.0a8

Audio: AudioClip can now be used as a Scriptable Generator.

😉

[sonic talon]

nice