Firefox Developer Tools' Web Audio Editor scratchpad

webaudioscratchsheet.md

Moved to https://wiki.mozilla.org/DevTools/WebAudio

Originally from etherpad

The Web Audio Editor in Firefox Developer Tools is still a work in progress. A lot of love is needed in its current state, and once the basic features are working, here are some dream features, and future planning.

Milestones

• Fx31 - Prototype, img
• Fx32 - Release
• Fx33 - Refined Release
• Fx34 - Designer Tools

Resources

• Open Web Audio Editor Bugs
• Create new Web Audio Editor bug

Features/Ideas

Views

• Context View (displays meta information about the AudioContext itself) bug 1007321
• Display automation over time (toggle between GRAPH view and AUTOMATION view?) bug 1007876
• Display input/output nodes in a connections panel bug 1007875

Visual Feedback

• Display feedback when an AudioSourceNode is playing.bug 1006626
• Display time/frequency domain visualization, VU, for overall sound output bug 1019100
• Display AudioNode connected to an AudioParam. bug 986705

Designer Controls

• Create AudioNodes bug 1023474
• Connect AudioNodes bug 1023475
• Load an AudioBuffer into an AudioBufferSourceNode via GUI bug 1022250

AudioNode controls

• Start/stop AudioSourceNodes bug 1006624
• "Tap into" nodes, listen along the way bug 1007887
• Play AudioBufferSourceNode's buffers (use a new AudioContext/audio element) bug 1007889
• "Disable/bypass" AudioNodes in a chain bug 1007778

Global Controls

• Hide unconnected nodes from view bug 1007255
• Hide GC'd nodes from view bug 1023462

Debugging

• Some way to debug onaudioprocess bug 1008741
• Break on action (connect/disconnect/play, etc.) bug 1007901
• Profiling glitches/"audio jank" bug 1008743
• Debugger break on AudioNode connect (or other events) bug 1007901

Misc

• Support multiple AudioContext's on a page (low priority IMO) bug 1006624
• Render/save out audio output from an AudioContext bug 1008742

Platform work needed

• GC-event when node is GC'd (so we can clear up dead-nodes in the graph view) bug 1008497
• Bypass/skip node in an audio chain (possible to implement on actor, but may be better to be native) -- for bug 1007778, may be necessary

Edge Cases to Test

• Buffer with loop

Research

• Who is going to use this tool? Game developers? Audio hackers?

Feedback

• Twitter: @jsantell, @firefoxdevtools
• IRC: irc.mozilla.org #devtools

@sole nice! I think displaying time/freq domain display with a VU or something would be great -- combined with bug 1007778, I think we'd be able to do that along every node along the chain, which would be great for debugging along a signal

Cool! I'm making https://github.com/the-grid/the-graph/ which is a zoomable nodal editor with named ports. I'd be happy to help you use it for this.

@forresto Just saw your message here! We're currently trying to figure out how best to display connecting to AudioParams -- open to any solutions, including the grid/graph you've linked, if it's performant and customizable!