Where the character of a sound lives
While we were building our string ensemble, Arco49, the first checks looked very good: the registers were close to the recordings of the real machine, and the release was right. But when we listened, something of the machine’s identity was still missing.
What a held note can’t show
In a string ensemble, much of the identity is movement. Three delay lines, driven by two slow oscillators, make the pitch and tone of every held note wander all the time. A test that looks at a held note can’t see that: average a second of audio and the movement disappears into the average.
So we added a check that follows the pitch of a held note as it changes over time and compares it with recordings of the real machine, with the ensemble off and on. On the real machine, switching the ensemble on makes the pitch sway far more. The check showed it clearly, and it pointed to the cause: our two slow oscillators were smooth sine waves, while the circuit we were modelling makes square waves. A square wave carries many extra components, and that is what gives the real machine its rich movement; with two smooth waves the result sounds like any ordinary chorus.
Two comparisons, used together
There is an easy way to check a sound: play it, save the result, and compare every new version with that recording. It tells you something useful: the sound has not changed. What it cannot tell you is whether the sound is right. For that we use a reference: the circuit’s diagram and formulas, the chip’s datasheet curves, the figures the manufacturer states. And a check looks at the shape of the sound, not only at a number: a symmetric circuit, for example, adds mostly odd harmonics, the extra notes that appear when you push a sound, and that comes from the shape of the circuit, not from our arithmetic. Where there is no reference, we say so.
The comparison with our own recordings warns us when something moved between one version and the next; the one with a real reference tells us whether the sound is the right one. One cannot stand in for the other.
What we took from it
If the character of a sound lives in its movement, testing a held note is the wrong test, however well it passes. Ask first where the character lives. Then decide what to measure.
For you, the point is simple: an instrument that keeps the character of the machine, not only numbers that match.