Unity3D analog style Synthesizer Tutorial 

Thanks! I hope you make some cool stuff with it.

That's a good idea!

it sounds much better

me too... can anyone help?

I don't understand what you were talking about until I move the frequency bar.

I found a solution. Popping is caused by sudden, sharp changes to the gain. Going from 0 to 0.1 gain in one sample has the chance to create a sharp ridge in the waveform, which is very likely to be audible. I solved this issue by attenuating the change in gain over a few milliseconds. Smoothing the volume in this way removes the artifacts from the samples without perceptably change the sound.

You could use Keijiro's MIDI Jack if you wanted to use a MIDI keyboard to play the synthesizer (or anything else) in Unity > github.com/keijiro/MidiJack

np solved

will you do a tutorial for the graphics, though?

Maybe, but for now put this in your scene: using UnityEngine; using System.Collections; public class AudioDataReader : MonoBehaviour { public static AudioDataReader reader; //AudioListener audioS; float[] spectrum; float[] spectrumDbL; float[] spectrumDbR; public float refValue = 0.1f; public float dbL; public float dbR; public float maxV = 0; public int maxN = 0; public float threshold = 0.02f; public float deg = 0.3515625f; public float fSample = 0f; public double pitchValue; private float[] freqData; private int nSamples = 1024; private float fMax; public LineRenderer lr; public bool circle; float height; public int lrLength = 1024; void Awake() { reader = this; } void Start() { spectrum = new float[lrLength]; spectrumDbL = new float[lrLength]; spectrumDbR = new float[lrLength]; freqData = new float[nSamples]; fMax = AudioSettings.outputSampleRate / 2; fSample = AudioSettings.outputSampleRate; } public static void SphericalToCartesian(float radius, float polar, float elevation, out Vector3 outCart) { float a = radius * Mathf.Cos(elevation); outCart.x = a * Mathf.Cos(polar); outCart.y = radius * Mathf.Sin(elevation); outCart.z = a * Mathf.Sin(polar); } public static void CartesianToSpherical(Vector3 cartCoords, out float outRadius, out float outPolar, out float outElevation) { if (cartCoords.x == 0) cartCoords.x = Mathf.Epsilon; outRadius = Mathf.Sqrt((cartCoords.x * cartCoords.x) + (cartCoords.y * cartCoords.y) + (cartCoords.z * cartCoords.z)); outPolar = Mathf.Atan(cartCoords.z / cartCoords.x); if (cartCoords.x < 0) outPolar += Mathf.PI; outElevation = Mathf.Asin(cartCoords.y / outRadius); } void Update() { spectrum = AudioListener.GetSpectrumData(lrLength, 0, FFTWindow.BlackmanHarris); spectrumDbL = AudioListener.GetOutputData(lrLength, 0); spectrumDbR = AudioListener.GetOutputData(lrLength, 1); int i = 1; while (i < lrLength - 1) { if (!circle) { Vector3 pos = new Vector3(2, (Mathf.Log(spectrum[i - 1])) + 10, i - 1 - 512); lr.SetPosition(i - 1, new Vector3(2, Mathf.Log(spectrum[i - 1]) + 10, (i - 1) * 2 - 50f)); //lr.SetPosition(i - 1, pos); } if (circle) { Vector3 pos = Vector3.zero; height = Mathf.Lerp(height, (deg * dbL), Time.deltaTime * 0.007f); pos.x = Mathf.Log(spectrum[i - 1]) * Mathf.Cos((float)(i - 1) * height); pos.y = Mathf.Log(spectrum[i - 1]) * Mathf.Sin((float)(i - 1) * height); pos.z = 0; lr.SetPosition(i - 1, new Vector3(i - 1, Mathf.Log(spectrum[i - 1]) + 10, 2)); lr.SetPosition(i - 1, pos); // Vector3 p = Vector3.zero; // float a = (i / 1023) * (2f * Mathf.PI); // float r = Mathf.Log(spectrum[i - 1]) + 50f; // p.x = p.x + r * Mathf.Cos( a ); // p.y = p.y + r * Mathf.Sin( a ); // lr.SetPosition(i - 1, p); } // Debug.DrawLine(new Vector3(i - 1, spectrum[i] + 10, 0), new Vector3(i, spectrum[i + 1] + 10, 0), Color.red); // Debug.DrawLine(new Vector3(i - 1, Mathf.Log(spectrum[i - 1]) + 10, 2), new Vector3(i, Mathf.Log(spectrum[i]) + 10, 2), Color.cyan); // Debug.DrawLine(new Vector3(Mathf.Log(i - 1), spectrum[i - 1] - 10, 1), new Vector3(Mathf.Log(i), spectrum[i] - 10, 1), Color.green); // Debug.DrawLine(new Vector3(Mathf.Log(i - 1), Mathf.Log(spectrum[i - 1]), 3), new Vector3(Mathf.Log(i), Mathf.Log(spectrum[i]), 3), Color.yellow); i++; } // int i = 1; // while (i < 1023) { // Vector3 pos = new Vector3(i - 1, (Mathf.Log(spectrum[i - 1])) + 10, 2); // //pos = Vector3.Slerp(pos); // lr.SetPosition(i - 1, pos); // //Vector3 pos = new Vector3(i - 1, (Mathf.Log(spectrum[i - 1])) + 10, 2); // //lr.SetPosition(i - 1, new Vector3(i - 1, (Mathf.Log(spectrum[i - 1])) + 10, 2)); // // Debug.DrawLine(new Vector3(i - 1, spectrum[i] + 10, 0), new Vector3(i, spectrum[i + 1] + 10, 0), Color.red); // Debug.DrawLine(new Vector3(i - 1, Mathf.Log(spectrum[i - 1]) + 10, 2), new Vector3(i, Mathf.Log(spectrum[i]) + 10, 2), Color.cyan); // Debug.DrawLine(new Vector3(Mathf.Log(i - 1), spectrum[i - 1] - 10, 1), new Vector3(Mathf.Log(i), spectrum[i] - 10, 1), Color.green); // Debug.DrawLine(new Vector3(Mathf.Log(i - 1), Mathf.Log(spectrum[i - 1]), 3), new Vector3(Mathf.Log(i), Mathf.Log(spectrum[i]), 3), Color.yellow); // i++; // } int d = 1; float sumL = 0; float sumR = 0; while (d < lrLength - 1) { sumL += spectrumDbL[d] * spectrumDbL[d]; sumR += spectrumDbR[d] * spectrumDbR[d]; d++; } float quotientL = sumL / lrLength; float quotientR = sumR / lrLength; float rmsL = Mathf.Sqrt(quotientL); float rmsR = Mathf.Sqrt(quotientR); dbL = 20 * Mathf.Log10(rmsL / refValue); if (dbL < -160) dbL = -160; dbR = 20 * Mathf.Log10(rmsR / refValue); if (dbR < -160) dbR = -160; for (i = 0; i < lrLength - 1; i++) { if (spectrum[i] > maxV && spectrum[i] > threshold) { maxV = spectrum[i]; maxN = i; } } double freqN = maxN; if (maxN > 0 && maxN < lrLength - 1) { float dL = spectrum[maxN - 1] / spectrum[maxN]; float dR = spectrum[maxN + 1] / spectrum[maxN]; freqN += 0.5 * (dR * dR - dL * dL); } pitchValue = freqN * AudioSettings.outputSampleRate / lrLength; //Debug.Log (pitchValue + " hz"); } public float BandVol(float fLow, float fHigh, int channel) { fLow = Mathf.Clamp(fLow, 20, fMax); // limit low... fHigh = Mathf.Clamp(fHigh, fLow, fMax); // and high frequencies AudioListener.GetSpectrumData(freqData, channel, FFTWindow.BlackmanHarris); int n1 = (int)Mathf.Floor(fLow * nSamples / fMax); int n2 = (int)Mathf.Floor(fHigh * nSamples / fMax); float sum = 0; for (var i = n1; i transform.localScale.y) { rend.material.SetColor("_EmissionColor", thisColor); transform.localScale = new Vector3(targetScale.x, level * multiplier, targetScale.z); } else { rend.material.SetColor("_EmissionColor", Color.Lerp(rend.material.GetColor("_EmissionColor"), Color.black, Time.deltaTime * responseSpeed)); setScale = new Vector3(targetScale.x, level * multiplier, targetScale.z); transform.localScale = Vector3.Lerp(transform.localScale, setScale, Time.deltaTime * responseSpeed); } } }

Kivanc Gumus did you make sure your sounds are playing on a different audio source than the synth?

Yeah figured it out man... Thanks for the quick response and good luck with your fantastic work :)))

The data parameter in OnAudioFilterRead is a buffer of individual raw audio samples. You could write that buffer to a WAV file every time the function is called, keeping in mind that samples for each channel are interlaced.

I used Mathf.pingpong for triangle instead of mathf.sin.

Dano Kablamo I know, I can't do that though because I want different sound sources to play at the same time, and that resulted in a buggy mess where the second one wouldn't play

Oh You need to use a second tone generator to have two tones at once..

Dano Kablamo that's the problem! the second one isn't playing any sound at all! I'm pretty sure it receives input too, it just doesn't play anything (i am using vive headset to create a vr analog synth, maybe it has an audio listener somewhere bugging it all?)

I can't remember how I did it in this tutorial, but if you are using AudioListener.OnAudioFilterRead, switch that to AudioSource.OnAudioFilterRead or something like it to use multiple at once.

Real instruments are pretty tricky, they're sounds are made up of multiple different pitched tones alongside the main tone, as well as other differences in the shape of the wave caused by how the instrument behaves in the real world.

Magic! Jk it's a line renderer and you use OnAudioFilterRead, except you don't change the data, you read it. It's complicated AF. I'll make a tutorial for it too.

I would be thankful for that. Here is a sub. Thx

Hey @@DanoKablamo Did you ever make a tutorial for the line renderer?

@Antony Nasce Check out a demo scene in ProBuilder that visualizes soundwaves.