As everything was connected up and the power was switched on there was a faint whine coming from somewhere in the circuit. I figured the Numitrons were causing some power fluctuations so I added a 100uF capacitor on the power rail. The whining stopped.

The power supply module I have already has capacitors but they didn't seem to help here.