The name is derived from the name of a DIY sequencer named "Baby 8", which is in turn a derivative of the "Baby 10".

Ironically, my current design for Baby's First 8 has only 4 steps, but the name is so fun that I don't want to change it (maybe I'll find an aesthetic way to cram 4 more steps in there, or make expansion a standard feature).