After playing around with a few ideas, I settled on building a design around the TI PCM2706. The schematic is based heavily on the reference design from the datasheet. The EDA files (KiCad), schematic pdf, and gerbers can all be found on the github repository. I've included below renderings of the PCB in 3D.

Front

Back