I've been busy designing a more compact and self contained PCB for the project and that is coming along pretty well and is virtually complete. In the meantime I happened upon a Pico with a screen i.e :

This could be an interesting device to use as a base, it's already got a screen and a charger. That would drastically reduce parts count. The screen is rather small though, but for now it would be a great proof of concept.