Hi, here is viedo of PoC with USB connected keyboard being used with smartphone acting like a Raspberry Pi screen.

Some explanations are probably necessary. I'm using the following software setup:

• x11vnc server in autostart for xserver. Installed via the following convenient script (http://simplesi.net/auto-install-x11vnc/)
• Raspberry configured to autoboot into the x session
• Console X session screen resolution changed (probably need to be changed to soemthing else)
• terminal window automatically opened on X server startup and screen command executed, so that you can SSH into the console session and use the keyboard
• /etc/dhcpcd.conf modified to allow static IP for usb0 netowrk adaptor
• Arduino IDE installed