After a long time I was able to migrate the whole project to ESP32. I wanted to do this mainly to make it fit into a small case. I used one of those GBA-GC third party cables to take the case and the link port connector. So now the project works just with an ESP32 connected to the link port and everything fits into a small case.

I also published all the instructions to build the adapter.