Just noticed the ADV3003, where I could do a trick to disable 50 Ohm termination, also has its ESD protection on the same line. So disabling the termination would mean disabling the ESD as well.

Considering adding a TI TPD12S520 ESD chip as well to have external ESD instead.