Have you tried some sketching with the connector on the side, opposed to the hardware volume and power keys?
What about using instead a RJ45 connector, as e.g. in Cisco consoles?