As Esbjerg has grown, the city and the harbour have started to turn their back to one another.