How to get people out of ports:

Go into the port where your enemy is and buy him treats. He then thinks that you like him and will leave. You then can attack him.