He thought that the golem would be put to better using serving himself and his goals. So he wanted to take it away.
But the golem didn't understand his true intent for that question. Besides, even if it did, it wouldn't help him stop it from doing its duty. That's against its duty.
So it said, "I actually have something you can help me with."
Arthur listened in anticipation only to hear it say, "Tell those cheaters to stop cheating. I will never accept someone at the third mortal coil to be an inheritor. So they are just wasting their time and their energy."
Arthur was disappointed, but he tried again. "Is that all? Is there really nothing I can do to free you from this?"
The golem asked in confusion, "Why would I need to be free from my duty?"
Arthur couldn't come up with a convincing answer in a short while. The golem wasn't willing to wait for an answer. It wasn't even interested in an answer, so it said, "It is time to leave."