my cat has only cat syndrome!

everytime i try and take his ball off him so that i can throw it for him he growls like a bloody dog!!!!!!