remove door handles

Hello tractors

I’m trying to remove the door handles on my French ’53 BN. I have tried the “twist the handle” trick till I’m worn out but it only comes out about 1/4 inch. I’m talking about the rear door handles here as I think I’ll be able to get the front ones off as I watched Darrin do it last week when he fitted his super mirror brackets.

Help much appreciated
Ken Jones