You've got the right location and they do wear out. I haven't looked closely at ours, but they usually just sit in a rubber grommet (sp?).
You could drop Rx a PM and check, it might be some twist and lock, but I expect it just yanks right out of there!
Of course, then it will click just fine from all the tugging and such...