Aglifter,
Just guessing, but next time you remove the pin, roll it on a flat surface and make sure it hasn't begun to bend a bit. Shouldn't happen, but it never hurts to check.
If the holes in the frame are getting eggshaped, you'd think the pin fit would be loosening up. You should be able to eyeball those holes for roundness.