A mechanical dashpot may hold the relay armature in long enough, but make sure it does not cause other problems.

A capacitor usually won't work with a relay using an AC coil, and changing that...