A common solution to this which may or may not work for you is to use a centrifugal clutch.
Off the shelf options would be too large for your application; and they wouldn't kick in until too high an rpm. But you may be able to 3D print something based on this principal.
I'm thinkingIf you make the arms very heavy arms on the inner shaft, with light springs it will work at lower rpms. PlusYou could also replace the friction element with teeth or "ledges" on the outer drum and armsa pawl style mechanism so that once it catchesit's engaged it will never slip.