How about a ‘keyring’ through’ the punched hole (may benefit from from an eyelet)
It may benefit the target area for the cup hook in the end of the dowel
The other end of the dowel could have a shoe horn glued and screwed to it which could be used to push down to help remove the shoe and to help...