A greater old style type of slipper changed into a dress shoe that slipped at the foot, in place of being buckled or buttoned—like Cinderella's glass slipper. The phrase comes from the truth that you can slip a slipper on or off easily. It's associated with the Old English slypescoh, actually "slip-shoe." Read more about it.