Where did the sand man come from?

The Sand Man and the Dust Man came into use in the 17th century. The usage is the eye rubbing of small children when they are sleepy and the same motions come about when sand or dust is thrown or blown into someones eyes. Over the centuries the Dust man has been left behind and the Sand man made into hero and horror by various authors.