Ugly? Have you ever thought about where the “ugly sweater” came from? The National Day calendar says it started as a joke. A resale retail store noticed an unruly amount of unfortunate sweaters knitted by relatives—or ridiculously decorated ones—coming in their doors. As a joke they put them up for sale.