Ostraca were pottery sherds used to nominate someone for exile.
Ostraca
Clipart.com
When someone became too powerful in ancient Athens, he could be sent into exile if enough people wanted it. The voting procedure was to write names on bits of broken pottery known as ostraca. The person voted into exile was, therefore, "ostracized".