According to the documentation, Python should do that already:
If the target directory already exists an error will be raised, unless the
--clear or --upgrade option was provided.
However that doesn't seem to be the case: http://bugs.python.org/issue23202
We do this by hand to make sure the user doesn't accidentally overwrite
something.
See #463.