What if you change your mind about adding a new file?
# If you already committed the new file
Delete it from the repository:
> svn rm _whoopsie.mistake_ > svn commit
# If you didn't commit the file but already did "svn add"
> svn revert
# If you haven't done "svn add"
Just delete it. Or leave it there for now; it's not bothering svn to have it there.