That's really not acceptable. It would be reasonable to have some sort of non-compete clause, and there's probably all sorts of intellectual property clauses already, but nothing as blanket as that is acceptable.
If they come back, maybe compromise and suggest something about keeping them informed of such ventures?