Previous owner can start the same business immediately and poach all the clients, reducing the value of the sold business to zero. Buyers obviously anticipate this and won't buy the business without the non-compete.

That would violate a non-compete attached to the sale.

...for employees. For business owners there are different rules (IIRC > 1% ownership threshold).