Cant make a living on all zone and cant make a living on all man....gotta mix it up.
The problem with straight zone is, like you said....a quality team will pick you apart if given time.
The problem with straight man, is that all your coverage guys have their backs to the QB and RB. A delayed hand off or a QB scramble will kill you.
A good mix and disguising is the answer.