In Lê-Ramanujam's paper The invariance of Milnor’s number implies the invariance of the topological type, they prove what the title says for families with isolated singularities and constant Milnor number in dimensions not equal to 3.
I'm not familiar with the literature on singularities so I'm hoping for some examples (if any are known) of such families which are nontrivial. The preprint of de Bobadilla-Pelka says that constant Milnor number also implies constant multiplicity for such families so multiplicity won't help in distinguishing two members of the family.