Stack Exchange network consists of 183 Q&A communities including Stack Overflow, the largest, most trusted online community for developers to learn, share their knowledge, and build their careers.
The problem of counting these matrices up to row and column permutations is solved in I. M. Gessel and J. Li, Enumeration of point-determining graphs, J. Combinatorial Theory Ser. A 118 (2011), 591-612, available online at arxiv.org/abs/0705.0042. (In the paper they are called "semi-point-determining bicolored graphs".) Of course, as in most unlabeled graphical enumeration problems, the formula is not simple, and might not be so helpful in deriving an asymptotic formula. The numbers in Richard's formula are sequence A181230 in the OEIS.