Here is a simple answer to the first part of the question. One can take some of the standard violations of CSB with other kinds of mathematical structures and transfer them to categories.
For example, with linear orders, we have the two linear orders $$\langle\mathbb{Q},<\rangle\qquad \langle\mathbb{Q}^{\geq 0},<\rangle,$$ which each order-embed into each other, but they are not isomorphic, since the latter has a minimal element and the former does not.
But any linear order can be viewed as a category, where one takes the nodes of the order as objects, and whenever $x<y$ there is a unique morphism from $x$ to $y$, plus the identity morphisms.
These two categories are not isomorphic, since the latter one has an initial object, but the former does not.