I assume that you are either working over an algebraically closed field, or that by "diagonalizable", you mean "diagonalizable, possibly after extending the field". To go ( a little, but actually not really any way) beyond the example abx gives, the matrix is diagonalizable I and only if its minimum polynomial has no repeated factors. In particular, it is diagonalizable if the characteristic polynomial has no repeated factors. The characteristic polynomial only depends on the "main diagonal blocks". So, for any set of main diagonal blocks which give a multiplicity free characteristic polynomial, you can supplement it with any blocks you like above the main block diagonal, and still obtain a matrix which is diagonalizable. It is questionable whether this question is research level.