Hilbert spaces don't generally have nice bases in the sense of linear algebra. Neither does the ring of formal power series $k[[X]]$ over a field $k$. (These have "bases" with "infinite linear combinations" that only make sense because of completeness.)