There cannot be a "free coalgebra" functor, at least in what I think is the standard usage. Namely, suppose that "orange" is a type of algebraic object, for which there is a natural "forgetful" functor from "orange" objects to "blue" objects. Then the "free orange" functor from Blue to Orange is the left adjoint, if it exists, to the forgetful map from Orange to Blue.
Suppose that the forgetful map from coalgebras to vector spaces had a left adjoint; then it would itself be a right adjoint, and so would preserve products. Now the product in the category of coalgebras is something huge — think about the coproduct in the category of algebras, which is some sort of free product — and it's clear that the forgetful map does not preserve products.
On the other hand, the coproduct in the category of coalgebras is given by the direct sum of underlying vector spaces, and so the forgetful map does preserve coproducts. This suggests that it may itself be a left adjoint; i.e. it may have a right adjoint from vector spaces to coalgebras, which should be called the "cofree coalgebra" on a vector space.
Let me assume axiom of choice, so that I can present the construction in terms of a basis. Then I believe that the cofree coalgebra on the vector space with basis $L$ (for "letters") is the graded vector space whose basis consists of all words in $L$, with the comultiplication given by $\Delta(w) = \sum_{a,b| ab = w} a \otimes b$, where $a,b,w$ are words in $L$. I.e. the cofree coalgebra has the same underlying vector space as the free algebra, with the dual multiplication. It's clear that for finite-dimensional vector spaces, the cofree coalgebra on a vector space is (canonically isomorphic to) the graded dual of the free algebra on the dual vector space. Anyway, this is clearly a coalgebra, and the map to the vector space is zero on all words that are not singletons and identity on the singletons. I haven't checked the universal property, though.
I should mention that in my mind the largest difference between algebras and coalgebras (by which I mean, and I assume you mean also, "associative unital algebras in Vect" and "coassociative counital coalgebras in Vect", respectively) is one of finiteness. You hinted at the difference in your answer: if $A$ is a (coassociative counital) coalgebra (in Vect), then it is a colimit (sum) of its finite-dimensional subcoalgebras, and moreover if $X$ is any $A$-comodule, then $X$ is a colimit of its finite-dimensional sub-A-comodules. This is absolutely not true for algebras. It's just not the case that every algebra is a limit of its finite-dimensional quotient algebras. A good example is any field of infinite-dimension.
It follows from the finiteness of the corepresentation theory that a coalgebra can be reconstructed from its category of finite-dimensional corepresentations. Let $A$ be a coalgebra, $\text{f.d.comod}_A$ its category of finite-dimensional right comodules, and $F : \text{f.d.comod}_A \to \text{f.d.Vect}$ the obvious forgetful map. Then there is a coalgebra $\operatorname{End}^\vee(F)$, defined as some natural coequalizer in the same way that the algebra of natural transformations $F\to F$ is defines as some equalizer, and there is a canonical coalgebra isomorphism $A \cong \operatorname{End}^\vee(F)$. (Proof: see André Joyal and Ross Street, An introduction to Tannaka duality and quantum groups, Category theory (Como, 1990), Lecture Notes in Math., vol. 1488, Springer, Berlin, 1991, pp. 413–492. MR1173027 (93f:18015).)
For an algebra, on the other hand, knowing its finite-dimensional representation theory is not nearly enough to determine the algebra. Again, the example is of an infinite-dimensional field (e.g. the field of rational functions). On the other hand, it is true that knowing the full representation theory of an algebra determines the algebra. Namely, if $A$ is an (associcative, unital) algebra (in Vect), $\text{mod}_A$ its category of all right modules, and $F: \text{mod}_A \to \text{Vect}$ the forgetful map, then there is a canonical isomorphism $A \cong \operatorname{End}(F)$. (Proof: $F$ has a left adjoint, $V \mapsto V\otimes A$. But $V \mapsto V\otimes \operatorname{End}(F)$ is also left-adjoint to $F$. The algebra structure comes from the adjunction: the $\text{mod}_A$ map $A\otimes A \to A$ corresponds to the vector space map $\operatorname{id}: A\to A$.) ((Note that you don't actually need the full representation theory, which probably doesn't exist foundationally, but you do need modules at least as large as $A$.))
All this all means is that if you believe that almost everything is finite-dimensional, you should reject algebras as "wrong" and coalgebras as "right", whereas if you like infinite-dimensional objects, algebras are the way to go.