Let $A$ be a commutative ring with 1, $I$ an ideal in $A$, $B$ an $A$-algebra. I am trying to prove the following isomorphism of $A$-algebras: $$ \big( A^* \otimes _A B \big) ^* \cong B^* $$ "$^*$" denotes the $I$-adic completion: every $A$-algebra $X$ may be endowed with the $I$-adic topology, defined by the ideal $IX$ in $X$, and the $I$-adic completion of the algebra is the completion with respect to this (uniform) topology.
I have so far been able to prove that the image of $B$ in $T :=A^*\otimes_A B$ under the map $1 \otimes id \colon B \to T$ is dense in $A$. At this stage I considered the map $(1 \otimes id)^* \colon B^* \to T^*$, and tried to show that it is an isomorphism, but I'm having troubles both with the injectivity and the surjectivity of this mapping.
Are these $A$-algebras always isomorphic? If so, how can this be proven? If not, how can a counterexample be constructed, and what do I have to require (Noetherity? Flatness? Finiteness?) for them to be isomorphic?