Yes.
Indeed, it is the assumption on $\cal B$ that suffices to promote an apparently weaker condition (preservation of monoidal structure -- a mere algebraic condition) into a stronger one (preservation of cartesian monoidal structure).
To see this, consider the following fact:
A cartesian monoidal category is a monoidal category such that each object is a cocommutative comonoid in a unique way and each map is a comonoid homomorphism.
This is easy to see in one direction: the comonoid structure is given by the diagonal map $\Delta_X:X \to X \times X$ and the terminal map $!_X:X \to 1$, and by universal property these commute with all morphisms in the category. Viceversa, given such a structure, one can obtain a limiting cone $X \overset{\pi_X}\leftarrow X \otimes Y \overset{\pi_Y}\to Y$ by setting $\pi_X = X \otimes !_Y$ and $\pi_Y = !_X \otimes X$ (I'm ignoring the unitors for convenience). To conclude this is a product, one has a (tiny) bit more work to do: see Theorem 6.13 here.
Anyway, this gives a very easy way to check that $F$ preserves products: since it is strong monoidal, it maps the unique comonoid structure on any $A: \cal A$ to a comonoid in $\cal B$. But since $\cal B$ is cartesian monoidal, such a comonoid structure can only be the unique comonoid structure on $FA$. Since projections and diagonals are constructed out of this structure, this shows $F$ preserves products. Indeed, let $A \times A'$ be a product in $\cal A$, then
$$
F\pi_A = F(A \times !_{A'}) = FA \times F!_{A'} = FA \times !_{FA'} = \pi_{FA}
$$
and likewise for diagonals.
N.B.: it is crucial that $F$ preserves the symmetry, since it is crucial that these comonoids are cocommutative in order to get products.