Let $V$ be the vector space you begin with. As you probably know, transformations $T \in \operatorname{End}(V)$ that preserve a symmetric form $(-,-)$ of full rank are called orthogonal, and the group of these transformations is denoted $O(V)$ (let me work with transformations instead of matrices).
Now, given any other form $\langle -,- \rangle$, there must exist a transformation $A \in \operatorname{End}(V)$ such that $\langle v,w \rangle = (Av, w)$, since $(-,-)$ had full rank. More precisely, one can view forms as linear transformations $V \to V^*$ via the map $v \mapsto (v, -)$ and similarly $v \mapsto \langle v, - \rangle$, and full rank ones are invertible, so we can obtain $A$ by composing $\langle -,- \rangle$ with the inverse of $(-,-)$. This obtains the desired matrix $A$.
Thus you are asking for the subgroup of $O(V)$ which also preserves $\langle v, w \rangle = (Av, w)$. This is nothing but the subgroup of $O(V)$ of transformations which commute with $A$. Indeed, if $B$ is orthogonal, then $\langle Bv, Bw \rangle = (ABv, Bw) = (B^{-1} AB v, w)$, which equals $\langle v,w \rangle$ for all $v$ and $w$ if and only if $A=B^{-1}AB$.
Of course this generalizes to the setting where you have your original nondegenerate symmetric form and $k$ other forms $v,w \mapsto (A_i v, w)$: then you are interested in the subgroup of $O(V)$ of transformations commuting with all $A_i$.