Let $V$ be the vector space you begin with.  As you probably know, transformations $T \in \operatorname{End}(V)$ that preserve a symmetric form $(-,-)$ of full rank are called orthogonal, and the group of these transformations is denoted $O(V)$ (let me work with transformations instead of matrices).

Now, given any other form $\langle -,- \rangle$, there must exist a transformation $A \in \operatorname{End}(V)$ such that $\langle v,w \rangle = (Av, w)$, since $(-,-)$ had full rank. More precisely, one can view forms as linear transformations $V \to V^*$ via the map $v \mapsto (v, -)$ and similarly $v \mapsto \langle v, - \rangle$, and full rank ones are invertible, so we can obtain $A$ by composing $\langle -,- \rangle$ with the inverse of $(-,-)$. This obtains the desired transformation $A$.

Thus you are asking for the subgroup of $O(V)$ which also preserves $\langle v, w \rangle = (Av, w)$. This is nothing but the subgroup of $O(V)$ of transformations which commute with $A$. Indeed, if $B$ is orthogonal, then $\langle Bv, Bw \rangle = (ABv, Bw) = (B^{-1} AB v, w)$, which equals $\langle v,w \rangle$ for all $v$ and $w$ if and only if $A=B^{-1}AB$. 

Computing this group is then a standard exercise in linear algebra. As pointed out by the next author, one can restrict to the generalized eigenspaces.  If you are working over the field of real numbers, then the generalized eigenspaces are all actual eigenspaces, and then, up to conjugation, your group is a direct product of $O(V_\lambda)$ for the real eigenspaces $V_\lambda$ along with $U(V_{\lambda,\bar \lambda})$ for the complex nonreal pairs of eigenvalues $\lambda, \bar \lambda$ (where $V_{\lambda, \bar \lambda} \subseteq V$ has the property that its complexification is the sum of complex eigenspaces of $\lambda$ and $\bar \lambda$, and the group $U(V_{\lambda,\bar \lambda})$ is the unitary group of $V_{\lambda, \bar \lambda}$ equipped with a complex structure and Hermitian form obtained from the original symmetric bilinear form). 

Of course this generalizes to the setting where you have your original nondegenerate symmetric form and $k$ other forms $v,w \mapsto (A_i v, w)$:  then you are interested in the subgroup of $O(V)$ of transformations commuting with all $A_i$.