Let $V$ be the vector space you begin with. As you probably know, transformations $T \in \operatorname{End}(V)$ that preserve a symmetric form $(-,-)$ of full rank are called orthogonal, and the group of these transformations is denoted $O(V)$ (let me work with transformations instead of matrices).
Now, given any other form $\langle -,- \rangle$, there must exist a transformation $A \in \operatorname{End}(V)$ such that $\langle v,w \rangle = (Av, w)$, since $(-,-)$ had full rank. More precisely, one can view forms as linear transformations $V \to V^*$ via the map $v \mapsto (v, -)$ and similarly $v \mapsto \langle v, - \rangle$, and full rank ones are invertible, so we can obtain $A$ by composing $\langle -,- \rangle$ with the inverse of $(-,-)$. This obtains the desired transformation $A$.
Thus you are asking for the subgroup of $O(V)$ which also preserves $\langle v, w \rangle = (Av, w)$. This is nothing but the subgroup of $O(V)$ of transformations which commute with $A$. Indeed, if $B$ is orthogonal, then $\langle Bv, Bw \rangle = (ABv, Bw) = (B^{-1} AB v, w)$, which equals $\langle v,w \rangle$ for all $v$ and $w$ if and only if $A=B^{-1}AB$.
Computing this group is then a standard exercise in linear algebra. As pointed out by the next author, one can restrict to the generalized eigenspaces of $A$, which are each preserved by all $B$ in the desired group. If you are working over the field of real numbers, then the generalized eigenspaces of $A \in O(V)$ are all actual eigenspaces, and then, up to conjugation, your group is a direct product of $O(V_\lambda)$ for the real eigenspaces $V_\lambda$ along with $U(V_{\lambda,\bar \lambda})$ for the complex nonreal pairs of eigenvalues $\lambda, \bar \lambda$ (where $V_{\lambda, \bar \lambda} \subseteq V$ has the property that its complexification is the sum of complex eigenspaces of $\lambda$ and $\bar \lambda$, and the group $U(V_{\lambda,\bar \lambda})$ is the unitary group of $V_{\lambda, \bar \lambda}$ equipped with a complex structure and Hermitian form obtained from the original symmetric bilinear form).
Of course this generalizes to the setting where you have your original nondegenerate symmetric form and $k$ other forms $v,w \mapsto (A_i v, w)$: then you are interested in the subgroup of $O(V)$ of transformations commuting with all $A_i$.