(I assume $S$ is finite, the essential case.) The answer is affirmative if and only if $G$ extends to a reductive $O_{F,S}$-group scheme (i.e., a smooth affine $O_{F,S}$-group with connected reductive fibers). This is a genuine restriction, since for any Dedekind domain $A$ and any smooth affine group $H$ over the fraction field $K$ of $A$ (e.g., $A=O_F$ and $G$ as above) there exists a smooth affine $A$-group with generic fiber $H$ (indeed, take the schematic closure of $H$ in ${\rm{GL}}_{n,A}$ relative to a choice of $K$-subgroup inclusion of $H$ into some ${\rm{GL}}_n$ to get a flat affine $A$-group of finite type with generic fiber $H$, and then apply the "group smoothening" process of Neron-Raynaud). So merely having an "$A$-model" in the sense of a smooth affine $A$-group is not a genuine constraint on a given smooth affine $K$-group; it is "spreading out" the reductivity condition that is the non-trivial feature.
IndeedIn the given situation over a number field, therethere is some finite $S' \supset S$ so that $G$ is the $F$-fiber of a reductive $O_{F,S'}$-group $\mathscr{G}$:. Indeed, this follows from general "denominator-chasing" principles adapted to the context of reductive group schemes (see either [SGA3, XIX, 2.1.6] combined with constructibility for the locus of geometrically connected fibers [EGA IV$_3$, 9.7.7], or Prop. 3.1.9(1) or Corollary 3.1.11 in the article "Reductive Group Schemes" from the Proceedings of the 2011 Luminy summer school on SGA3). It is then automatic from smoothness of the schemes of Borel subgroups and of maximal tori for a reductive group scheme, as well as finiteness of the residue fields for $F$ at its finite places, that for every $v \not\in S'$ the $F_v$-group $G_{F_v}$ is quasi-split and becomes split over a finite unramified extension of $F_v$ (see Corollary 5.2.14 in "Reductive Group Schemes").