$\newcommand{\R}{\mathbb{R}}\newcommand{\Z}{\mathbb{Z}}\newcommand{\de}{\delta}\newcommand{\ol}{\overline}$The property of $\R$ that you want to prove is that the topological space $\R$ is normal. All metric spaces are perfectly normal and hence normal. This proves your desired result.
That all metric spaces are normal immediately follows e.g. from Theorems 5.1.3 and 5.1.5 of the book by Engelking: Theorem 5. These two theorems are due, respectively, to Stone and Dieudonné1. They state, respectively,3 (due to Stone; see also the short proof by M. E. Rudin) states that every metrizable space is paracompact, and Theorem 5.1.5 (due to Dieudonné) states that every paracompact space is normal.
Here is an elementary, self-contained proof:
For each $n\in\Z$, the set \begin{equation*} F_n:=F\cap[n,n+1] \tag{1} \end{equation*} is closed and bounded, and hence a compact subset of the open set $V$, so that there is some $\de_n\in(0,1)$ such that \begin{equation*} \ol{U_n}\subseteq V, \tag{2} \end{equation*} where \begin{equation*} U_n:=(F_n)_{\de_n}, \tag{3} \end{equation*} the open $\de_n$-neighborhood of $F_n$.
Let finally \begin{equation*} U:=\bigcup_{n\in Z}U_n, \tag{4} \end{equation*} so that $U$ is an open set containing $F$.
It remains to show that $\ol U\subseteq V$. Take any $x\in\ol U$, so that $x=\lim_{k\to\infty}x_k$ for some sequence $(x_k)$ in $U$. Without loss of generality, for some natural $N$ and all natural $k$ we have $x_k\in U\cap[N-1,N+1]$. The conditions $F_n\subseteq[n,n+1]$, (3), and $\de_n\in(0,1)$ imply \begin{equation*} \ol{U_n}\subseteq[n-1,n+2]. \end{equation*} Hence, by (4), for all natural $k$ we have \begin{equation*} x_k\in\bigcup_{n\colon\,[n-1,n+2]\cap[N-1,N+1]\ne\emptyset}U_n\ \subseteq\bigcup_{n=N-3}^{N+2}U_n. \end{equation*} So, \begin{equation*} x\in\bigcup_{n=N-3}^{N+2}\ol{U_n}\subseteq V, \end{equation*} by (2). Thus, indeed $\ol U\subseteq V$. $\quad\Box$
(The part $V\ne\R$ of your condition $V\subsetneq\R$ is not needed here; looking at this condition, it seems that you are using $\subset$ for $\subseteq$.)