Take the graph on $2k+2$ vertices $x_0, \ldots, x_k, y_0, \ldots, y_k$ with an edge between any pair of distinct vertices except $(x_i, y_i)$ for $0\le i \le k$. There are plenty of $2$-factors, e.g. the Hamiltonian cycle $x_0 \to \ldots \to x_k \to y_0 \to \ldots \to y_k \to x_0$. Removing all the edges on this Hamiltonian cycle also gives a $1$-factor.
This is clearly the smallest number of vertices you can have since a any $2k$-regular simple graph has at least $2k+1$ vertices and the existence of a $1$-factor forces an even number of vertices.