The condition you want is $X$ a locally noetherian scheme. Then by Hartshorne's "Residues & Dualities" Proposition 7.17, $\cal{F}$ is an injective ${\cal O}_X$-module if and only if for each $x \in X$, the stalks ${\cal F}_x$ are injective ${\cal O}_x$-modules. If the sections are injective ${\cal O}_X(U)$-modules, that should give injectivity on the stalks. For the reverse question, I think you need $X$ to be noetherian.
Robert K
- 309
- 1
- 8