Take $A$ to be a product of two fields, e.g. $\mathbb{Z}/6$. All localizations at prime ideals are fields, but there are non-split short exact sequences of $A$-modules.