That's a nice question and I like your conjectured possible form of a local condition. It reminds me of various theorems about convex sets such as [Helly's Theorem][1]. I think I can see that an ordered list of points are the vertices of a convex polygon (in clockwise order) exactly if your lists restricted to those points are the same list with a deletion. Given such a convex polygon we can also tell which points are inside it and which outside. I'd guess that $N=4$ is enough. Also that if one knows the lists for every $4$ point set then one can reconstruct all the convex polygons. That would seem to follow from [Carthéodory's Theorem][2].



  [1]: https://en.wikipedia.org/wiki/Helly's_theorem
  [2]: https://en.wikipedia.org/wiki/Carath%C3%A9odory%27s_theorem_(convex_hull)