show/hide this revision's text 3 added 1527 characters in body

In response to a comment, here is some more detail (that doesn't itself fit into a comment).The question was about stability and how to prove convergence under the limiting process.

To prove existence, you don't need stability: just take a sequence of longer and longer rays, and choose a convergent subsequence. This exists because of compactness of the set of possible initial directions.

To prove uniqueness: this follows from the hyperbolicity of the flow. Think of the convex obstacles as trick mirrors that make you look skinny, cylinders with a convex cross-section. The convexity implies that reflected rays diverge at least as fast as they would from a flat mirror. Successive reflected images of the two mirrors in each other get thinner and thinner, so they narrow down to a unique point. (In the three-dimensional picture, they're also narrowing vertically, just at the relatively slow rate at which images shrink with distance in Euclidean space rather than at the exponential rate resulting from mirrors that are convex to 2nd order).

One way to formalize the discussion above is by use of triangle comparison theorems. Double the complement of the convex bodies to make a surface. The surface can be smoothly approximated by a surface of nonpositive curvature if it's comforting, but that's not technically necessary; the (intuitively obvious) statement about image sizes above become cases of the Toponogov comparison theorem.

show/hide this revision's text 2 Modified to get beyond the trivial case.; added 50 characters in body

Yes, there is always a trapped ray. The simplest way to see it is to find the path between the two bodies that minimizes length. It is necessarily perpendicular to both surfaces.

EDIT: I see the question was edited to ask for more than this trivial answer, so the new answer: there is a unique trapped ray from any starting point, but it is not trapped in backward time unless it is on the shortest path between the bodies. One can find it by minimizing distance of a zig-zag path alternately touching the two bodies a finite number of times, then passing to a limit.

Here is a generalization: suppose you have a collection of smooth disjoint convex shapes ${S_i}$ in the plane arranged in a way that no straight line intersects more than two. Then, for any doubly infinite sequence of indices $ \dots, i_{-1}, i_{0}, i_{1}, \dots $ such that $i_j \ne i_{j+1}$, there is a unique trajectory that intersects the shapes in that order, starting with $S_{i_1}$ in the positive direction and $S_{i_0}$ going backward. If the sequence is periodic, you can find the trajectory just as for the case of two objects. For the infinite case, you can take limits.

Even if the shapes are not convex, as long as they are smooth the trajectories still exist, but they are not necessarily unique. If you want to say something about the case when the obstacles are not smooth, you can extend the rule to make it a non-deterministic dynamical system, where a ray hitting a corner has choices which way to go.

This kind of system is classical dynamical systems, which has been well-understood since early last century. Perhaps someone more knowledgable will supply appropriate references. It is a limiting special case of the theory of the geodesic flow on surfaces of negative curvature.

show/hide this revision's text 1

Yes, there is always a trapped ray. The simplest way to see it is to find the path between the two bodies that minimizes length. It is necessarily perpendicular to both surfaces.

Here is a generalization: suppose you have a collection of smooth disjoint convex shapes ${S_i}$ in the plane arranged in a way that no straight line intersects more than two. Then, for any doubly infinite sequence of indices $ \dots, i_{-1}, i_{0}, i_{1}, \dots $ such that $i_j \ne i_{j+1}$, there is a unique trajectory that intersects the shapes in that order, starting with $S_{i_1}$ in the positive direction and $S_{i_0}$ going backward. If the sequence is periodic, you can find the trajectory just as for the case of two objects. For the infinite case, you can take limits.

Even if the shapes are not convex, as long as they are smooth the trajectories still exist, but they are not necessarily unique. If you want to say something about the case when the obstacles are not smooth, you can extend the rule to make it a non-deterministic dynamical system, where a ray hitting a corner has choices which way to go.

This kind of system is classical dynamical systems, which has been well-understood since early last century. Perhaps someone more knowledgable will supply appropriate references. It is a limiting special case of the theory of the geodesic flow on surfaces of negative curvature.