Consider the following adaptive strategy for sampling from a Multi Armed Bandit with $K$ arms:

1) Split the $T$ rounds into $N (\in \mathbb{N})$ disjoint intervals. Each interval is indexed by $i=1,2,\dots,N$. We assume $N$ is fixed and $T>>N$.
2) For each interval $i$, we have an allocation function $w_i: ((w_1,\bar{X}_1),(w_2,\bar{X}_2),\dots,(w_{i-1},\bar{X}_{i-1})) \to \Delta_K$, i.e, a map from the history of allocations and sample averages it decides to sample the arm $a$ in the $i^{th}$ interval according to the proportions $w_i(a)$. Here $\bar{X}_i$ denotes the $K$-dimensional vector containing the $K$ sample means (one for each arm) from the $i^{th}$ disjoint interval.

Question 1: Does the $N$-tuple $(\bar{X}_1,\bar{X}_2,\dots, \bar{X}_N)$ satisfy a LDP as $T \to \infty$? If indeed it does, it would be great to get a closed form dependence on allocation functions $w_i$ in the rate function. Any sort of (reasonable) regularity assumption on arm distribution might added to derive the result.

For $N=1$ it is known to be true regardless of the nature of the allocation function $w_1$. See for example [Glynn-Juneja 04][1] for a simple argument based on Gartner Ellis. Based on their work, intuitively for $N\geq 2$ it feels like the rate function should have the form :
$$
\frac{1}{N}\sum^{N}_{i=1}\sum^{K}_{a=1}w_i(u_1,\dots,u_{i-1})(a)I_a(u_{i,a})
$$
where $I_a(.)$ is rate function associated with an individual arm, and the large deviation exponent for a set $A$ has the form:
$$
\underset{(u_1,u_2,\dots,u_N) \in A}{inf} \frac{1}{N}\sum^{N}_{i=1}\sum^{K}_{a=1}w_i(u_1,\dots,u_{i-1})(a)I_a(u_{i,a}).
$$

This form has an intuitive appeal-  we take the deviations of each arm in a disjoint interval $i$ and then sum them across arms and intervals in an appropriate weighted manner. 

For $N=2$, I feel one can again use Gartner Ellis in the following nested manner:

Consider the mgf for $(\bar{X}_1,\bar{X}_2)$:

\begin{aligned}
e^{\Lambda_T(T\lambda)}&=E[e^{\langle T \lambda,(\bar{X}_1,\bar{X}_2)\rangle}]\\
&=\int e^{\langle T \lambda_1,u_1\rangle}E[e^{\langle T \lambda_2,\bar{X}_2\rangle}|\bar{X}_1=u_1]\mathbb{P}_T(\bar{X}_1 \in du_1)\\
&=\int e^{\langle T \lambda_1,u_1\rangle}e^{T/2\cdot(\sum_a w_2(u_1)(a)\Lambda_a(2\lambda_{2,a}/w_2(u_1)(a))}\mathbb{P}_T(\bar{X}_1 \in du_1)\\
&=\int e^{T(\langle \lambda_1,u_1\rangle+\frac{1}{2}\sum_a w_2(u_1)(a)\Lambda_a(2\lambda_{2,a}/w_2(u_1)(a))}\mathbb{P}_T(\bar{X}_1 \in du_1)
\end{aligned}
where $\Lambda$'s are the appropriate cumulant functions for various distributions. Now from the result of $N=1$ we note that the family of measures $(\mathbb{P}_T(\bar{X}_1 \in \cdot))_{T \in \mathbb{N}}$ satisfies an LDP with rate function:
$$
\frac{1}{2}\sum_a w_1(a)I_a(.)
$$
and hence one can invoke Varadhan's lemma to evaluate the limit:
\begin{aligned}
\underset{T \to \infty}{lim}\frac{\Lambda_T(T\lambda)}{T}&=\underset{T \to \infty}{lim}\frac{\log\big( \int e^{T(\langle \lambda_1,u_1\rangle+\frac{1}{2}\sum_a w_2(u_1)(a)\Lambda_a(2\lambda_{2,a}/w_2(u_1)(a))}\mathbb{P}_T(\bar{X}_1 \in du_1)\big)}{T}\\
&=\underset{u_1}{sup}(\langle \lambda_1,u_1\rangle+\frac{1}{2}\sum_a w_2(u_1)(a)\Lambda_a(2\lambda_{2,a}/w_2(u_1)(a))-\frac{1}{2}\sum_a w_1(a)I_a(u_{1,a})
\end{aligned}

Thus the usual Gartner Eliis limit will exist and $(\bar{X}_1,\bar{X}_2)$ will satisfy a LDP with rate function which is the fenchel conjugate of the above limit.

Question 2: Is the above obtained rate function just a disguised version of the heuristic guess we have for $N=2$? I haven't been able to relate the two rate functions.

  [1]: https://web.stanford.edu/~glynn/papers/2004/GJuneja04.pdf