Let $R$ be a commutative ring. Let $\mathcal C$ be a category that has finitely many objects. The category algebra $R[\mathcal C]$ of $\mathcal C$ consists of finite sums $\sum a_i f_i$, where $f_i$ are morphisms of $\mathcal C$ and $a_i$ are elements of the ring $R$, with a multiplication operation $$ \sum a_i f_i \cdot \sum b_j g_j =\sum a_ib_j f_i\circ g_j $$ by using the composition $\circ$ in the category $\mathcal C$.
On the other hand, a multicategory $\mathcal D$ consists of objects, arrows, a composition operation, and identities, just like an ordinary category, the difference being that the domain of an arrow is not just a single object but a finite sequence of them.
Question: Could we imitate the construction of category algebras to define certain "multicategory algebra" $R[\mathcal D]$? If this sounds like a natural generalization, it seems strange to me since I can't find any reference. So, I'm afraid I'm overlooking something.