$\newcommand{\Gal}{\mathrm{Gal}} \newcommand{\GL}{\mathrm{GL}} \newcommand{\Q}{\mathbf Q} \newcommand{\F}{\mathbf F} \newcommand{\s}{\mathrm{s}} \newcommand{\nr}{\mathrm{nr}} \newcommand{\t}{\mathrm{t}}$

Let me explain Serre's definition in the case of a finite extension $K$ of $\Q_p$ ($p$ prime).  In his notation, $K_\s$ is an algebraic closure of $K$, $K_\t$ is the maximal tamely ramified extension of $K$ in $K_\s$, $K_\nr$ is the maximal unramified extension of $K$ in $K_\t$, and $I_\t=\Gal(K_\t|K_\nr)$.  The common residue field $k_\s$ of $K_\s$, $K_\t$, and $K_\nr$  is an algebraic closure of the finite field $\F_p$.

So inside $k_\s$ you have all the finite extensions $\F_{p^n}$ of $\F_p$, with norm maps $\F_{p^m}^\times\to\F_{p^n}^\times$ whenever $n|m$.  The first thing to observe is that there is a natural identification $\theta$ of $I_\t$ with the inverse limit of this system of norm maps (prop. 2)

As such, for each power $q=p^n$ of $p$, there is a natural projection $\theta_{q-1}:I_\t\to\F_q^\times$, which you might call *the* fundamental character of level $n$.  When you compose it with some power $\varphi^i$ of the automorphism $\varphi:x\mapsto x^p$ of $\F_q^\times$, you get all the other fundamental characters of level $n$.  There are thus $n$ fundmental characters of level $n$, namely $\varphi^i\circ\theta_{q-1}=\theta_{q-1}^{p^i}$ for $i\in[0,n[$.

Here is how to think of $\theta_{q-1}$ concretely.  Take a uniformiser $\pi$ of $K_\nr$ and adjoin its $(q-1)$-th root $\root q-1\of\pi$ to get the extension $L_{q-1}$ of $K_\nr$ in $K_\t$; this extension does not depend on the choice of $\pi$.  On the one hand, the group $\Gal(L_{q-1}|K_\nr)$ is a quotient of $I_\t$.  On the other hand, $\Gal(L_{q-1}|K_\nr)$ is naturally isomorphic to the group $\mu_{q-1}$ of $(q-1)$-th roots of $1$ (under $\zeta\mapsto(\root q-1\of\pi\mapsto\zeta.\root q-1\of\pi$)), which is naturally isomorphic (under reduction modulo $\pi$) to the group $\F_q^\times$.  The character $\theta_{q-1}$ is just the composite
$$
I_\t\to\Gal(L_{q-1}|K_\nr)\to\mu_{q-1} \to\F_q^\times.
$$

I'll leave it to the experts to elucidate the role of fundamental characters in Serre's modularity conjecture (now a theorem).  I believe they serve to define the *optimal weight* of a cuspidal eigenform from which  a given odd irreducible representation $\Gal(\bar{\Q}|\Q)\to\GL_2(\bar{\F}_p)$ arises.