Let $f(x)$ have the expansion $f(x)=x+c_3 x^3+c_4 x^4 +\cdots$, then define $y=x/a$ and you have
$$I=\int_0^{\infty}{dx}\ln \bigg(1+\exp\left(-\frac{f(x)}{a}\right)\bigg)$$
$$=\int_0^\infty \left[a\ln \left(1+e^{-y}\right)-\frac{a^3 c_3 y^3}{e^y+1}-\frac{a^4 c_4 y^4}{e^y+1}+{\cal O}(a^5)\right]\,dy$$
$$=\frac{1}{12} \pi ^2 a-\frac{7}{120} \pi ^4  c_3 a^3-\frac{45}{2} \zeta (5)c_4  a^4+{\cal O}(a^5).$$
The term of order $a^p$ has coefficient $-c_p\left(1-2^{-p}\right)p! \zeta (p+1)$, when $c_p$ is the coefficient of order $x^p$ in the expansion of $f(x)$.