One can define a height with respect to a special metric so that some particular useful equation involving the height holds exactly, instead of approximately as for the Weil height.
For example, one can define the canonical height using a metrized line bundle. This puts it on the same footing as the Weil height and not defined only as a limit of Weil heights composed with various maps.
More substantially, the Faltings height was defined this way, using a metrized line bundle on the moduli stack of abelian varieties. The invariance of the Faltings height under isogenies associated to p-divisible groups was crucial in Faltings' proof of the Mordell and Shafarevich conjectures.