Who first used the corner quotes, $\ulcorner$ and $\urcorner$, for the notion of Gödel number? They can also be written as\Godelnum
with Sam Buss's macro.
They were used by Joseph R. Shoenfield, in Mathematical Logic, 1967, as from page 122.
The corner quotes are used prevalently in provability logic, and in other areas of logic. Two important citations are Craig Smorynski, “The Incompleteness Theorems”, in Handbook of Mathematical Logic, as from 1st edition 1979; and Paanu Raatikainen, “Gödel's incompleteness theorems”, in Stanford Encyclopedia of Philosophy.
Edit: The corner quotes $\ulcorner\urcorner$ were indeed first used by Quine, and long before Shoenfield, but not for the notion of Gödel number.
Edit 2: I do not find the corner quotes in Martin Davis, The Undecidable, or in the books by Moztowski or Kleene.