This question was popular in the 50s and 60s after Foelnerr theorem was proved. Many examples of weird Foelner sets were consttucted. The typical examples of groups where Foelner sets are nor balls are lamplighter groups and the wreath products of infinite cyclic gtoups.